[jira] [Commented] (HIVE-7173) Support HIVE-4867 on mapjoin of MR Tasks
[
https://issues.apache.org/jira/browse/HIVE-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1402#comment-1402
]
Hive QA commented on HIVE-7173:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12648846/HIVE-7173.2.patch.txt
{color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 5530 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority2
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_ctas
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimal
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalX
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalXY
org.apache.hive.hcatalog.templeton.tool.TestTempletonUtils.testPropertiesParsing
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/408/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/408/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-408/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 7 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12648846
> Support HIVE-4867 on mapjoin of MR Tasks
>
>
> Key: HIVE-7173
> URL: https://issues.apache.org/jira/browse/HIVE-7173
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
>Reporter: Navis
>Assignee: Navis
>Priority: Minor
> Attachments: HIVE-7173.1.patch.txt, HIVE-7173.2.patch.txt
>
>
> HIVE-4867 dedups columns in RS for reducer join and RS for order-by. But
> small aliases of mapjoin of MR tasks still contains key columns in value
> exprs.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7136) Allow Hive to read hive scripts from any of the supported file systems in hadoop eco-system
[ https://issues.apache.org/jira/browse/HIVE-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021109#comment-14021109 ] Sumit Kumar commented on HIVE-7136: --- Sure, will update the documentation. > Allow Hive to read hive scripts from any of the supported file systems in > hadoop eco-system > --- > > Key: HIVE-7136 > URL: https://issues.apache.org/jira/browse/HIVE-7136 > Project: Hive > Issue Type: Improvement > Components: CLI >Affects Versions: 0.13.0 >Reporter: Sumit Kumar >Assignee: Sumit Kumar >Priority: Minor > Fix For: 0.14.0 > > Attachments: HIVE-7136.01.patch, HIVE-7136.patch > > > Current hive cli assumes that the source file (hive script) is always on the > local file system. This patch implements support for reading source files > from other file systems in hadoop eco-system (hdfs, s3 etc) as well keeping > the default behavior intact to be reading from default filesystem (local) in > case scheme is not provided in the url for the source file. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7136) Allow Hive to read hive scripts from any of the supported file systems in hadoop eco-system
[ https://issues.apache.org/jira/browse/HIVE-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021107#comment-14021107 ] Lefty Leverenz commented on HIVE-7136: -- This could be documented (with a Hive 0.14 release note) in the wiki here: * [CLI -- Hive Batch Mode Commands | https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Cli#LanguageManualCli-HiveBatchModeCommands] with one or two examples here: * [CLI -- Examples | https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Cli#LanguageManualCli-Examples] > Allow Hive to read hive scripts from any of the supported file systems in > hadoop eco-system > --- > > Key: HIVE-7136 > URL: https://issues.apache.org/jira/browse/HIVE-7136 > Project: Hive > Issue Type: Improvement > Components: CLI >Affects Versions: 0.13.0 >Reporter: Sumit Kumar >Assignee: Sumit Kumar >Priority: Minor > Fix For: 0.14.0 > > Attachments: HIVE-7136.01.patch, HIVE-7136.patch > > > Current hive cli assumes that the source file (hive script) is always on the > local file system. This patch implements support for reading source files > from other file systems in hadoop eco-system (hdfs, s3 etc) as well keeping > the default behavior intact to be reading from default filesystem (local) in > case scheme is not provided in the url for the source file. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7053) Unable to fetch column stats from decimal columns
[
https://issues.apache.org/jira/browse/HIVE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xuefu Zhang updated HIVE-7053:
--
Attachment: HIVE-7053.patch
Newly attached patch addressed:
1. Rebased with trunk
2. Added a test case.
> Unable to fetch column stats from decimal columns
> -
>
> Key: HIVE-7053
> URL: https://issues.apache.org/jira/browse/HIVE-7053
> Project: Hive
> Issue Type: Bug
> Components: Statistics
>Affects Versions: 0.13.0
>Reporter: Xuefu Zhang
>Assignee: Xuefu Zhang
> Attachments: HIVE-7053.patch
>
>
> After HIVE-6701, column stats for decimal columns can be computed. However,
> when the stats are fetched, nothing is returned. The problem was originally
> reproducible using thrift API. With the patch in HIVE-7050, the problem can
> be also produced using "desc formatted table column".
> {code}
> hive> desc formatted dec i;
> OK
> # col_namedata_type min
> max num_nulls distinct_count
> avg_col_len max_col_len num_trues
> num_falses comment
>
>
> i int 0 4
> 0 5 null
> nullnullnull
> from deserializer
> hive> desc formatted dec d;
> OK
> # col_namedata_type min
> max num_nulls distinct_count
> avg_col_len max_col_len num_trues
> num_falses comment
>
>
> d decimal(5,2)from deserializer
>
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HIVE-7053) Unable to fetch column stats from decimal columns
[
https://issues.apache.org/jira/browse/HIVE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xuefu Zhang updated HIVE-7053:
--
Attachment: (was: HIVE-7053.patch)
> Unable to fetch column stats from decimal columns
> -
>
> Key: HIVE-7053
> URL: https://issues.apache.org/jira/browse/HIVE-7053
> Project: Hive
> Issue Type: Bug
> Components: Statistics
>Affects Versions: 0.13.0
>Reporter: Xuefu Zhang
>Assignee: Xuefu Zhang
>
> After HIVE-6701, column stats for decimal columns can be computed. However,
> when the stats are fetched, nothing is returned. The problem was originally
> reproducible using thrift API. With the patch in HIVE-7050, the problem can
> be also produced using "desc formatted table column".
> {code}
> hive> desc formatted dec i;
> OK
> # col_namedata_type min
> max num_nulls distinct_count
> avg_col_len max_col_len num_trues
> num_falses comment
>
>
> i int 0 4
> 0 5 null
> nullnullnull
> from deserializer
> hive> desc formatted dec d;
> OK
> # col_namedata_type min
> max num_nulls distinct_count
> avg_col_len max_col_len num_trues
> num_falses comment
>
>
> d decimal(5,2)from deserializer
>
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7053) Unable to fetch column stats from decimal columns
[
https://issues.apache.org/jira/browse/HIVE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021101#comment-14021101
]
Ashutosh Chauhan commented on HIVE-7053:
+1
> Unable to fetch column stats from decimal columns
> -
>
> Key: HIVE-7053
> URL: https://issues.apache.org/jira/browse/HIVE-7053
> Project: Hive
> Issue Type: Bug
> Components: Statistics
>Affects Versions: 0.13.0
>Reporter: Xuefu Zhang
>Assignee: Xuefu Zhang
> Attachments: HIVE-7053.patch
>
>
> After HIVE-6701, column stats for decimal columns can be computed. However,
> when the stats are fetched, nothing is returned. The problem was originally
> reproducible using thrift API. With the patch in HIVE-7050, the problem can
> be also produced using "desc formatted table column".
> {code}
> hive> desc formatted dec i;
> OK
> # col_namedata_type min
> max num_nulls distinct_count
> avg_col_len max_col_len num_trues
> num_falses comment
>
>
> i int 0 4
> 0 5 null
> nullnullnull
> from deserializer
> hive> desc formatted dec d;
> OK
> # col_namedata_type min
> max num_nulls distinct_count
> avg_col_len max_col_len num_trues
> num_falses comment
>
>
> d decimal(5,2)from deserializer
>
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HIVE-7053) Unable to fetch column stats from decimal columns
[
https://issues.apache.org/jira/browse/HIVE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xuefu Zhang updated HIVE-7053:
--
Status: Patch Available (was: Open)
> Unable to fetch column stats from decimal columns
> -
>
> Key: HIVE-7053
> URL: https://issues.apache.org/jira/browse/HIVE-7053
> Project: Hive
> Issue Type: Bug
> Components: Statistics
>Affects Versions: 0.13.0
>Reporter: Xuefu Zhang
>Assignee: Xuefu Zhang
> Attachments: HIVE-7053.patch
>
>
> After HIVE-6701, column stats for decimal columns can be computed. However,
> when the stats are fetched, nothing is returned. The problem was originally
> reproducible using thrift API. With the patch in HIVE-7050, the problem can
> be also produced using "desc formatted table column".
> {code}
> hive> desc formatted dec i;
> OK
> # col_namedata_type min
> max num_nulls distinct_count
> avg_col_len max_col_len num_trues
> num_falses comment
>
>
> i int 0 4
> 0 5 null
> nullnullnull
> from deserializer
> hive> desc formatted dec d;
> OK
> # col_namedata_type min
> max num_nulls distinct_count
> avg_col_len max_col_len num_trues
> num_falses comment
>
>
> d decimal(5,2)from deserializer
>
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7065) Hive jobs in webhcat run in default mr mode even in Hive on Tez setup
[
https://issues.apache.org/jira/browse/HIVE-7065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021079#comment-14021079
]
Lefty Leverenz commented on HIVE-7065:
--
This looks like it should be documented in the wiki:
* [WebHCat Configuration -- Configuration Variables |
https://cwiki.apache.org/confluence/display/Hive/WebHCat+Configure#WebHCatConfigure-ConfigurationVariables]
{quote}
*templeton.hive.properties* -- Properties to set when running Hive. To use it
in a cluster with Kerberos security enabled, set
hive.metastore.sasl.enabled=false and add hive.metastore.execute.setugi=true.
Using localhost in metastore uri does not work with Kerberos security.
{quote}
Revise as "Properties to set when running Hive (during job sumission)" or
perhaps that should be "Properties set (during job submission) when running
Hive."
Should hive.execution.engine be mentioned for releases prior to 0.14?
> Hive jobs in webhcat run in default mr mode even in Hive on Tez setup
> -
>
> Key: HIVE-7065
> URL: https://issues.apache.org/jira/browse/HIVE-7065
> Project: Hive
> Issue Type: Bug
> Components: Tez, WebHCat
>Affects Versions: 0.13.0
>Reporter: Eugene Koifman
>Assignee: Eugene Koifman
> Fix For: 0.14.0
>
> Attachments: HIVE-7065.1.patch, HIVE-7065.patch
>
>
> WebHCat config has templeton.hive.properties to specify Hive config
> properties that need to be passed to Hive client on node executing a job
> submitted through WebHCat (hive query, for example).
> this should include "hive.execution.engine"
> NO PRECOMMIT TESTS
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7194) authorization_ctas.q failing on trunk
[ https://issues.apache.org/jira/browse/HIVE-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021073#comment-14021073 ] Thejas M Nair commented on HIVE-7194: - Old error is correct one, only SELECT is required on t1 for the operation. I will look into why that changed. > authorization_ctas.q failing on trunk > - > > Key: HIVE-7194 > URL: https://issues.apache.org/jira/browse/HIVE-7194 > Project: Hive > Issue Type: Task > Components: Authorization >Reporter: Ashutosh Chauhan >Assignee: Thejas M Nair > Attachments: HIVE-7194.patch > > > Need to update .q.out file -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Assigned] (HIVE-7194) authorization_ctas.q failing on trunk
[ https://issues.apache.org/jira/browse/HIVE-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair reassigned HIVE-7194: --- Assignee: Thejas M Nair (was: Ashutosh Chauhan) > authorization_ctas.q failing on trunk > - > > Key: HIVE-7194 > URL: https://issues.apache.org/jira/browse/HIVE-7194 > Project: Hive > Issue Type: Task > Components: Authorization >Reporter: Ashutosh Chauhan >Assignee: Thejas M Nair > Attachments: HIVE-7194.patch > > > Need to update .q.out file -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7168) Don't require to name all columns in analyze statements if stats collection is for all columns
[
https://issues.apache.org/jira/browse/HIVE-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021060#comment-14021060
]
Lefty Leverenz commented on HIVE-7168:
--
This should be documented with a Hive 0.14 release note in the wiki:
* [Statistics in Hive -- Existing Tables |
https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-ExistingTables]
{code}
ANALYZE TABLE tablename [PARTITION(partcol1[=val1], partcol2[=val2], ...)]
COMPUTE STATISTICS [noscan];
{code}
{quote}
When the user issues that command, he may or may not specify the partition
specs. If the user doesn't specify any partition specs, statistics are gathered
for the table as well as all the partitions (if any). If certain partition
specs are specified, then statistics are gathered for only those partitions.
When computing statistics across all partitions, the partition columns still
need to be listed.
{quote}
> Don't require to name all columns in analyze statements if stats collection
> is for all columns
> --
>
> Key: HIVE-7168
> URL: https://issues.apache.org/jira/browse/HIVE-7168
> Project: Hive
> Issue Type: Improvement
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Fix For: 0.14.0
>
> Attachments: HIVE-7168.1.patch, HIVE-7168.2.patch, HIVE-7168.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HIVE-7173) Support HIVE-4867 on mapjoin of MR Tasks
[ https://issues.apache.org/jira/browse/HIVE-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7173: Status: Patch Available (was: Open) > Support HIVE-4867 on mapjoin of MR Tasks > > > Key: HIVE-7173 > URL: https://issues.apache.org/jira/browse/HIVE-7173 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Navis >Assignee: Navis >Priority: Minor > Attachments: HIVE-7173.1.patch.txt, HIVE-7173.2.patch.txt > > > HIVE-4867 dedups columns in RS for reducer join and RS for order-by. But > small aliases of mapjoin of MR tasks still contains key columns in value > exprs. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7173) Support HIVE-4867 on mapjoin of MR Tasks
[ https://issues.apache.org/jira/browse/HIVE-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7173: Attachment: HIVE-7173.2.patch.txt > Support HIVE-4867 on mapjoin of MR Tasks > > > Key: HIVE-7173 > URL: https://issues.apache.org/jira/browse/HIVE-7173 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Navis >Assignee: Navis >Priority: Minor > Attachments: HIVE-7173.1.patch.txt, HIVE-7173.2.patch.txt > > > HIVE-4867 dedups columns in RS for reducer join and RS for order-by. But > small aliases of mapjoin of MR tasks still contains key columns in value > exprs. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7110) TestHCatPartitionPublish test failure: No FileSystem or scheme: pfile
[
https://issues.apache.org/jira/browse/HIVE-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020982#comment-14020982
]
Eugene Koifman commented on HIVE-7110:
--
I see the same test failure on current tunk (OSX 10.8.5)
> TestHCatPartitionPublish test failure: No FileSystem or scheme: pfile
> -
>
> Key: HIVE-7110
> URL: https://issues.apache.org/jira/browse/HIVE-7110
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: David Chen
>Assignee: David Chen
> Attachments: HIVE-7110.1.patch, HIVE-7110.2.patch, HIVE-7110.3.patch,
> HIVE-7110.4.patch
>
>
> I got the following TestHCatPartitionPublish test failure when running all
> unit tests against Hadoop 1. This also appears when testing against Hadoop 2.
> {code}
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 26.06 sec
> <<< FAILURE! - in org.apache.hive.hcatalog.mapreduce.TestHCatPartitionPublish
> testPartitionPublish(org.apache.hive.hcatalog.mapreduce.TestHCatPartitionPublish)
> Time elapsed: 1.361 sec <<< ERROR!
> org.apache.hive.hcatalog.common.HCatException:
> org.apache.hive.hcatalog.common.HCatException : 2001 : Error setting output
> information. Cause : java.io.IOException: No FileSystem for scheme: pfile
> at
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1443)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1464)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:263)
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
> at
> org.apache.hive.hcatalog.mapreduce.HCatOutputFormat.setOutput(HCatOutputFormat.java:212)
> at
> org.apache.hive.hcatalog.mapreduce.HCatOutputFormat.setOutput(HCatOutputFormat.java:70)
> at
> org.apache.hive.hcatalog.mapreduce.TestHCatPartitionPublish.runMRCreateFail(TestHCatPartitionPublish.java:191)
> at
> org.apache.hive.hcatalog.mapreduce.TestHCatPartitionPublish.testPartitionPublish(TestHCatPartitionPublish.java:155)
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7194) authorization_ctas.q failing on trunk
[
https://issues.apache.org/jira/browse/HIVE-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020934#comment-14020934
]
Hive QA commented on HIVE-7194:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12648822/HIVE-7194.patch
{color:red}ERROR:{color} -1 due to 9 failed/errored test(s), 5605 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_insert1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_scriptfile1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_dml
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
org.apache.hadoop.hive.cli.TestNegativeMinimrCliDriver.testNegativeCliDriver_minimr_broken_pipe
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimal
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalX
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalXY
org.apache.hive.hcatalog.templeton.tool.TestTempletonUtils.testPropertiesParsing
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/407/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/407/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-407/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 9 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12648822
> authorization_ctas.q failing on trunk
> -
>
> Key: HIVE-7194
> URL: https://issues.apache.org/jira/browse/HIVE-7194
> Project: Hive
> Issue Type: Task
> Components: Authorization
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-7194.patch
>
>
> Need to update .q.out file
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HIVE-7173) Support HIVE-4867 on mapjoin of MR Tasks
[ https://issues.apache.org/jira/browse/HIVE-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7173: --- Status: Open (was: Patch Available) There seems to be other valid failures like auto_join21.q,auto_join29.q etc. which are failing with ClassCastException in CommonJoinOperator::getFilterTag() > Support HIVE-4867 on mapjoin of MR Tasks > > > Key: HIVE-7173 > URL: https://issues.apache.org/jira/browse/HIVE-7173 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Navis >Assignee: Navis >Priority: Minor > Attachments: HIVE-7173.1.patch.txt > > > HIVE-4867 dedups columns in RS for reducer join and RS for order-by. But > small aliases of mapjoin of MR tasks still contains key columns in value > exprs. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7173) Support HIVE-4867 on mapjoin of MR Tasks
[ https://issues.apache.org/jira/browse/HIVE-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020890#comment-14020890 ] Ashutosh Chauhan commented on HIVE-7173: +1 seems like patch file wasn't updated correctly for .q.out files > Support HIVE-4867 on mapjoin of MR Tasks > > > Key: HIVE-7173 > URL: https://issues.apache.org/jira/browse/HIVE-7173 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Navis >Assignee: Navis >Priority: Minor > Attachments: HIVE-7173.1.patch.txt > > > HIVE-4867 dedups columns in RS for reducer join and RS for order-by. But > small aliases of mapjoin of MR tasks still contains key columns in value > exprs. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7173) Support HIVE-4867 on mapjoin of MR Tasks
[
https://issues.apache.org/jira/browse/HIVE-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020874#comment-14020874
]
Hive QA commented on HIVE-7173:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12648803/HIVE-7173.1.patch.txt
{color:red}ERROR:{color} -1 due to 34 failed/errored test(s), 5510 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join20
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join21
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join28
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join29
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join30
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join31
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join8
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_filters
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_nulls
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_without_localtask
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_bucketmapjoin1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_bucketmapjoin2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_bucketmapjoin3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_bucketmapjoin4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_bucketmapjoin5
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cross_product_check_2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_rearrange
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_reorder4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapjoin_filter_on_outerjoin
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapjoin_subquery2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapjoin_test_outer
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_reduce_deduplicate_exclude_join
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats11
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vectorized_nested_mapjoin
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_ctas
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_sortmerge_mapjoin_mismatch_1
org.apache.hive.hcatalog.pig.TestHCatLoader.testReadDataPrimitiveTypes
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimal
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalX
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalXY
org.apache.hive.hcatalog.templeton.tool.TestTempletonUtils.testPropertiesParsing
org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/406/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/406/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-406/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 34 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12648803
> Support HIVE-4867 on mapjoin of MR Tasks
>
>
> Key: HIVE-7173
> URL: https://issues.apache.org/jira/browse/HIVE-7173
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
>Reporter: Navis
>Assignee: Navis
>Priority: Minor
> Attachments: HIVE-7173.1.patch.txt
>
>
> HIVE-4867 dedups columns in RS for reducer join and RS for order-by. But
> small aliases of mapjoin of MR tasks still contains key columns in value
> exprs.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HIVE-7194) authorization_ctas.q failing on trunk
[ https://issues.apache.org/jira/browse/HIVE-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7194: --- Attachment: HIVE-7194.patch Updated .q.out file. [~thejas] Can you take a quick look? > authorization_ctas.q failing on trunk > - > > Key: HIVE-7194 > URL: https://issues.apache.org/jira/browse/HIVE-7194 > Project: Hive > Issue Type: Task > Components: Authorization >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Attachments: HIVE-7194.patch > > > Need to update .q.out file -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7194) authorization_ctas.q failing on trunk
[ https://issues.apache.org/jira/browse/HIVE-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7194: --- Status: Patch Available (was: Open) > authorization_ctas.q failing on trunk > - > > Key: HIVE-7194 > URL: https://issues.apache.org/jira/browse/HIVE-7194 > Project: Hive > Issue Type: Task > Components: Authorization >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Attachments: HIVE-7194.patch > > > Need to update .q.out file -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HIVE-7194) authorization_ctas.q failing on trunk
Ashutosh Chauhan created HIVE-7194: -- Summary: authorization_ctas.q failing on trunk Key: HIVE-7194 URL: https://issues.apache.org/jira/browse/HIVE-7194 Project: Hive Issue Type: Task Components: Authorization Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Need to update .q.out file -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7161) TestMetastoreVersion fails intermittently on trunk
[
https://issues.apache.org/jira/browse/HIVE-7161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-7161:
---
Resolution: Fixed
Fix Version/s: 0.14.0
Status: Resolved (was: Patch Available)
Committed to trunk. Thanks, Szehon!
> TestMetastoreVersion fails intermittently on trunk
> --
>
> Key: HIVE-7161
> URL: https://issues.apache.org/jira/browse/HIVE-7161
> Project: Hive
> Issue Type: Bug
> Components: Tests
>Reporter: Szehon Ho
>Assignee: Szehon Ho
> Fix For: 0.14.0
>
> Attachments: HIVE-7161.patch
>
>
> TestMetastoreVersion#testDefaults sometimes fails with:
> {noformat}
> junit.framework.AssertionFailedError: null
> at junit.framework.Assert.fail(Assert.java:48)
> at junit.framework.Assert.assertTrue(Assert.java:20)
> at junit.framework.Assert.assertFalse(Assert.java:34)
> at junit.framework.Assert.assertFalse(Assert.java:41)
> at
> org.apache.hadoop.hive.metastore.TestMetastoreVersion.testDefaults(TestMetastoreVersion.java:73)
> {noformat}
> This also looks like it is because of random test order. My hypothesis is
> that other tests set the System property
> "hive.metastore.schema.verification.", then if testDefaults doesnt run first,
> it will pick that up and assertion fails.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7140) Bump default hive.metastore.client.socket.timeout to 5 minutes
[ https://issues.apache.org/jira/browse/HIVE-7140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020866#comment-14020866 ] Ashutosh Chauhan commented on HIVE-7140: [~brocknoland] Can you post some details about the setup where this occurs? Like which api calls were these which were taking long time to complete. How long they took? Was it remote metastore? How many partitions it had? Was directSql successful or query on RDBMS was done using DataNucleus? How much time was spent on RDBMS Vs how much in Metastore code? May be we should also investigate in parallel why this is happening. There looks like an opportunity to improve our metastore codebase here. > Bump default hive.metastore.client.socket.timeout to 5 minutes > -- > > Key: HIVE-7140 > URL: https://issues.apache.org/jira/browse/HIVE-7140 > Project: Hive > Issue Type: Improvement >Affects Versions: 0.10.0, 0.12.0, 0.13.0 >Reporter: Brock Noland >Assignee: Brock Noland > Attachments: HIVE-7140.patch > > > The issue is that OOTB clients often face timeouts when using HMS since many > operations in the HMS completes are long running (e.g. many operations on a > table with many partitions). A few supporting pieces of information: > * The default value of hive.metastore.client.socket.timeout is 20 seconds. > * Since the timeout is client only, the server happy continues doing the > requested work > * Clients retry after a small delay to perform the requested work again, > often while the server is still trying to complete the original request > * A few tests have actually increased this value in order to pass reliably. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7143) Add Streaming support in Windowing mode for more UDAFs (min/max, lead/lag, fval/lval)
[ https://issues.apache.org/jira/browse/HIVE-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7143: --- Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks, Harish! > Add Streaming support in Windowing mode for more UDAFs (min/max, lead/lag, > fval/lval) > - > > Key: HIVE-7143 > URL: https://issues.apache.org/jira/browse/HIVE-7143 > Project: Hive > Issue Type: Bug >Reporter: Harish Butani >Assignee: Harish Butani > Fix For: 0.14.0 > > Attachments: HIVE-7143.1.patch, HIVE-7143.3.patch > > > Provided implementations for Streaming for the above fns. > Min/Max based on Alg by Daniel Lemire: > http://www.archipel.uqam.ca/309/1/webmaximinalgo.pdf -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7161) TestMetastoreVersion fails intermittently on trunk
[
https://issues.apache.org/jira/browse/HIVE-7161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020854#comment-14020854
]
Ashutosh Chauhan commented on HIVE-7161:
+1
> TestMetastoreVersion fails intermittently on trunk
> --
>
> Key: HIVE-7161
> URL: https://issues.apache.org/jira/browse/HIVE-7161
> Project: Hive
> Issue Type: Bug
> Components: Tests
>Reporter: Szehon Ho
>Assignee: Szehon Ho
> Attachments: HIVE-7161.patch
>
>
> TestMetastoreVersion#testDefaults sometimes fails with:
> {noformat}
> junit.framework.AssertionFailedError: null
> at junit.framework.Assert.fail(Assert.java:48)
> at junit.framework.Assert.assertTrue(Assert.java:20)
> at junit.framework.Assert.assertFalse(Assert.java:34)
> at junit.framework.Assert.assertFalse(Assert.java:41)
> at
> org.apache.hadoop.hive.metastore.TestMetastoreVersion.testDefaults(TestMetastoreVersion.java:73)
> {noformat}
> This also looks like it is because of random test order. My hypothesis is
> that other tests set the System property
> "hive.metastore.schema.verification.", then if testDefaults doesnt run first,
> it will pick that up and assertion fails.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HIVE-7191) optimized map join hash table has a bug when it reaches 2Gb
[
https://issues.apache.org/jira/browse/HIVE-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-7191:
---
Resolution: Fixed
Fix Version/s: 0.14.0
Status: Resolved (was: Patch Available)
Committed to trunk. Thanks, Sergey!
> optimized map join hash table has a bug when it reaches 2Gb
> ---
>
> Key: HIVE-7191
> URL: https://issues.apache.org/jira/browse/HIVE-7191
> Project: Hive
> Issue Type: Bug
>Reporter: Sergey Shelukhin
>Assignee: Sergey Shelukhin
> Fix For: 0.14.0
>
> Attachments: HIVE-7191.patch
>
>
> Via [~t3rmin4t0r]:
> {noformat}
> Caused by: java.lang.ArrayIndexOutOfBoundsException: -204
> at java.util.ArrayList.elementData(ArrayList.java:371)
> at java.util.ArrayList.get(ArrayList.java:384)
> at
> org.apache.hadoop.hive.serde2.WriteBuffers.setReadPoint(WriteBuffers.java:95)
> at
> org.apache.hadoop.hive.serde2.WriteBuffers.hashCode(WriteBuffers.java:100)
> at
> org.apache.hadoop.hive.ql.exec.persistence.BytesBytesMultiHashMap.put(BytesBytesMultiHashMap.java:203)
> at
> org.apache.hadoop.hive.ql.exec.persistence.MapJoinBytesTableContainer.putRow(MapJoinBytesTableContainer.java:266)
> at
> org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:124)
> ... 16 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HIVE-7187) Reconcile jetty versions in hive
[
https://issues.apache.org/jira/browse/HIVE-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-7187:
---
Resolution: Fixed
Fix Version/s: 0.14.0
Status: Resolved (was: Patch Available)
Committed to trunk. Test failures are unrelated.
> Reconcile jetty versions in hive
>
>
> Key: HIVE-7187
> URL: https://issues.apache.org/jira/browse/HIVE-7187
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2, Web UI, WebHCat
>Reporter: Vaibhav Gumashta
>Assignee: Ashutosh Chauhan
> Fix For: 0.14.0
>
> Attachments: HIVE-7187.patch
>
>
> Hive root pom has 3 parameters for specifying jetty dependency versions:
> {code}
> 6.1.26
> 7.6.0.v20120127
> 7.6.0.v20120127
> {code}
> 1st one is used by HWI, 2nd by WebHCat and 3rd by HiveServer2 (in http mode).
> We should probably use the same jetty version for all hive components.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7173) Support HIVE-4867 on mapjoin of MR Tasks
[ https://issues.apache.org/jira/browse/HIVE-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020841#comment-14020841 ] Ashutosh Chauhan commented on HIVE-7173: Test output diff for auto_join_without_localtask.q looks wrong. > Support HIVE-4867 on mapjoin of MR Tasks > > > Key: HIVE-7173 > URL: https://issues.apache.org/jira/browse/HIVE-7173 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Navis >Assignee: Navis >Priority: Minor > Attachments: HIVE-7173.1.patch.txt > > > HIVE-4867 dedups columns in RS for reducer join and RS for order-by. But > small aliases of mapjoin of MR tasks still contains key columns in value > exprs. -- This message was sent by Atlassian JIRA (v6.2#6252)
Re: [ANNOUNCE] Apache Hive 0.13.1 Released
Congratulations ,Thanks for all your works. Sent from my iPhone5s > On 2014年6月7日, at 22:35, khorg...@apache.org (Sushanth Sowmyan) wrote: > > > The Apache Hive team is proud to announce the the release of Apache Hive > 0.13.1. > > The Apache Hive (TM) data warehouse software facilitates querying and > managing large datasets residing in distributed storage. Built on top > of Apache Hadoop (TM), it provides: > > * Tools to enable easy data extract/transform/load (ETL) > > * A mechanism to impose structure on a variety of data formats > > * Access to files stored either directly in Apache HDFS (TM) or in other > data storage systems such as Apache HBase (TM) > > * Query execution via Apache Hadoop MapReduce and Apache Tez frameworks. > > For Hive release details and downloads, please visit: > http://hive.apache.org/downloads.html > > Hive X.Y.Z Release Notes are available here: > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12326829&styleName=Text&projectId=12310843 > > We would like to thank the many contributors who made this release > possible. > > Regards, > > The Apache Hive Team
[ANNOUNCE] Apache Hive 0.13.1 Released
The Apache Hive team is proud to announce the the release of Apache Hive 0.13.1. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides: * Tools to enable easy data extract/transform/load (ETL) * A mechanism to impose structure on a variety of data formats * Access to files stored either directly in Apache HDFS (TM) or in other data storage systems such as Apache HBase (TM) * Query execution via Apache Hadoop MapReduce and Apache Tez frameworks. For Hive release details and downloads, please visit: http://hive.apache.org/downloads.html Hive X.Y.Z Release Notes are available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12326829&styleName=Text&projectId=12310843 We would like to thank the many contributors who made this release possible. Regards, The Apache Hive Team
[jira] [Commented] (HIVE-6473) Allow writing HFiles via HBaseStorageHandler table
[
https://issues.apache.org/jira/browse/HIVE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020796#comment-14020796
]
Hive QA commented on HIVE-6473:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12648784/HIVE-6473.6.patch
{color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 5587 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_optimization
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_load_dyn_part1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_scriptfile1
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_ctas
org.apache.hive.hcatalog.pig.TestHCatLoader.testReadDataPrimitiveTypes
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimal
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalX
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalXY
org.apache.hive.hcatalog.templeton.tool.TestTempletonUtils.testPropertiesParsing
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/405/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/405/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-405/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 10 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12648784
> Allow writing HFiles via HBaseStorageHandler table
> --
>
> Key: HIVE-6473
> URL: https://issues.apache.org/jira/browse/HIVE-6473
> Project: Hive
> Issue Type: Improvement
> Components: HBase Handler
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
> Fix For: 0.14.0
>
> Attachments: HIVE-6473.0.patch.txt, HIVE-6473.1.patch,
> HIVE-6473.1.patch.txt, HIVE-6473.2.patch, HIVE-6473.3.patch,
> HIVE-6473.4.patch, HIVE-6473.5.patch, HIVE-6473.6.patch
>
>
> Generating HFiles for bulkload into HBase could be more convenient. Right now
> we require the user to register a new table with the appropriate output
> format. This patch allows the exact same functionality, but through an
> existing table managed by the HBaseStorageHandler.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-6394) Implement Timestmap in ParquetSerde
[
https://issues.apache.org/jira/browse/HIVE-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020771#comment-14020771
]
Hive QA commented on HIVE-6394:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12648767/HIVE-6394.6.patch
{color:red}ERROR:{color} -1 due to 13 failed/errored test(s), 5589 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_optimization
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_load_dyn_part1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_scriptfile1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_dml
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_ctas
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_parquet_timestamp
org.apache.hadoop.hive.metastore.TestMetastoreVersion.testDefaults
org.apache.hive.hcatalog.pig.TestHCatLoader.testReadDataPrimitiveTypes
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimal
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalX
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalXY
org.apache.hive.hcatalog.templeton.tool.TestTempletonUtils.testPropertiesParsing
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/404/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/404/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-404/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 13 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12648767
> Implement Timestmap in ParquetSerde
> ---
>
> Key: HIVE-6394
> URL: https://issues.apache.org/jira/browse/HIVE-6394
> Project: Hive
> Issue Type: Sub-task
> Components: Serializers/Deserializers
>Reporter: Jarek Jarcec Cecho
>Assignee: Szehon Ho
> Labels: Parquet
> Attachments: HIVE-6394.2.patch, HIVE-6394.3.patch, HIVE-6394.4.patch,
> HIVE-6394.5.patch, HIVE-6394.6.patch, HIVE-6394.patch
>
>
> This JIRA is to implement timestamp support in Parquet SerDe.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HIVE-7173) Support HIVE-4867 on mapjoin of MR Tasks
[ https://issues.apache.org/jira/browse/HIVE-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7173: Attachment: HIVE-7173.1.patch.txt > Support HIVE-4867 on mapjoin of MR Tasks > > > Key: HIVE-7173 > URL: https://issues.apache.org/jira/browse/HIVE-7173 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Navis >Assignee: Navis >Priority: Minor > Attachments: HIVE-7173.1.patch.txt > > > HIVE-4867 dedups columns in RS for reducer join and RS for order-by. But > small aliases of mapjoin of MR tasks still contains key columns in value > exprs. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7173) Support HIVE-4867 on mapjoin of MR Tasks
[ https://issues.apache.org/jira/browse/HIVE-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7173: Status: Patch Available (was: Open) > Support HIVE-4867 on mapjoin of MR Tasks > > > Key: HIVE-7173 > URL: https://issues.apache.org/jira/browse/HIVE-7173 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Navis >Assignee: Navis >Priority: Minor > Attachments: HIVE-7173.1.patch.txt > > > HIVE-4867 dedups columns in RS for reducer join and RS for order-by. But > small aliases of mapjoin of MR tasks still contains key columns in value > exprs. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7187) Reconcile jetty versions in hive
[
https://issues.apache.org/jira/browse/HIVE-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020751#comment-14020751
]
Hive QA commented on HIVE-7187:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12648736/HIVE-7187.patch
{color:red}ERROR:{color} -1 due to 14 failed/errored test(s), 5585 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mi
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sort_merge_join_desc_7
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_optimization
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_insert1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_load_dyn_part1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_scriptfile1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_dml
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_ctas
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimal
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalX
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalXY
org.apache.hive.hcatalog.templeton.tool.TestTempletonUtils.testPropertiesParsing
org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/403/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/403/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-403/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 14 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12648736
> Reconcile jetty versions in hive
>
>
> Key: HIVE-7187
> URL: https://issues.apache.org/jira/browse/HIVE-7187
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2, Web UI, WebHCat
>Reporter: Vaibhav Gumashta
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-7187.patch
>
>
> Hive root pom has 3 parameters for specifying jetty dependency versions:
> {code}
> 6.1.26
> 7.6.0.v20120127
> 7.6.0.v20120127
> {code}
> 1st one is used by HWI, 2nd by WebHCat and 3rd by HiveServer2 (in http mode).
> We should probably use the same jetty version for all hive components.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020747#comment-14020747 ] Sushanth Sowmyan commented on HIVE-7167: (Removing fix version tag of 0.13.0 - 0.13.0 is a released version that won't be changing, this patch will likely go into 0.14) > Hive Metastore fails to start with SQLServerException > - > > Key: HIVE-7167 > URL: https://issues.apache.org/jira/browse/HIVE-7167 > Project: Hive > Issue Type: Bug > Components: Metastore >Affects Versions: 0.13.0 >Reporter: Xiaobing Zhou >Assignee: Xiaobing Zhou > Labels: patch,, test > Attachments: HIVE-7167.1.patch > > > In the case that hiveserver2 uses embedded metastore and hiveserver uses > remote metastore, this exception comes up when hiveserver2 and hiveserver are > started simultaneously. > metastore service status is running but when I launch hive cli, I get > following metastore connection error: > C:\apps\dist\hive-0.13.0.2.1.2.0-1660\bin>hive.cmd > 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* > no l > onger has any effect. Use hive.hmshandler.retry.* instead > Logging initialized using configuration in > file:/C:/apps/dist/hive-0.13.0.2.1.2. > 0-1660/conf/hive-log4j.properties > Exception in thread "main" java.lang.RuntimeException: > java.lang.RuntimeExceptio > n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient > at > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav > a:347) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. > java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces > sorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > Caused by: java.lang.RuntimeException: Unable to instantiate > org.apache.hadoop.h > ive.metastore.HiveMetaStoreClient > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore > Utils.java:1413) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(Retry > ingMetaStoreClient.java:62) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret > ryingMetaStoreClient.java:72) > at > org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja > va:2444) > at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) > at > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav > a:341) > ... 7 more > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct > orAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC > onstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:525) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore > Utils.java:1411) > ... 12 more > Caused by: MetaException(message:Could not connect to meta store using any of > th > e URIs provided. Most recent failure: > org.apache.thrift.transport.TTransportExce > ption: java.net.ConnectException: Connection refused: connect > at org.apache.thrift.transport.TSocket.open(TSocket.java:185) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto > reClient.java:336) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaS > toreClient.java:214) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct > orAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC > onstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:525) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore > Utils.java:1411) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(Retry > ingMetaStoreClient.java:62) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret > ryingMetaStoreClient.java:72) > at > org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja > va:2444) > at org.apache.h
[jira] [Updated] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-7167: --- Fix Version/s: (was: 0.13.0) > Hive Metastore fails to start with SQLServerException > - > > Key: HIVE-7167 > URL: https://issues.apache.org/jira/browse/HIVE-7167 > Project: Hive > Issue Type: Bug > Components: Metastore >Affects Versions: 0.13.0 >Reporter: Xiaobing Zhou >Assignee: Xiaobing Zhou > Labels: patch,, test > Attachments: HIVE-7167.1.patch > > > In the case that hiveserver2 uses embedded metastore and hiveserver uses > remote metastore, this exception comes up when hiveserver2 and hiveserver are > started simultaneously. > metastore service status is running but when I launch hive cli, I get > following metastore connection error: > C:\apps\dist\hive-0.13.0.2.1.2.0-1660\bin>hive.cmd > 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* > no l > onger has any effect. Use hive.hmshandler.retry.* instead > Logging initialized using configuration in > file:/C:/apps/dist/hive-0.13.0.2.1.2. > 0-1660/conf/hive-log4j.properties > Exception in thread "main" java.lang.RuntimeException: > java.lang.RuntimeExceptio > n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient > at > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav > a:347) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. > java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces > sorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > Caused by: java.lang.RuntimeException: Unable to instantiate > org.apache.hadoop.h > ive.metastore.HiveMetaStoreClient > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore > Utils.java:1413) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(Retry > ingMetaStoreClient.java:62) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret > ryingMetaStoreClient.java:72) > at > org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja > va:2444) > at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) > at > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav > a:341) > ... 7 more > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct > orAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC > onstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:525) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore > Utils.java:1411) > ... 12 more > Caused by: MetaException(message:Could not connect to meta store using any of > th > e URIs provided. Most recent failure: > org.apache.thrift.transport.TTransportExce > ption: java.net.ConnectException: Connection refused: connect > at org.apache.thrift.transport.TSocket.open(TSocket.java:185) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto > reClient.java:336) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaS > toreClient.java:214) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct > orAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC > onstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:525) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore > Utils.java:1411) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(Retry > ingMetaStoreClient.java:62) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret > ryingMetaStoreClient.java:72) > at > org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja > va:2444) > at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) > at > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav > a:341) >
[jira] [Updated] (HIVE-7165) Fix hive-default.xml.template errors & omissions
[ https://issues.apache.org/jira/browse/HIVE-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-7165: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk as well. Thanks, Lefty! > Fix hive-default.xml.template errors & omissions > > > Key: HIVE-7165 > URL: https://issues.apache.org/jira/browse/HIVE-7165 > Project: Hive > Issue Type: Bug > Components: Documentation >Affects Versions: 0.13.0 >Reporter: Lefty Leverenz >Assignee: Lefty Leverenz > Fix For: 0.14.0, 0.13.1 > > Attachments: HIVE-7165.13.patch, HIVE-7165.14.patch > > > In Hive 0.13.0, hive-default.xml.template: > * gives the wrong default values for hive.auto.convert.join (HIVE-3297) & > hive.stats.dbclass (HIVE-6500) > * omits hive.server2.authentication.ldap.Domain & hive.server2.session.hook > * lists hive.metastore.integral.jdo.pushdown twice > so fix these errors in 0.13.1 and trunk. -- This message was sent by Atlassian JIRA (v6.2#6252)
