[jira] [Commented] (HIVE-10944) Fix HS2 for Metrics
[
https://issues.apache.org/jira/browse/HIVE-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576090#comment-14576090
]
Hive QA commented on HIVE-10944:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738208/HIVE-10944.2.patch
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4206/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4206/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4206/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12738208 - PreCommit-HIVE-TRUNK-Build
> Fix HS2 for Metrics
> ---
>
> Key: HIVE-10944
> URL: https://issues.apache.org/jira/browse/HIVE-10944
> Project: Hive
> Issue Type: Bug
>Reporter: Szehon Ho
>Assignee: Szehon Ho
> Attachments: HIVE-10944.2.patch, HIVE-10944.patch
>
>
> Some issues about initializing the new HS2 metrics
> 1. Metrics is not working properly in HS2 due to wrong init checks
> 2. If not enabled, JVMPauseMonitor logs trash to HS2 logs as it wasnt
> checking if metrics was enabled.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-10958) Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails
[
https://issues.apache.org/jira/browse/HIVE-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576074#comment-14576074
]
Hive QA commented on HIVE-10958:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738205/HIVE-10958.01.patch
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_index_auto_mult_tables_compact
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4205/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4205/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4205/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12738205 - PreCommit-HIVE-TRUNK-Build
> Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails
> --
>
> Key: HIVE-10958
> URL: https://issues.apache.org/jira/browse/HIVE-10958
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-10958.01.patch
>
>
> Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails due to the
> statement "set mapred.reduce.tasks = 18;"
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-10233) Hive on LLAP: Memory manager
[ https://issues.apache.org/jira/browse/HIVE-10233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-10233: -- Attachment: HIVE-10233-WIP-7.patch Join only patch. > Hive on LLAP: Memory manager > > > Key: HIVE-10233 > URL: https://issues.apache.org/jira/browse/HIVE-10233 > Project: Hive > Issue Type: Bug > Components: Tez >Affects Versions: llap >Reporter: Vikram Dixit K >Assignee: Vikram Dixit K > Attachments: HIVE-10233-WIP-2.patch, HIVE-10233-WIP-3.patch, > HIVE-10233-WIP-4.patch, HIVE-10233-WIP-5.patch, HIVE-10233-WIP-6.patch, > HIVE-10233-WIP-7.patch > > > We need a memory manager in llap/tez to manage the usage of memory across > threads. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10955) CliDriver leaves tables behind at end of test run
[ https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576059#comment-14576059 ] Mostafa Mokhtar commented on HIVE-10955: [~ekoifman] Could this be related to the issues you saw with TDE? > CliDriver leaves tables behind at end of test run > -- > > Key: HIVE-10955 > URL: https://issues.apache.org/jira/browse/HIVE-10955 > Project: Hive > Issue Type: Test > Components: Testing Infrastructure >Affects Versions: 1.2.0 >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Fix For: 1.2.1 > > Attachments: HIVE-10955.patch > > > When run serially with other drivers, this causes problems -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10841) [WHERE col is not null] does not work sometimes for queries with many JOIN statements
[
https://issues.apache.org/jira/browse/HIVE-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576044#comment-14576044
]
Hive QA commented on HIVE-10841:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738118/HIVE-10841.1.patch
{color:red}ERROR:{color} -1 due to 98 failed/errored test(s), 9002 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join12
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join23
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_sortmerge_join_12
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_bucketsortoptimize_insert_2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_bucketsortoptimize_insert_7
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_cond_pushdown
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_join_breaktask
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join12
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join19
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join23
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join28
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join32
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join32_lessSize
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join33
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_alt_syntax
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_hive_626
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_star
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_vc
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_view
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lateral_view_ppd
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapjoin_subquery
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapjoin_subquery2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multiMapJoin1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multi_join_union
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_no_hooks
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_join5
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_outer_join5
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoin
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_smb_mapjoin9
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udtf_json_tuple
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udtf_parse_url_tuple
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union22
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_inner_join
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_mr_diff_schema_alias
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_auto_sortmerge_join_12
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_bucket_map_join_tez1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynamic_partition_pruning
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_explainuser_2
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_filter_join_breaktask
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_hybridgrace_hashjoin_2
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_lvj_mapjoin
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_skewjoin
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_inner_join
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_mr_diff_schema_alias
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vectorized_dynamic_partition_pruning
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join12
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join16
org.apache.hadoop.hive.cli
[jira] [Commented] (HIVE-10957) QueryPlan's start time is incorrect in certain cases
[
https://issues.apache.org/jira/browse/HIVE-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575998#comment-14575998
]
Hive QA commented on HIVE-10957:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738139/HIVE-10957.2.patch
{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchAbortAndCommit
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4203/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4203/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4203/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12738139 - PreCommit-HIVE-TRUNK-Build
> QueryPlan's start time is incorrect in certain cases
>
>
> Key: HIVE-10957
> URL: https://issues.apache.org/jira/browse/HIVE-10957
> Project: Hive
> Issue Type: Bug
>Reporter: Gunther Hagleitner
>Assignee: Wei Zheng
> Attachments: HIVE-10957.1.patch, HIVE-10957.2.patch
>
>
> In some cases the start time of the previous query is used mistakenly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-10955) CliDriver leaves tables behind at end of test run
[ https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-10955: Affects Version/s: (was: 1.3.0) 1.2.0 > CliDriver leaves tables behind at end of test run > -- > > Key: HIVE-10955 > URL: https://issues.apache.org/jira/browse/HIVE-10955 > Project: Hive > Issue Type: Test > Components: Testing Infrastructure >Affects Versions: 1.2.0 >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Fix For: 1.2.1 > > Attachments: HIVE-10955.patch > > > When run serially with other drivers, this causes problems -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10944) Fix HS2 for Metrics
[ https://issues.apache.org/jira/browse/HIVE-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-10944: - Attachment: HIVE-10944.2.patch Yea good points, i was just trying to get this to work first. Removed the unnecessary conf checks and got rid of the synchronized block by doing some refactoring. Also added a review board: [https://reviews.apache.org/r/35181/|https://reviews.apache.org/r/35181/] > Fix HS2 for Metrics > --- > > Key: HIVE-10944 > URL: https://issues.apache.org/jira/browse/HIVE-10944 > Project: Hive > Issue Type: Bug >Reporter: Szehon Ho >Assignee: Szehon Ho > Attachments: HIVE-10944.2.patch, HIVE-10944.patch > > > Some issues about initializing the new HS2 metrics > 1. Metrics is not working properly in HS2 due to wrong init checks > 2. If not enabled, JVMPauseMonitor logs trash to HS2 logs as it wasnt > checking if metrics was enabled. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10955) CliDriver leaves tables behind at end of test run
[ https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575972#comment-14575972 ] Hari Sankar Sivarama Subramaniyan commented on HIVE-10955: -- +1 > CliDriver leaves tables behind at end of test run > -- > > Key: HIVE-10955 > URL: https://issues.apache.org/jira/browse/HIVE-10955 > Project: Hive > Issue Type: Test > Components: Testing Infrastructure >Affects Versions: 1.3.0 >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Attachments: HIVE-10955.patch > > > When run serially with other drivers, this causes problems -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HIVE-10774) ReduceSinkDedup undoes Distinct Rewrite
[ https://issues.apache.org/jira/browse/HIVE-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan resolved HIVE-10774. - Resolution: Won't Fix As described above, ReduceSinkDedup is doing the right thing. There is nothing to fix here. > ReduceSinkDedup undoes Distinct Rewrite > --- > > Key: HIVE-10774 > URL: https://issues.apache.org/jira/browse/HIVE-10774 > Project: Hive > Issue Type: Improvement > Components: CBO, Logical Optimizer >Affects Versions: 1.2.0 >Reporter: Mostafa Mokhtar >Assignee: Ashutosh Chauhan > Attachments: HIVE-10774.patch > > > Now distinct rewrite can fire in more cases. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10939) Make TestFileDump robust
[ https://issues.apache.org/jira/browse/HIVE-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-10939: Affects Version/s: (was: 1.3.0) 1.2.0 > Make TestFileDump robust > > > Key: HIVE-10939 > URL: https://issues.apache.org/jira/browse/HIVE-10939 > Project: Hive > Issue Type: Test > Components: Tests >Affects Versions: 1.2.0 >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Fix For: 1.2.1 > > Attachments: HIVE-10939.patch > > > It fails on Windows OS currently. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10956) HS2 leaks HMS connections
[
https://issues.apache.org/jira/browse/HIVE-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575961#comment-14575961
]
Hive QA commented on HIVE-10956:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738129/HIVE-10956.1.patch
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4201/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4201/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4201/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12738129 - PreCommit-HIVE-TRUNK-Build
> HS2 leaks HMS connections
> -
>
> Key: HIVE-10956
> URL: https://issues.apache.org/jira/browse/HIVE-10956
> Project: Hive
> Issue Type: Bug
>Reporter: Jimmy Xiang
>Assignee: Jimmy Xiang
> Fix For: 1.3.0
>
> Attachments: HIVE-10956.1.patch
>
>
> HS2 uses threadlocal to cache HMS client in class Hive. When the thread is
> dead, the HMS client is not closed. So the connection to the HMS is leaked.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-10958) Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails
[ https://issues.apache.org/jira/browse/HIVE-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-10958: --- Attachment: HIVE-10958.01.patch > Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails > -- > > Key: HIVE-10958 > URL: https://issues.apache.org/jira/browse/HIVE-10958 > Project: Hive > Issue Type: Bug >Reporter: Pengcheng Xiong >Assignee: Pengcheng Xiong > Attachments: HIVE-10958.01.patch > > > Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails due to the > statement "set mapred.reduce.tasks = 18;" -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10955) CliDriver leaves tables behind at end of test run
[ https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575948#comment-14575948 ] Ashutosh Chauhan commented on HIVE-10955: - Test failures are unrelated. [~hsubramaniyan] can you please take a look? > CliDriver leaves tables behind at end of test run > -- > > Key: HIVE-10955 > URL: https://issues.apache.org/jira/browse/HIVE-10955 > Project: Hive > Issue Type: Test > Components: Testing Infrastructure >Affects Versions: 1.3.0 >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Attachments: HIVE-10955.patch > > > When run serially with other drivers, this causes problems -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10955) CliDriver leaves tables behind at end of test run
[ https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-10955: Description: When run serially with other drivers, this causes problems (was: When run serially with other drives, this causes problems) > CliDriver leaves tables behind at end of test run > -- > > Key: HIVE-10955 > URL: https://issues.apache.org/jira/browse/HIVE-10955 > Project: Hive > Issue Type: Test > Components: Testing Infrastructure >Affects Versions: 1.3.0 >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Attachments: HIVE-10955.patch > > > When run serially with other drivers, this causes problems -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8931) Test TestAccumuloCliDriver is not completing
[
https://issues.apache.org/jira/browse/HIVE-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575912#comment-14575912
]
Hive QA commented on HIVE-8931:
---
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738126/HIVE-8931.001.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4200/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4200/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4200/
Messages:
{noformat}
This message was trimmed, see log for full details
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-odbc ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/odbc/target/tmp
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/odbc/target/warehouse
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/odbc/target/tmp/conf
[copy] Copying 11 files to
/data/hive-ptest/working/apache-github-source-source/odbc/target/tmp/conf
[INFO] Executed tasks
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @
hive-odbc ---
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-odbc ---
[INFO] Installing
/data/hive-ptest/working/apache-github-source-source/odbc/pom.xml to
/home/hiveptest/.m2/repository/org/apache/hive/hive-odbc/1.3.0-SNAPSHOT/hive-odbc-1.3.0-SNAPSHOT.pom
[INFO]
[INFO]
[INFO] Building Hive Shims Aggregator 1.3.0-SNAPSHOT
[INFO]
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-shims-aggregator
---
[INFO] Deleting
/data/hive-ptest/working/apache-github-source-source/shims/target
[INFO] Deleting /data/hive-ptest/working/apache-github-source-source/shims
(includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @
hive-shims-aggregator ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @
hive-shims-aggregator ---
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @
hive-shims-aggregator ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @
hive-shims-aggregator ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/shims/target/tmp
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/shims/target/warehouse
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/shims/target/tmp/conf
[copy] Copying 11 files to
/data/hive-ptest/working/apache-github-source-source/shims/target/tmp/conf
[INFO] Executed tasks
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @
hive-shims-aggregator ---
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @
hive-shims-aggregator ---
[INFO] Installing
/data/hive-ptest/working/apache-github-source-source/shims/pom.xml to
/home/hiveptest/.m2/repository/org/apache/hive/hive-shims-aggregator/1.3.0-SNAPSHOT/hive-shims-aggregator-1.3.0-SNAPSHOT.pom
[INFO]
[INFO]
[INFO] Building Hive TestUtils 1.3.0-SNAPSHOT
[INFO]
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-testutils ---
[INFO] Deleting
/data/hive-ptest/working/apache-github-source-source/testutils/target
[INFO] Deleting /data/hive-ptest/working/apache-github-source-source/testutils
(includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @
hive-testutils ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-testutils
---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
hive-testutils ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/data/hive-ptest/working/apache-github-source-source/testutils/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-testutils ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-c
[jira] [Commented] (HIVE-10955) CliDriver leaves tables behind at end of test run
[
https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575905#comment-14575905
]
Hive QA commented on HIVE-10955:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738097/HIVE-10955.patch
{color:red}ERROR:{color} -1 due to 5 failed/errored test(s), 9001 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vectorized_parquet_types
org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchAbort
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchEmptyCommit
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4199/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4199/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4199/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 5 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12738097 - PreCommit-HIVE-TRUNK-Build
> CliDriver leaves tables behind at end of test run
> --
>
> Key: HIVE-10955
> URL: https://issues.apache.org/jira/browse/HIVE-10955
> Project: Hive
> Issue Type: Test
> Components: Testing Infrastructure
>Affects Versions: 1.3.0
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-10955.patch
>
>
> When run serially with other drives, this causes problems
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-10900) Fix the indeterministic stats for some hive queries
[ https://issues.apache.org/jira/browse/HIVE-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-10900: Component/s: Tests > Fix the indeterministic stats for some hive queries > > > Key: HIVE-10900 > URL: https://issues.apache.org/jira/browse/HIVE-10900 > Project: Hive > Issue Type: Improvement > Components: Tests >Affects Versions: 1.0.0, 1.2.0, 1.1.0 >Reporter: Pengcheng Xiong >Assignee: Pengcheng Xiong >Priority: Minor > Fix For: 1.2.1 > > Attachments: HIVE-10900.01.patch > > > If we do not run compute stats for a table and then we do some operation on > that table, we will get different stats numbers when we run explain. The main > reason is due to the different OS/FS configurations that Hive Stats depends > on when there is no table stats. A simple fix is to add compute stats for > those indeterministic stats. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10900) Fix the indeterministic stats for some hive queries
[ https://issues.apache.org/jira/browse/HIVE-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-10900: Affects Version/s: 1.1.0 1.0.0 1.2.0 > Fix the indeterministic stats for some hive queries > > > Key: HIVE-10900 > URL: https://issues.apache.org/jira/browse/HIVE-10900 > Project: Hive > Issue Type: Improvement > Components: Tests >Affects Versions: 1.0.0, 1.2.0, 1.1.0 >Reporter: Pengcheng Xiong >Assignee: Pengcheng Xiong >Priority: Minor > Fix For: 1.2.1 > > Attachments: HIVE-10900.01.patch > > > If we do not run compute stats for a table and then we do some operation on > that table, we will get different stats numbers when we run explain. The main > reason is due to the different OS/FS configurations that Hive Stats depends > on when there is no table stats. A simple fix is to add compute stats for > those indeterministic stats. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10910) Alter table drop partition queries in encrypted zone failing to remove data from HDFS
[
https://issues.apache.org/jira/browse/HIVE-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575862#comment-14575862
]
Hive QA commented on HIVE-10910:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738120/HIVE-10910.2.patch
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4198/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4198/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4198/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12738120 - PreCommit-HIVE-TRUNK-Build
> Alter table drop partition queries in encrypted zone failing to remove data
> from HDFS
> -
>
> Key: HIVE-10910
> URL: https://issues.apache.org/jira/browse/HIVE-10910
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Affects Versions: 1.2.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Eugene Koifman
> Attachments: HIVE-10910.2.patch, HIVE-10910.patch
>
>
> Alter table query trying to drop partition removes metadata of partition but
> fails to remove the data from HDFS
> hive> create table table_1(name string, age int, gpa double) partitioned by
> (b string) stored as textfile;
> OK
> Time taken: 0.732 seconds
> hive> alter table table_1 add partition (b='2010-10-10');
> OK
> Time taken: 0.496 seconds
> hive> show partitions table_1;
> OK
> b=2010-10-10
> Time taken: 0.781 seconds, Fetched: 1 row(s)
> hive> alter table table_1 drop partition (b='2010-10-10');
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Got exception: java.io.IOException
> Failed to move to trash:
> hdfs://:8020//table_1/b=2010-10-10
> hive> show partitions table_1;
> OK
> Time taken: 0.622 seconds
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (HIVE-10907) Hive on Tez: Classcast exception in some cases with SMB joins
[
https://issues.apache.org/jira/browse/HIVE-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575843#comment-14575843
]
Vikram Dixit K edited comment on HIVE-10907 at 6/6/15 5:42 PM:
---
[~sershe] Can you please review this? The purpose of the patch is to prevent
smb joins in cases where one of the sides would be a map side work and the
other is coming from a shuffle. This jira is a work around to stop class cast
exceptions from occurring in that case. The way to prevent this is in
ConvertJoinMapJoin code where a check is made to see if the number of reduce
sinks above the parent of the join operator is either 0 or non-zero on all
sides of the join.
a join b
Non-Kosher case:
{noformat}
| There should be either no RS left of this boundary or there
should be one or more for both sides. If that is not the case, no SMB.
RS -> Gby -> | RS -> Join ->
TS -> Fil -> | RS /
{noformat}
[~hagleitn] reviewed the patch earlier and made a comment that I addressed
(basically uncommented the code). Can you take a look and review this patch
please? This needs to go to branch-1.2 as well.
Thanks
Vikram.
was (Author: vikram.dixit):
[~sershe] Can you please review this? The purpose of the patch is to prevent
smb joins in cases where one of the sides would be a map side work and the
other is coming from a shuffle. This jira is a work around to stop class cast
exceptions from occurring in that case. The way to prevent this is in
ConvertJoinMapJoin code where a check is made to see if the number of reduce
sinks above the parent of the join operator is either 0 or non-zero on all
sides of the join.
a join b
Non-Kosher case:
{noformat}
| There should be either no RS left of this boundary or there
should be one or more for both sides. If that is not the case, no SMB.
RS -> Gby -> | RS -> Join ->
TS -> Fil -> | RS /
{noformat}
[~hagleitn] reviewed the patch earlier and made a comment that I addressed
(basically uncommented the code). Can you take a look and review this patch
please? This needs to go to branch-1.2 as well.
Thanks
Vikram.
> Hive on Tez: Classcast exception in some cases with SMB joins
> -
>
> Key: HIVE-10907
> URL: https://issues.apache.org/jira/browse/HIVE-10907
> Project: Hive
> Issue Type: Bug
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
> Attachments: HIVE-10907.1.patch, HIVE-10907.2.patch,
> HIVE-10907.3.patch, HIVE-10907.4.patch
>
>
> In cases where there is a mix of Map side work and reduce side work, we get a
> classcast exception because we assume homogeneity in the code. We need to fix
> this correctly. For now this is a workaround.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (HIVE-10907) Hive on Tez: Classcast exception in some cases with SMB joins
[
https://issues.apache.org/jira/browse/HIVE-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575843#comment-14575843
]
Vikram Dixit K edited comment on HIVE-10907 at 6/6/15 5:41 PM:
---
[~sershe] Can you please review this? The purpose of the patch is to prevent
smb joins in cases where one of the sides would be a map side work and the
other is coming from a shuffle. This jira is a work around to stop class cast
exceptions from occurring in that case. The way to prevent this is in
ConvertJoinMapJoin code where a check is made to see if the number of reduce
sinks above the parent of the join operator is either 0 or non-zero on all
sides of the join.
a join b
Non-Kosher case:
{noformat}
| There should be either no RS left of this boundary or there
should be one or more for both sides. If that is not the case, no SMB.
RS -> Gby -> | RS -> Join ->
TS -> Fil -> | RS /
{noformat}
[~hagleitn] reviewed the patch earlier and made a comment that I addressed
(basically uncommented the code). Can you take a look and review this patch
please? This needs to go to branch-1.2 as well.
Thanks
Vikram.
was (Author: vikram.dixit):
[~sershe] Can you please review this? The purpose of the patch is to prevent
smb joins in cases where one of the sides would be a map side work and the
other is coming from a shuffle. This jira is a work around to stop class cast
exceptions from occurring in that case. The way to prevent this is in
ConvertJoinMapJoin code where a check is made to see if the number of reduce
sinks above the parent of the join operator is either 0 or non-zero on all
sides of the join.
a join b
Non-Kosher case:
{noformat}
| There should be either no RS left of this boundary or
there should be one or more for both sides. If that is not the case, no SMB.
RS -> Gby -> | RS -> Join ->
TS -> Filter -> | RS /
{noformat}
[~hagleitn] reviewed the patch earlier and made a comment that I addressed
(basically uncommented the code). Can you take a look and review this patch
please? This needs to go to branch-1.2 as well.
Thanks
Vikram.
> Hive on Tez: Classcast exception in some cases with SMB joins
> -
>
> Key: HIVE-10907
> URL: https://issues.apache.org/jira/browse/HIVE-10907
> Project: Hive
> Issue Type: Bug
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
> Attachments: HIVE-10907.1.patch, HIVE-10907.2.patch,
> HIVE-10907.3.patch, HIVE-10907.4.patch
>
>
> In cases where there is a mix of Map side work and reduce side work, we get a
> classcast exception because we assume homogeneity in the code. We need to fix
> this correctly. For now this is a workaround.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-10907) Hive on Tez: Classcast exception in some cases with SMB joins
[
https://issues.apache.org/jira/browse/HIVE-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575843#comment-14575843
]
Vikram Dixit K commented on HIVE-10907:
---
[~sershe] Can you please review this? The purpose of the patch is to prevent
smb joins in cases where one of the sides would be a map side work and the
other is coming from a shuffle. This jira is a work around to stop class cast
exceptions from occurring in that case. The way to prevent this is in
ConvertJoinMapJoin code where a check is made to see if the number of reduce
sinks above the parent of the join operator is either 0 or non-zero on all
sides of the join.
a join b
Non-Kosher case:
{noformat}
| There should be either no RS left of this boundary or
there should be one or more for both sides. If that is not the case, no SMB.
RS -> Gby -> | RS -> Join ->
TS -> Filter -> | RS /
{noformat}
[~hagleitn] reviewed the patch earlier and made a comment that I addressed
(basically uncommented the code). Can you take a look and review this patch
please? This needs to go to branch-1.2 as well.
Thanks
Vikram.
> Hive on Tez: Classcast exception in some cases with SMB joins
> -
>
> Key: HIVE-10907
> URL: https://issues.apache.org/jira/browse/HIVE-10907
> Project: Hive
> Issue Type: Bug
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
> Attachments: HIVE-10907.1.patch, HIVE-10907.2.patch,
> HIVE-10907.3.patch, HIVE-10907.4.patch
>
>
> In cases where there is a mix of Map side work and reduce side work, we get a
> classcast exception because we assume homogeneity in the code. We need to fix
> this correctly. For now this is a workaround.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-10906) Value based UDAF function without orderby expression throws NPE
[
https://issues.apache.org/jira/browse/HIVE-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575814#comment-14575814
]
Hive QA commented on HIVE-10906:
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738112/HIVE-10906.2.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4197/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4197/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4197/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]]
+ export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
+ JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
+ export
PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
+
PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ cd /data/hive-ptest/working/
+ tee /data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4197/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ cd apache-github-source-source
+ git fetch origin
>From https://github.com/apache/hive
777999a..65626de branch-1 -> origin/branch-1
491222e..a4d0298 branch-1.2 -> origin/branch-1.2
8a10730..29af41c master -> origin/master
+ git reset --hard HEAD
HEAD is now at 8a10730 HIVE-10932 : Unit test udf_nondeterministic failure due
to HIVE-10728 (Aihua Xu via Ashutosh Chauhan)
+ git clean -f -d
Removing ql/src/test/queries/clientpositive/tez_union_dynamic_partition.q
Removing
ql/src/test/results/clientpositive/tez/tez_union_dynamic_partition.q.out
+ git checkout master
Already on 'master'
Your branch is behind 'origin/master' by 1 commit, and can be fast-forwarded.
+ git reset --hard origin/master
HEAD is now at 29af41c HIVE-10941: Provide option to disable spark tests
outside itests (Hari Sankar Sivarama Subramaniyan, reviewed by Ashutosh Chauhan)
+ git merge --ff-only origin/master
Already up-to-date.
+ git gc
+ patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hive-ptest/working/scratch/build.patch
+ [[ -f /data/hive-ptest/working/scratch/build.patch ]]
+ chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh
/data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0, p1, or p2
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12738112 - PreCommit-HIVE-TRUNK-Build
> Value based UDAF function without orderby expression throws NPE
> ---
>
> Key: HIVE-10906
> URL: https://issues.apache.org/jira/browse/HIVE-10906
> Project: Hive
> Issue Type: Sub-task
> Components: PTF-Windowing
>Reporter: Aihua Xu
>Assignee: Aihua Xu
> Attachments: HIVE-10906.2.patch, HIVE-10906.patch
>
>
> The following query throws NPE.
> {noformat}
> select key, value, min(value) over (partition by key range between unbounded
> preceding and current row) from small;
> FAILED: NullPointerException null
> 2015-06-03 13:48:09,268 ERROR [main]: ql.Driver
> (SessionState.java:printError(957)) - FAILED: NullPointerException null
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.WindowingSpec.validateValueBoundary(WindowingSpec.java:293)
> at
> org.apache.hadoop.hive.ql.parse.WindowingSpec.validateWindowFrame(WindowingSpec.java:281)
> at
> org.apache.hadoop.hive.ql.parse.WindowingSpec.validateAndMakeEffective(WindowingSpec.java:155)
> at
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genWindowingPlan(SemanticAnalyzer.java:11965)
> at
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genP
[jira] [Resolved] (HIVE-10881) The bucket number is not respected in insert overwrite.
[
https://issues.apache.org/jira/browse/HIVE-10881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xuefu Zhang resolved HIVE-10881.
Resolution: Duplicate
Duplicated of HIVE-10880.
> The bucket number is not respected in insert overwrite.
> ---
>
> Key: HIVE-10881
> URL: https://issues.apache.org/jira/browse/HIVE-10881
> Project: Hive
> Issue Type: Bug
>Affects Versions: 1.2.0, 1.3.0
>Reporter: Yongzhi Chen
>Assignee: Yongzhi Chen
>Priority: Critical
>
> When hive.enforce.bucketing is true, the bucket number defined in the table
> is no longer respected in current master and 1.2. This is a regression.
> Reproduce:
> {noformat}
> CREATE TABLE IF NOT EXISTS buckettestinput(
> data string
> )
> ROW FORMAT DELIMITED FIELDS TERMINATED BY ',';
> CREATE TABLE IF NOT EXISTS buckettestoutput1(
> data string
> )CLUSTERED BY(data)
> INTO 2 BUCKETS
> ROW FORMAT DELIMITED FIELDS TERMINATED BY ',';
> CREATE TABLE IF NOT EXISTS buckettestoutput2(
> data string
> )CLUSTERED BY(data)
> INTO 2 BUCKETS
> ROW FORMAT DELIMITED FIELDS TERMINATED BY ',';
> Then I inserted the following data into the "buckettestinput" table
> firstinsert1
> firstinsert2
> firstinsert3
> firstinsert4
> firstinsert5
> firstinsert6
> firstinsert7
> firstinsert8
> secondinsert1
> secondinsert2
> secondinsert3
> secondinsert4
> secondinsert5
> secondinsert6
> secondinsert7
> secondinsert8
> set hive.enforce.bucketing = true;
> set hive.enforce.sorting=true;
> insert overwrite table buckettestoutput1
> select * from buckettestinput where data like 'first%';
> set hive.auto.convert.sortmerge.join=true;
> set hive.optimize.bucketmapjoin = true;
> set hive.optimize.bucketmapjoin.sortedmerge = true;
> select * from buckettestoutput1 a join buckettestoutput2 b on (a.data=b.data);
> Error: Error while compiling statement: FAILED: SemanticException [Error
> 10141]: Bucketed table metadata is not correct. Fix the metadata or don't use
> bucketed mapjoin, by setting hive.enforce.bucketmapjoin to false. The number
> of buckets for table buckettestoutput1 is 2, whereas the number of files is 1
> (state=42000,code=10141)
> {noformat}
> The related debug information related to insert overwrite:
> {noformat}
> 0: jdbc:hive2://localhost:1> insert overwrite table buckettestoutput1
> select * from buckettestinput where data like 'first%'insert overwrite table
> buckettestoutput1
> 0: jdbc:hive2://localhost:1> ;
> select * from buckettestinput where data like '
> first%';
> INFO : Number of reduce tasks determined at compile time: 2
> INFO : In order to change the average load for a reducer (in bytes):
> INFO : set hive.exec.reducers.bytes.per.reducer=
> INFO : In order to limit the maximum number of reducers:
> INFO : set hive.exec.reducers.max=
> INFO : In order to set a constant number of reducers:
> INFO : set mapred.reduce.tasks=
> INFO : Job running in-process (local Hadoop)
> INFO : 2015-06-01 11:09:29,650 Stage-1 map = 86%, reduce = 100%
> INFO : Ended Job = job_local107155352_0001
> INFO : Loading data to table default.buckettestoutput1 from
> file:/user/hive/warehouse/buckettestoutput1/.hive-staging_hive_2015-06-01_11-09-28_166_3109203968904090801-1/-ext-1
> INFO : Table default.buckettestoutput1 stats: [numFiles=1, numRows=4,
> totalSize=52, rawDataSize=48]
> No rows affected (1.692 seconds)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-10929) In Tez mode,dynamic partitioning query with union all fails at moveTask,Invalid partition key & values
[
https://issues.apache.org/jira/browse/HIVE-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575622#comment-14575622
]
Hive QA commented on HIVE-10929:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738075/HIVE-10929.4.patch
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4196/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4196/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4196/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12738075 - PreCommit-HIVE-TRUNK-Build
> In Tez mode,dynamic partitioning query with union all fails at
> moveTask,Invalid partition key & values
> --
>
> Key: HIVE-10929
> URL: https://issues.apache.org/jira/browse/HIVE-10929
> Project: Hive
> Issue Type: Bug
> Components: Tez
>Affects Versions: 1.2.0
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
> Attachments: HIVE-10929.1.patch, HIVE-10929.2.patch,
> HIVE-10929.3.patch, HIVE-10929.4.patch
>
>
> {code}
> create table dummy(i int);
> insert into table dummy values (1);
> select * from dummy;
> create table partunion1(id1 int) partitioned by (part1 string);
> set hive.exec.dynamic.partition.mode=nonstrict;
> set hive.execution.engine=tez;
> explain insert into table partunion1 partition(part1)
> select temps.* from (
> select 1 as id1, '2014' as part1 from dummy
> union all
> select 2 as id1, '2014' as part1 from dummy ) temps;
> insert into table partunion1 partition(part1)
> select temps.* from (
> select 1 as id1, '2014' as part1 from dummy
> union all
> select 2 as id1, '2014' as part1 from dummy ) temps;
> select * from partunion1;
> {code}
> fails.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
