[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185142#comment-16185142 ] Hive QA commented on HIVE-17561: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12889520/HIVE-17561.4.patch {color:green}SUCCESS:{color} +1 due to 18 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 11087 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestAccumuloCliDriver.testCliDriver[accumulo_predicate_pushdown] (batchId=231) org.apache.hadoop.hive.cli.TestAccumuloCliDriver.testCliDriver[accumulo_single_sourced_multi_insert] (batchId=231) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[optimize_nullscan] (batchId=162) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[union_fast_stats] (batchId=157) org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_explainuser_1] (batchId=171) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.org.apache.hadoop.hive.cli.TestTezPerfCliDriver (batchId=239) org.apache.hadoop.hive.cli.control.TestDanglingQOuts.checkDanglingQOut (batchId=202) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/7031/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/7031/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-7031/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 7 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12889520 - PreCommit-HIVE-Build > Move TxnStore and implementations to standalone metastore > - > > Key: HIVE-17561 > URL: https://issues.apache.org/jira/browse/HIVE-17561 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Transactions >Reporter: Alan Gates >Assignee: Alan Gates > Labels: pull-request-available > Attachments: HIVE-17561.4.patch, HIVE-17561.patch > > > We need to move the metastore handling of transactions into the standalone > metastore. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189102#comment-16189102 ] Alan Gates commented on HIVE-17561: --- [~ekoifman], [~vihangk1] could you review please? > Move TxnStore and implementations to standalone metastore > - > > Key: HIVE-17561 > URL: https://issues.apache.org/jira/browse/HIVE-17561 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Transactions >Reporter: Alan Gates >Assignee: Alan Gates > Labels: pull-request-available > Attachments: HIVE-17561.4.patch, HIVE-17561.patch > > > We need to move the metastore handling of transactions into the standalone > metastore. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190476#comment-16190476 ] Eugene Koifman commented on HIVE-17561: --- Look OK in general. I left a few comments in https://github.com/apache/hive/pull/253/files > Move TxnStore and implementations to standalone metastore > - > > Key: HIVE-17561 > URL: https://issues.apache.org/jira/browse/HIVE-17561 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Transactions >Reporter: Alan Gates >Assignee: Alan Gates > Labels: pull-request-available > Attachments: HIVE-17561.4.patch, HIVE-17561.patch > > > We need to move the metastore handling of transactions into the standalone > metastore. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192427#comment-16192427 ] Hive QA commented on HIVE-17561: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12890449/HIVE-17561.5.patch {color:green}SUCCESS:{color} +1 due to 19 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 11200 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestAccumuloCliDriver.testCliDriver[accumulo_predicate_pushdown] (batchId=231) org.apache.hadoop.hive.cli.TestAccumuloCliDriver.testCliDriver[accumulo_single_sourced_multi_insert] (batchId=231) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[optimize_nullscan] (batchId=162) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[union_fast_stats] (batchId=157) org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_explainuser_1] (batchId=171) org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainanalyze_2] (batchId=101) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[query14] (batchId=239) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/7128/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/7128/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-7128/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 7 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12890449 - PreCommit-HIVE-Build > Move TxnStore and implementations to standalone metastore > - > > Key: HIVE-17561 > URL: https://issues.apache.org/jira/browse/HIVE-17561 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Transactions >Reporter: Alan Gates >Assignee: Alan Gates > Labels: pull-request-available > Attachments: HIVE-17561.4.patch, HIVE-17561.5.patch, HIVE-17561.patch > > > We need to move the metastore handling of transactions into the standalone > metastore. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16194799#comment-16194799 ] Eugene Koifman commented on HIVE-17561: --- +1 patch 6 > Move TxnStore and implementations to standalone metastore > - > > Key: HIVE-17561 > URL: https://issues.apache.org/jira/browse/HIVE-17561 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Transactions >Reporter: Alan Gates >Assignee: Alan Gates > Labels: pull-request-available > Attachments: HIVE-17561.4.patch, HIVE-17561.5.patch, > HIVE-17561.6.patch, HIVE-17561.patch > > > We need to move the metastore handling of transactions into the standalone > metastore. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199063#comment-16199063 ] ASF GitHub Bot commented on HIVE-17561: --- Github user alanfgates closed the pull request at: https://github.com/apache/hive/pull/253 > Move TxnStore and implementations to standalone metastore > - > > Key: HIVE-17561 > URL: https://issues.apache.org/jira/browse/HIVE-17561 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Transactions >Reporter: Alan Gates >Assignee: Alan Gates > Labels: pull-request-available > Attachments: HIVE-17561.4.patch, HIVE-17561.5.patch, > HIVE-17561.6.patch, HIVE-17561.patch > > > We need to move the metastore handling of transactions into the standalone > metastore. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172788#comment-16172788 ] ASF GitHub Bot commented on HIVE-17561: --- GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/253 HIVE-17561 Moved TxnStore and its implementations. Moved DataSourceProvider as well. Moved ValidTxnList and ValidReadTxnList to storage-api as ORC and the standalone metastore will both need them. Also moved the newly created SQLGenerator. I did not move the functionality that added bonecp and hikari to the restricted list in HiveConf because MetastoreConf doesn't have a restricted list. MetastoreConf doesn't have a restricted list because that functionality is broken. setVar* doesn't check against the restricted list. Given that MetastoreConf is a set of static convenience methods to be used on top of Configuration we can't stop users from going underneath and calling set() directly anyway. If we want to restrict users from setting certain values in the MetastoreConf we need a comprehensive and secure way to do it. Plus I'm not convinced that boncep and hikari settings are high security issues anyway. You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17561 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/253.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #253 commit 305c8f27e884c94faad34a350ee1848cdd5f Author: Alan Gates Date: 2017-08-04T20:02:03Z WIP, tests don't pass yet. I think I've moved all the files. commit 21523f3dfd0666a3ef68558a392df14c0bf80eb0 Author: Alan Gates Date: 2017-09-20T06:01:25Z Moved SQLGenerator since it was newly created. I did not move the functionality that added bonecp and hikari to the restricted list in HiveConf, because there is no restricted list in MetastoreConf. There's no restricted list because the HiveConf implementation is completely broken. It isn't checked when a setVar call is made, so it's easy to end run around. If we want to figure out ways to restrict what values users can set at runtime we need to do it in a coherent and complete way. > Move TxnStore and implementations to standalone metastore > - > > Key: HIVE-17561 > URL: https://issues.apache.org/jira/browse/HIVE-17561 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Transactions >Reporter: Alan Gates >Assignee: Alan Gates > Labels: pull-request-available > > We need to move the metastore handling of transactions into the standalone > metastore. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172807#comment-16172807 ] Alan Gates commented on HIVE-17561: --- cc [~ekoifman] > Move TxnStore and implementations to standalone metastore > - > > Key: HIVE-17561 > URL: https://issues.apache.org/jira/browse/HIVE-17561 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Transactions >Reporter: Alan Gates >Assignee: Alan Gates > Labels: pull-request-available > Attachments: HIVE-17561.patch > > > We need to move the metastore handling of transactions into the standalone > metastore. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16173968#comment-16173968 ] Hive QA commented on HIVE-17561: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12888021/HIVE-17561.patch {color:green}SUCCESS:{color} +1 due to 5 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 70 failed/errored test(s), 11045 tests executed *Failed tests:* {noformat} TestAccumuloCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=229) TestDummy - did not produce a TEST-*.xml file (likely timed out) (batchId=229) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[create_view] (batchId=39) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_mask_hash] (batchId=28) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[acid_bucket_pruning] (batchId=142) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[acid_globallimit] (batchId=151) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[acid_no_buckets] (batchId=159) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[acid_vectorization_missing_cols] (batchId=150) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[delete_all_non_partitioned] (batchId=151) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[delete_all_partitioned] (batchId=151) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[delete_tmp_table] (batchId=156) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[delete_where_no_match] (batchId=151) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[delete_where_non_partitioned] (batchId=153) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[delete_where_partitioned] (batchId=154) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[delete_whole_partition] (batchId=147) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[dynamic_semijoin_reduction_3] (batchId=160) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[dynpart_sort_optimization_acid] (batchId=155) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[explainuser_1] (batchId=153) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_orig_table] (batchId=158) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_update_delete] (batchId=162) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_values_dynamic_partitioned] (batchId=160) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_values_non_partitioned] (batchId=149) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_values_partitioned] (batchId=161) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_values_tmp_table] (batchId=146) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[join_acid_non_acid] (batchId=161) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_orc_acid_part] (batchId=151) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_orc_acid_part_update] (batchId=159) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_orc_acid_table] (batchId=153) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_orc_acid_table_update] (batchId=159) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_orc_acidvec_part] (batchId=159) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_orc_acidvec_part_update] (batchId=148) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_orc_acidvec_table] (batchId=162) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_orc_acidvec_table_update] (batchId=146) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[sqlmerge] (batchId=161) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[union_fast_stats] (batchId=156) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[update_after_multiple_inserts] (batchId=159) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[update_all_non_partitioned] (batchId=147) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[update_all_partitioned] (batchId=156) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[update_all_types] (batchId=149) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[update_tmp_table] (batchId=153) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[update_two_cols] (batchId=149) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[update_where_no_match] (b
[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181691#comment-16181691 ] Hive QA commented on HIVE-17561: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12889163/HIVE-17561.3.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/6997/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/6997/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-6997/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ date '+%Y-%m-%d %T.%3N' 2017-09-26 22:35:53.027 + [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]] + export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 + export PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games + PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'MAVEN_OPTS=-Xmx1g ' + MAVEN_OPTS='-Xmx1g ' + cd /data/hiveptest/working/ + tee /data/hiveptest/logs/PreCommit-HIVE-Build-6997/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ git = \s\v\n ]] + [[ git = \g\i\t ]] + [[ -z master ]] + [[ -d apache-github-source-source ]] + [[ ! -d apache-github-source-source/.git ]] + [[ ! -d apache-github-source-source ]] + date '+%Y-%m-%d %T.%3N' 2017-09-26 22:35:53.030 + cd apache-github-source-source + git fetch origin >From https://github.com/apache/hive 2d698b6..f3cb704 master -> origin/master + git reset --hard HEAD HEAD is now at 2d698b6 HIVE-17483 : HS2 kill command to kill queries using query id (Teddy Choi, reviewed by Thejas Nair ) + git clean -f -d Removing standalone-metastore/src/gen/org/ + git checkout master Already on 'master' Your branch is behind 'origin/master' by 1 commit, and can be fast-forwarded. (use "git pull" to update your local branch) + git reset --hard origin/master HEAD is now at f3cb704 HIVE-17587 : Remove unnecessary filter from getPartitionsFromPartitionIds call (Tao Li, reviewed by Sergey Shelukhin) + git merge --ff-only origin/master Already up-to-date. + date '+%Y-%m-%d %T.%3N' 2017-09-26 22:35:54.171 + patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hiveptest/working/scratch/build.patch + [[ -f /data/hiveptest/working/scratch/build.patch ]] + chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh + /data/hiveptest/working/scratch/smart-apply-patch.sh /data/hiveptest/working/scratch/build.patch error: patch failed: ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java:2926 error: ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java: patch does not apply error: patch failed: ql/src/java/org/apache/hadoop/hive/ql/plan/ShowCompactionsDesc.java:27 error: ql/src/java/org/apache/hadoop/hive/ql/plan/ShowCompactionsDesc.java: patch does not apply error: patch failed: ql/src/test/results/clientpositive/dbtxnmgr_showlocks.q.out:67 error: ql/src/test/results/clientpositive/dbtxnmgr_showlocks.q.out: patch does not apply The patch does not appear to apply with p0, p1, or p2 + exit 1 ' {noformat} This message is automatically generated. ATTACHMENT ID: 12889163 - PreCommit-HIVE-Build > Move TxnStore and implementations to standalone metastore > - > > Key: HIVE-17561 > URL: https://issues.apache.org/jira/browse/HIVE-17561 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Transactions >Reporter: Alan Gates >Assignee: Alan Gates > Labels: pull-request-available > Attachments: HIVE-17561.2.patch, HIVE-17561.3.patch, HIVE-17561.patch > > > We need to move the metastore handling of transactions into the standalone > metastore. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182144#comment-16182144 ] Hive QA commented on HIVE-17561: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12889163/HIVE-17561.3.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/7004/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/7004/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-7004/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ date '+%Y-%m-%d %T.%3N' 2017-09-27 07:44:51.899 + [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]] + export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 + export PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games + PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'MAVEN_OPTS=-Xmx1g ' + MAVEN_OPTS='-Xmx1g ' + cd /data/hiveptest/working/ + tee /data/hiveptest/logs/PreCommit-HIVE-Build-7004/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ git = \s\v\n ]] + [[ git = \g\i\t ]] + [[ -z master ]] + [[ -d apache-github-source-source ]] + [[ ! -d apache-github-source-source/.git ]] + [[ ! -d apache-github-source-source ]] + date '+%Y-%m-%d %T.%3N' 2017-09-27 07:44:51.902 + cd apache-github-source-source + git fetch origin >From https://github.com/apache/hive ac24537..fb2b15f master -> origin/master + git reset --hard HEAD HEAD is now at ac24537 HIVE-17386 : support LLAP workload management in HS2 (low level only) (Sergey Shelukhin, reviewed by Zhiyuan Yang, Gunther Hagleitner) + git clean -f -d Removing common/src/java/org/apache/hadoop/hive/conf/HiveConf.java.orig Removing ql/src/java/org/apache/hadoop/hive/ql/exec/tez/monitoring/TezJobMonitor.java.orig Removing ql/src/java/org/apache/hadoop/hive/ql/wm/ Removing ql/src/test/org/apache/hadoop/hive/ql/wm/ Removing standalone-metastore/src/gen/org/ + git checkout master Already on 'master' Your branch is behind 'origin/master' by 1 commit, and can be fast-forwarded. (use "git pull" to update your local branch) + git reset --hard origin/master HEAD is now at fb2b15f HIVE-17590: upgrade hadoop to 2.8.1 (Zoltan Haindrich, reviewed by Peter Vary) + git merge --ff-only origin/master Already up-to-date. + date '+%Y-%m-%d %T.%3N' 2017-09-27 07:44:53.173 + patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hiveptest/working/scratch/build.patch + [[ -f /data/hiveptest/working/scratch/build.patch ]] + chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh + /data/hiveptest/working/scratch/smart-apply-patch.sh /data/hiveptest/working/scratch/build.patch error: patch failed: ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java:2926 error: ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java: patch does not apply error: patch failed: ql/src/java/org/apache/hadoop/hive/ql/plan/ShowCompactionsDesc.java:27 error: ql/src/java/org/apache/hadoop/hive/ql/plan/ShowCompactionsDesc.java: patch does not apply error: patch failed: ql/src/test/results/clientpositive/dbtxnmgr_showlocks.q.out:67 error: ql/src/test/results/clientpositive/dbtxnmgr_showlocks.q.out: patch does not apply error: patch failed: storage-api/pom.xml:31 error: storage-api/pom.xml: patch does not apply The patch does not appear to apply with p0, p1, or p2 + exit 1 ' {noformat} This message is automatically generated. ATTACHMENT ID: 12889163 - PreCommit-HIVE-Build > Move TxnStore and implementations to standalone metastore > - > > Key: HIVE-17561 > URL: https://issues.apache.org/jira/browse/HIVE-17561 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Transactions >Reporter: Alan Gates >Assignee: Alan Gates > Labels: pull-request-available > Attachments: HIVE-17561.2.patch, HIVE-17561.3.patch, HIVE-17561.patch > > > We need to move the metastore handling of transactions into the standalone > metastore. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-17561) Move TxnStore and implementations to standalone metastore
[ https://issues.apache.org/jira/browse/HIVE-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182952#comment-16182952 ] Hive QA commented on HIVE-17561: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12889308/HIVE-17561.4.patch {color:green}SUCCESS:{color} +1 due to 18 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 19 failed/errored test(s), 11082 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestAccumuloCliDriver.testCliDriver[accumulo_predicate_pushdown] (batchId=230) org.apache.hadoop.hive.cli.TestAccumuloCliDriver.testCliDriver[accumulo_single_sourced_multi_insert] (batchId=230) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[cte_2] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[dynamic_partition_pruning_2] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[global_limit] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[intersect_merge] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[llap_udf] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[orc_ppd_schema_evol_3a] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[parallel_colstats] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[rcfile_createas1] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[schemeAuthority] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[tez_union_dynamic_partition] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[tez_union_dynamic_partition_2] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[unionDistinct_1] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[optimize_nullscan] (batchId=161) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[union_fast_stats] (batchId=156) org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_explainuser_1] (batchId=170) org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainanalyze_2] (batchId=100) org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] (batchId=234) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/7006/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/7006/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-7006/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 19 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12889308 - PreCommit-HIVE-Build > Move TxnStore and implementations to standalone metastore > - > > Key: HIVE-17561 > URL: https://issues.apache.org/jira/browse/HIVE-17561 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Transactions >Reporter: Alan Gates >Assignee: Alan Gates > Labels: pull-request-available > Attachments: HIVE-17561.4.patch, HIVE-17561.patch > > > We need to move the metastore handling of transactions into the standalone > metastore. -- This message was sent by Atlassian JIRA (v6.4.14#64029)