[
https://issues.apache.org/jira/browse/HIVE-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14148651#comment-14148651
]
Hive QA commented on HIVE-7389:
-------------------------------
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12655191/HIVE-7389.1.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/986/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/986/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-986/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]]
+ export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
+ JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
+ export
PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-maven-3.0.5/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
+
PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-maven-3.0.5/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ cd /data/hive-ptest/working/
+ tee /data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-986/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ svn = \s\v\n ]]
+ [[ -n '' ]]
+ [[ -d apache-svn-trunk-source ]]
+ [[ ! -d apache-svn-trunk-source/.svn ]]
+ [[ ! -d apache-svn-trunk-source ]]
+ cd apache-svn-trunk-source
+ svn revert -R .
Reverted 'ql/src/test/results/clientnegative/limit_partition_stats.q.out'
Reverted 'ql/src/test/results/clientpositive/explain_dependency.q.out'
Reverted 'ql/src/test/results/clientpositive/ql_rewrite_gbtoidx.q.out'
Reverted 'ql/src/test/results/clientpositive/orc_merge5.q.out'
Reverted 'ql/src/test/results/clientpositive/stats_only_null.q.out'
Reverted 'ql/src/test/results/clientpositive/orc_merge_incompat1.q.out'
Reverted 'ql/src/test/results/clientpositive/limit0.q.out'
Reverted 'ql/src/test/results/clientpositive/limit_pushdown.q.out'
Reverted 'ql/src/test/results/clientpositive/orc_merge7.q.out'
Reverted 'ql/src/test/results/clientpositive/tez/orc_merge_incompat1.q.out'
Reverted 'ql/src/test/results/clientpositive/tez/orc_merge6.q.out'
Reverted 'ql/src/test/results/clientpositive/tez/metadata_only_queries.q.out'
Reverted 'ql/src/test/results/clientpositive/tez/orc_merge5.q.out'
Reverted 'ql/src/test/results/clientpositive/tez/orc_merge_incompat2.q.out'
Reverted 'ql/src/test/results/clientpositive/tez/limit_pushdown.q.out'
Reverted 'ql/src/test/results/clientpositive/tez/orc_merge7.q.out'
Reverted 'ql/src/test/results/clientpositive/tez/orc_analyze.q.out'
Reverted 'ql/src/test/results/clientpositive/tez/alter_merge_stats_orc.q.out'
Reverted 'ql/src/test/results/clientpositive/query_properties.q.out'
Reverted 'ql/src/test/results/clientpositive/vectorization_limit.q.out'
Reverted 'ql/src/test/results/clientpositive/metadata_only_queries.q.out'
Reverted
'ql/src/test/results/clientpositive/metadata_only_queries_with_filters.q.out'
Reverted 'ql/src/test/results/clientpositive/orc_analyze.q.out'
Reverted 'ql/src/test/results/clientpositive/orc_merge6.q.out'
Reverted 'ql/src/test/results/clientpositive/orc_merge_incompat2.q.out'
Reverted 'ql/src/test/results/clientpositive/authorization_explain.q.out'
Reverted 'ql/src/test/results/clientpositive/alter_merge_stats_orc.q.out'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java'
++ awk '{print $2}'
++ egrep -v '^X|^Performing status on external'
++ svn status --no-ignore
+ rm -rf target datanucleus.log ant/target shims/target shims/0.20/target
shims/0.20S/target shims/0.23/target shims/aggregator/target
shims/common/target shims/common-secure/target packaging/target
hbase-handler/target testutils/target jdbc/target metastore/target
itests/target itests/hcatalog-unit/target itests/test-serde/target
itests/qtest/target itests/hive-unit-hadoop2/target itests/hive-minikdc/target
itests/hive-unit/target itests/custom-serde/target itests/util/target
hcatalog/target hcatalog/core/target hcatalog/streaming/target
hcatalog/server-extensions/target hcatalog/hcatalog-pig-adapter/target
hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target
accumulo-handler/target hwi/target common/target common/src/gen service/target
contrib/target serde/target beeline/target odbc/target cli/target
ql/dependency-reduced-pom.xml ql/target
ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java.orig
+ svn update
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HivePrivilegeObject.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HivePrincipal.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HiveAccessControlException.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HiveAuthorizerFactory.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HivePrivilege.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HiveAuthzPluginException.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HiveMetastoreClientFactory.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HiveAuthorizer.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HiveRoleGrant.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HiveAuthzContext.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HiveOperationType.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HivePrivilegeInfo.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HiveAuthzSessionContext.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HiveAccessController.java
U
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/HiveAuthorizationValidator.java
U ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezProcessor.java
U serde/src/test/org/apache/hadoop/hive/serde2/io/TestHiveCharWritable.java
U
serde/src/test/org/apache/hadoop/hive/serde2/io/TestHiveDecimalWritable.java
A serde/src/test/org/apache/hadoop/hive/serde2/io/TestDateWritable.java
U
serde/src/test/org/apache/hadoop/hive/serde2/io/TestHiveVarcharWritable.java
U serde/src/test/org/apache/hadoop/hive/serde2/io/TestTimestampWritable.java
U serde/pom.xml
U common/pom.xml
U common/src/test/org/apache/hadoop/hive/common/type/TestHiveDecimal.java
U common/src/test/org/apache/hadoop/hive/common/type/TestHiveVarchar.java
U common/src/test/org/apache/hadoop/hive/common/type/TestHiveChar.java
Fetching external item into 'hcatalog/src/test/e2e/harness'
Updated external to revision 1627704.
Updated to revision 1627704.
+ patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hive-ptest/working/scratch/build.patch
+ [[ -f /data/hive-ptest/working/scratch/build.patch ]]
+ chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh
/data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0, p1, or p2
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12655191
> Reduce number of metastore calls in MoveTask (when loading dynamic partitions)
> ------------------------------------------------------------------------------
>
> Key: HIVE-7389
> URL: https://issues.apache.org/jira/browse/HIVE-7389
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.14.0
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Labels: performance
> Attachments: HIVE-7389.1.patch, local_vm_testcase.txt
>
>
> When the number of dynamic partitions to be loaded are high, the time taken
> for 'MoveTask' is greater than the actual job in some scenarios. It would be
> possible to reduce overall runtime by reducing the number of calls made to
> metastore from MoveTask operation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
