[
https://issues.apache.org/jira/browse/HIVE-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580058#comment-14580058
]
Hive QA commented on HIVE-10959:
--------------------------------
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738697/HIVE-10959.3.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4235/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4235/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4235/
Messages:
{noformat}
**** This message was trimmed, see log for full details ****
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @
hive-hcatalog-server-extensions ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/hcatalog/server-extensions/target/tmp
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/hcatalog/server-extensions/target/warehouse
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/hcatalog/server-extensions/target/tmp/conf
[copy] Copying 11 files to
/data/hive-ptest/working/apache-github-source-source/hcatalog/server-extensions/target/tmp/conf
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @
hive-hcatalog-server-extensions ---
[INFO] Compiling 2 source files to
/data/hive-ptest/working/apache-github-source-source/hcatalog/server-extensions/target/test-classes
[INFO]
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @
hive-hcatalog-server-extensions ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @
hive-hcatalog-server-extensions ---
[INFO] Building jar:
/data/hive-ptest/working/apache-github-source-source/hcatalog/server-extensions/target/hive-hcatalog-server-extensions-2.0.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @
hive-hcatalog-server-extensions ---
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @
hive-hcatalog-server-extensions ---
[INFO] Installing
/data/hive-ptest/working/apache-github-source-source/hcatalog/server-extensions/target/hive-hcatalog-server-extensions-2.0.0-SNAPSHOT.jar
to
/home/hiveptest/.m2/repository/org/apache/hive/hcatalog/hive-hcatalog-server-extensions/2.0.0-SNAPSHOT/hive-hcatalog-server-extensions-2.0.0-SNAPSHOT.jar
[INFO] Installing
/data/hive-ptest/working/apache-github-source-source/hcatalog/server-extensions/pom.xml
to
/home/hiveptest/.m2/repository/org/apache/hive/hcatalog/hive-hcatalog-server-extensions/2.0.0-SNAPSHOT/hive-hcatalog-server-extensions-2.0.0-SNAPSHOT.pom
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive HCatalog Webhcat Java Client 2.0.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @
hive-webhcat-java-client ---
[INFO] Deleting
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/target
[INFO] Deleting
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client
(includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @
hive-webhcat-java-client ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @
hive-webhcat-java-client ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
hive-webhcat-java-client ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @
hive-webhcat-java-client ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @
hive-webhcat-java-client ---
[INFO] Compiling 36 source files to
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/target/classes
[WARNING]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/src/main/java/org/apache/hive/hcatalog/api/HCatClientHMSImpl.java:
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/src/main/java/org/apache/hive/hcatalog/api/HCatClientHMSImpl.java
uses or overrides a deprecated API.
[WARNING]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/src/main/java/org/apache/hive/hcatalog/api/HCatClientHMSImpl.java:
Recompile with -Xlint:deprecation for details.
[WARNING]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/src/main/java/org/apache/hive/hcatalog/api/repl/ReplicationTask.java:
Some input files use unchecked or unsafe operations.
[WARNING]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/src/main/java/org/apache/hive/hcatalog/api/repl/ReplicationTask.java:
Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @
hive-webhcat-java-client ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @
hive-webhcat-java-client ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/target/tmp
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/target/warehouse
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/target/tmp/conf
[copy] Copying 11 files to
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/target/tmp/conf
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @
hive-webhcat-java-client ---
[INFO] Compiling 6 source files to
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/target/test-classes
[WARNING]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/src/test/java/org/apache/hive/hcatalog/api/repl/CommandTestUtils.java:
Some input files use or override a deprecated API.
[WARNING]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/src/test/java/org/apache/hive/hcatalog/api/repl/CommandTestUtils.java:
Recompile with -Xlint:deprecation for details.
[INFO]
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @
hive-webhcat-java-client ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-webhcat-java-client ---
[INFO] Building jar:
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/target/hive-webhcat-java-client-2.0.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @
hive-webhcat-java-client ---
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @
hive-webhcat-java-client ---
[INFO] Installing
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/target/hive-webhcat-java-client-2.0.0-SNAPSHOT.jar
to
/home/hiveptest/.m2/repository/org/apache/hive/hcatalog/hive-webhcat-java-client/2.0.0-SNAPSHOT/hive-webhcat-java-client-2.0.0-SNAPSHOT.jar
[INFO] Installing
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/java-client/pom.xml
to
/home/hiveptest/.m2/repository/org/apache/hive/hcatalog/hive-webhcat-java-client/2.0.0-SNAPSHOT/hive-webhcat-java-client-2.0.0-SNAPSHOT.pom
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive HCatalog Webhcat 2.0.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-webhcat ---
[INFO] Deleting
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/target
[INFO] Deleting
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr
(includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @
hive-webhcat ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-webhcat
---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
hive-webhcat ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources to .
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-webhcat ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-webhcat
---
[INFO] Compiling 67 source files to
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/target/classes
[INFO] -------------------------------------------------------------
[WARNING] COMPILATION WARNING :
[INFO] -------------------------------------------------------------
[WARNING]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/Server.java:
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/Server.java
uses or overrides a deprecated API.
[WARNING]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/Server.java:
Recompile with -Xlint:deprecation for details.
[WARNING]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/LogRetriever.java:
Some input files use unchecked or unsafe operations.
[WARNING]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/LogRetriever.java:
Recompile with -Xlint:unchecked for details.
[INFO] 4 warnings
[INFO] -------------------------------------------------------------
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/LaunchMapper.java:[352,24]
cannot find symbol
symbol: method getState()
location: variable jobStatus of type org.apache.hadoop.mapred.JobStatus
[ERROR]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/LaunchMapper.java:[361,22]
cannot find symbol
symbol: method getMapProgress()
location: variable jobStatus of type org.apache.hadoop.mapred.JobStatus
[ERROR]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/LaunchMapper.java:[361,54]
cannot find symbol
symbol: method getReduceProgress()
location: variable jobStatus of type org.apache.hadoop.mapred.JobStatus
[INFO] 3 errors
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Hive .............................................. SUCCESS [15.525s]
[INFO] Hive Shims Common ................................. SUCCESS [13.363s]
[INFO] Hive Shims 0.20S .................................. SUCCESS [3.111s]
[INFO] Hive Shims 0.23 ................................... SUCCESS [11.266s]
[INFO] Hive Shims Scheduler .............................. SUCCESS [2.186s]
[INFO] Hive Shims ........................................ SUCCESS [2.270s]
[INFO] Hive Common ....................................... SUCCESS [16.131s]
[INFO] Hive Serde ........................................ SUCCESS [18.589s]
[INFO] Hive Metastore .................................... SUCCESS [38.687s]
[INFO] Hive Ant Utilities ................................ SUCCESS [1.865s]
[INFO] Spark Remote Client ............................... SUCCESS [17.120s]
[INFO] Hive Query Language ............................... SUCCESS [2:46.734s]
[INFO] Hive Service ...................................... SUCCESS [10.440s]
[INFO] Hive Accumulo Handler ............................. SUCCESS [5.524s]
[INFO] Hive JDBC ......................................... SUCCESS [17.588s]
[INFO] Hive Beeline ...................................... SUCCESS [3.847s]
[INFO] Hive CLI .......................................... SUCCESS [2.963s]
[INFO] Hive Contrib ...................................... SUCCESS [1.822s]
[INFO] Hive HBase Handler ................................ SUCCESS [6.738s]
[INFO] Hive HCatalog ..................................... SUCCESS [0.525s]
[INFO] Hive HCatalog Core ................................ SUCCESS [2.854s]
[INFO] Hive HCatalog Pig Adapter ......................... SUCCESS [3.323s]
[INFO] Hive HCatalog Server Extensions ................... SUCCESS [2.083s]
[INFO] Hive HCatalog Webhcat Java Client ................. SUCCESS [2.654s]
[INFO] Hive HCatalog Webhcat ............................. FAILURE [3.107s]
[INFO] Hive HCatalog Streaming ........................... SKIPPED
[INFO] Hive HWI .......................................... SKIPPED
[INFO] Hive ODBC ......................................... SKIPPED
[INFO] Hive Shims Aggregator ............................. SKIPPED
[INFO] Hive TestUtils .................................... SKIPPED
[INFO] Hive Packaging .................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6:13.135s
[INFO] Finished at: Wed Jun 10 01:42:50 EDT 2015
[INFO] Final Memory: 211M/566M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on
project hive-webhcat: Compilation failure: Compilation failure:
[ERROR]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/LaunchMapper.java:[352,24]
cannot find symbol
[ERROR] symbol: method getState()
[ERROR] location: variable jobStatus of type org.apache.hadoop.mapred.JobStatus
[ERROR]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/LaunchMapper.java:[361,22]
cannot find symbol
[ERROR] symbol: method getMapProgress()
[ERROR] location: variable jobStatus of type org.apache.hadoop.mapred.JobStatus
[ERROR]
/data/hive-ptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/LaunchMapper.java:[361,54]
cannot find symbol
[ERROR] symbol: method getReduceProgress()
[ERROR] location: variable jobStatus of type org.apache.hadoop.mapred.JobStatus
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hive-webhcat
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12738697 - PreCommit-HIVE-TRUNK-Build
> Templeton launcher job should reconnect to the running child job on task retry
> ------------------------------------------------------------------------------
>
> Key: HIVE-10959
> URL: https://issues.apache.org/jira/browse/HIVE-10959
> Project: Hive
> Issue Type: Bug
> Components: WebHCat
> Affects Versions: 0.15.0
> Reporter: Ivan Mitic
> Assignee: Ivan Mitic
> Attachments: HIVE-10959.2.patch, HIVE-10959.3.patch, HIVE-10959.patch
>
>
> Currently, Templeton launcher kills all child jobs (jobs tagged with the
> parent job's id) upon task retry.
> Upon templeton launcher task retry, templeton should reconnect to the running
> job and continue tracking its progress that way.
> This logic cannot be used for all job kinds (e.g. for jobs that are driven by
> the client side like regular hive). However, for MapReduceV2, and possibly
> Tez and HiveOnTez, this should be the default.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
