[
https://issues.apache.org/jira/browse/HIVE-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051499#comment-14051499
]
Hive QA commented on HIVE-6584:
-------------------------------
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12653797/HIVE-6584.7.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/672/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/672/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-672/
Messages:
{noformat}
**** This message was trimmed, see log for full details ****
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-contrib
---
[INFO] Compiling 39 source files to
/data/hive-ptest/working/apache-svn-trunk-source/contrib/target/classes
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMax.java:
Some input files use or override a deprecated API.
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMax.java:
Recompile with -Xlint:deprecation for details.
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/contrib/src/java/org/apache/hadoop/hive/contrib/udf/example/UDFExampleStructPrint.java:
/data/hive-ptest/working/apache-svn-trunk-source/contrib/src/java/org/apache/hadoop/hive/contrib/udf/example/UDFExampleStructPrint.java
uses unchecked or unsafe operations.
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/contrib/src/java/org/apache/hadoop/hive/contrib/udf/example/UDFExampleStructPrint.java:
Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @
hive-contrib ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/data/hive-ptest/working/apache-svn-trunk-source/contrib/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-contrib ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
/data/hive-ptest/working/apache-svn-trunk-source/contrib/target/tmp
[mkdir] Created dir:
/data/hive-ptest/working/apache-svn-trunk-source/contrib/target/warehouse
[mkdir] Created dir:
/data/hive-ptest/working/apache-svn-trunk-source/contrib/target/tmp/conf
[copy] Copying 5 files to
/data/hive-ptest/working/apache-svn-trunk-source/contrib/target/tmp/conf
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @
hive-contrib ---
[INFO] Compiling 2 source files to
/data/hive-ptest/working/apache-svn-trunk-source/contrib/target/test-classes
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/contrib/src/test/org/apache/hadoop/hive/contrib/serde2/TestRegexSerDe.java:
/data/hive-ptest/working/apache-svn-trunk-source/contrib/src/test/org/apache/hadoop/hive/contrib/serde2/TestRegexSerDe.java
uses or overrides a deprecated API.
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/contrib/src/test/org/apache/hadoop/hive/contrib/serde2/TestRegexSerDe.java:
Recompile with -Xlint:deprecation for details.
[INFO]
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-contrib ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-contrib ---
[INFO] Building jar:
/data/hive-ptest/working/apache-svn-trunk-source/contrib/target/hive-contrib-0.14.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @
hive-contrib ---
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-contrib ---
[INFO] Installing
/data/hive-ptest/working/apache-svn-trunk-source/contrib/target/hive-contrib-0.14.0-SNAPSHOT.jar
to
/data/hive-ptest/working/maven/org/apache/hive/hive-contrib/0.14.0-SNAPSHOT/hive-contrib-0.14.0-SNAPSHOT.jar
[INFO] Installing
/data/hive-ptest/working/apache-svn-trunk-source/contrib/pom.xml to
/data/hive-ptest/working/maven/org/apache/hive/hive-contrib/0.14.0-SNAPSHOT/hive-contrib-0.14.0-SNAPSHOT.pom
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive HBase Handler 0.14.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-hbase-handler ---
[INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/hbase-handler
(includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @
hive-hbase-handler ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
hive-hbase-handler ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-hbase-handler
---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @
hive-hbase-handler ---
[INFO] Compiling 31 source files to
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/target/classes
[INFO] -------------------------------------------------------------
[WARNING] COMPILATION WARNING :
[INFO] -------------------------------------------------------------
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java:
Some input files use or override a deprecated API.
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java:
Recompile with -Xlint:deprecation for details.
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSerDeParameters.java:
Some input files use unchecked or unsafe operations.
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSerDeParameters.java:
Recompile with -Xlint:unchecked for details.
[INFO] 4 warnings
[INFO] -------------------------------------------------------------
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotSplit.java:[10,66]
package org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat does not
exist
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotSplit.java:[17,17]
cannot find symbol
symbol: class TableSnapshotRegionSplit
location: class org.apache.hadoop.hive.hbase.HBaseSnapshotSplit
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotSplit.java:[24,29]
cannot find symbol
symbol: class TableSnapshotRegionSplit
location: class org.apache.hadoop.hive.hbase.HBaseSnapshotSplit
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotSplit.java:[29,10]
cannot find symbol
symbol: class TableSnapshotRegionSplit
location: class org.apache.hadoop.hive.hbase.HBaseSnapshotSplit
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[28,41]
cannot find symbol
symbol: class TableSnapshotInputFormat
location: package org.apache.hadoop.hbase.mapreduce
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[31,66]
package org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat does not
exist
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[76,3]
cannot find symbol
symbol: class TableSnapshotInputFormat
location: class org.apache.hadoop.hive.hbase.HiveHBaseTableSnapshotInputFormat
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotStorageHandler.java:[36,41]
cannot find symbol
symbol: class TableSnapshotInputFormatImpl
location: package org.apache.hadoop.hbase.mapreduce
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotSplit.java:[21,17]
cannot find symbol
symbol: class TableSnapshotRegionSplit
location: class org.apache.hadoop.hive.hbase.HBaseSnapshotSplit
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[76,43]
cannot find symbol
symbol: class TableSnapshotInputFormat
location: class org.apache.hadoop.hive.hbase.HiveHBaseTableSnapshotInputFormat
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[125,54]
convertScanToString(org.apache.hadoop.hbase.client.Scan) is not public in
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil; cannot be accessed from
outside package
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[279,46]
cannot find symbol
symbol: class TableSnapshotRegionSplit
location: class org.apache.hadoop.hive.hbase.HiveHBaseTableSnapshotInputFormat
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[295,5]
cannot find symbol
symbol: class TableSnapshotRegionSplit
location: class org.apache.hadoop.hive.hbase.HiveHBaseTableSnapshotInputFormat
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotStorageHandler.java:[169,11]
cannot find symbol
symbol: variable TableSnapshotInputFormatImpl
location: class org.apache.hadoop.hive.hbase.HBaseSnapshotStorageHandler
[INFO] 14 errors
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Hive .............................................. SUCCESS [9.666s]
[INFO] Hive Ant Utilities ................................ SUCCESS [5.737s]
[INFO] Hive Shims Common ................................. SUCCESS [4.585s]
[INFO] Hive Shims 0.20 ................................... SUCCESS [2.598s]
[INFO] Hive Shims Secure Common .......................... SUCCESS [4.482s]
[INFO] Hive Shims 0.20S .................................. SUCCESS [2.989s]
[INFO] Hive Shims 0.23 ................................... SUCCESS [6.850s]
[INFO] Hive Shims ........................................ SUCCESS [0.676s]
[INFO] Hive Common ....................................... SUCCESS [20.287s]
[INFO] Hive Serde ........................................ SUCCESS [13.145s]
[INFO] Hive Metastore .................................... SUCCESS [33.448s]
[INFO] Hive Query Language ............................... SUCCESS [1:29.659s]
[INFO] Hive Service ...................................... SUCCESS [7.314s]
[INFO] Hive JDBC ......................................... SUCCESS [15.917s]
[INFO] Hive Beeline ...................................... SUCCESS [2.681s]
[INFO] Hive CLI .......................................... SUCCESS [2.613s]
[INFO] Hive Contrib ...................................... SUCCESS [3.214s]
[INFO] Hive HBase Handler ................................ FAILURE [7.778s]
[INFO] Hive HCatalog ..................................... SKIPPED
[INFO] Hive HCatalog Core ................................ SKIPPED
[INFO] Hive HCatalog Pig Adapter ......................... SKIPPED
[INFO] Hive HCatalog Server Extensions ................... SKIPPED
[INFO] Hive HCatalog Webhcat Java Client ................. SKIPPED
[INFO] Hive HCatalog Webhcat ............................. SKIPPED
[INFO] Hive HCatalog Streaming ........................... SKIPPED
[INFO] Hive HWI .......................................... SKIPPED
[INFO] Hive ODBC ......................................... SKIPPED
[INFO] Hive Shims Aggregator ............................. SKIPPED
[INFO] Hive TestUtils .................................... SKIPPED
[INFO] Hive Packaging .................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3:56.405s
[INFO] Finished at: Thu Jul 03 10:22:22 EDT 2014
[INFO] Final Memory: 120M/710M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on
project hive-hbase-handler: Compilation failure: Compilation failure:
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotSplit.java:[10,66]
package org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat does not
exist
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotSplit.java:[17,17]
cannot find symbol
[ERROR] symbol: class TableSnapshotRegionSplit
[ERROR] location: class org.apache.hadoop.hive.hbase.HBaseSnapshotSplit
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotSplit.java:[24,29]
cannot find symbol
[ERROR] symbol: class TableSnapshotRegionSplit
[ERROR] location: class org.apache.hadoop.hive.hbase.HBaseSnapshotSplit
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotSplit.java:[29,10]
cannot find symbol
[ERROR] symbol: class TableSnapshotRegionSplit
[ERROR] location: class org.apache.hadoop.hive.hbase.HBaseSnapshotSplit
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[28,41]
cannot find symbol
[ERROR] symbol: class TableSnapshotInputFormat
[ERROR] location: package org.apache.hadoop.hbase.mapreduce
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[31,66]
package org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat does not
exist
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[76,3]
cannot find symbol
[ERROR] symbol: class TableSnapshotInputFormat
[ERROR] location: class
org.apache.hadoop.hive.hbase.HiveHBaseTableSnapshotInputFormat
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotStorageHandler.java:[36,41]
cannot find symbol
[ERROR] symbol: class TableSnapshotInputFormatImpl
[ERROR] location: package org.apache.hadoop.hbase.mapreduce
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotSplit.java:[21,17]
cannot find symbol
[ERROR] symbol: class TableSnapshotRegionSplit
[ERROR] location: class org.apache.hadoop.hive.hbase.HBaseSnapshotSplit
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[76,43]
cannot find symbol
[ERROR] symbol: class TableSnapshotInputFormat
[ERROR] location: class
org.apache.hadoop.hive.hbase.HiveHBaseTableSnapshotInputFormat
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[125,54]
convertScanToString(org.apache.hadoop.hbase.client.Scan) is not public in
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil; cannot be accessed from
outside package
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[279,46]
cannot find symbol
[ERROR] symbol: class TableSnapshotRegionSplit
[ERROR] location: class
org.apache.hadoop.hive.hbase.HiveHBaseTableSnapshotInputFormat
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableSnapshotInputFormat.java:[295,5]
cannot find symbol
[ERROR] symbol: class TableSnapshotRegionSplit
[ERROR] location: class
org.apache.hadoop.hive.hbase.HiveHBaseTableSnapshotInputFormat
[ERROR]
/data/hive-ptest/working/apache-svn-trunk-source/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSnapshotStorageHandler.java:[169,11]
cannot find symbol
[ERROR] symbol: variable TableSnapshotInputFormatImpl
[ERROR] location: class org.apache.hadoop.hive.hbase.HBaseSnapshotStorageHandler
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hive-hbase-handler
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12653797
> Add HiveHBaseTableSnapshotInputFormat
> -------------------------------------
>
> Key: HIVE-6584
> URL: https://issues.apache.org/jira/browse/HIVE-6584
> Project: Hive
> Issue Type: Improvement
> Components: HBase Handler
> Reporter: Nick Dimiduk
> Assignee: Nick Dimiduk
> Fix For: 0.14.0
>
> Attachments: HIVE-6584.0.patch, HIVE-6584.1.patch, HIVE-6584.2.patch,
> HIVE-6584.3.patch, HIVE-6584.4.patch, HIVE-6584.5.patch, HIVE-6584.6.patch,
> HIVE-6584.7.patch
>
>
> HBASE-8369 provided mapreduce support for reading from HBase table snapsopts.
> This allows a MR job to consume a stable, read-only view of an HBase table
> directly off of HDFS. Bypassing the online region server API provides a nice
> performance boost for the full scan. HBASE-10642 is backporting that feature
> to 0.94/0.96 and also adding a {{mapred}} implementation. Once that's
> available, we should add an input format. A follow-on patch could work out
> how to integrate this functionality into the StorageHandler, similar to how
> HIVE-6473 integrates the HFileOutputFormat into existing table definitions.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
