[
https://issues.apache.org/jira/browse/HIVE-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268983#comment-14268983
]
Chuan Jin commented on HIVE-7378:
---------------------------------
I also encountered this problem, but zero copy is a new feature in hadoopshims.
If you don't need it ,you can overpass it by removing this class and build
again. Maybe using a higher version of hadoop to compile and build hive 0.13.1
is also a considerable choice.
https://issues.apache.org/jira/browse/HIVE-6346
> Could not build hive 0.13.1 with hadoop 2.2.0
> ---------------------------------------------
>
> Key: HIVE-7378
> URL: https://issues.apache.org/jira/browse/HIVE-7378
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.13.1
> Reporter: John
>
> I attemped to build hive 0.13.1 with hadoop 2.2.0 and got a failure.
> 1. Steps
> a. set `hadoop-23.version' to 2.2.0 in main pom file
> b. build with command `mvn clean install -DskipTests -Phadoop-2'
> 2. Error Messages
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Building Hive Shims 0.23 0.13.1
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-shims-0.23 ---
> [INFO] Deleting /home/apache/hive/shims/0.23/target
> [INFO] Deleting /home/apache/hive/shims/0.23 (includes = [datanucleus.log,
> derby.log], excludes = [])
> [INFO]
> [INFO] --- maven-remote-resources-plugin:1.5:process (default) @
> hive-shims-0.23 ---
> [INFO]
> [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
> hive-shims-0.23 ---
> [INFO] Using 'UTF-8' encoding to copy filtered resources.
> [INFO] skip non existing resourceDirectory
> /home/apache/hive/shims/0.23/src/main/resources
> [INFO] Copying 3 resources
> [INFO]
> [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-shims-0.23
> ---
> [INFO] Executing tasks
> main:
> [INFO] Executed tasks
> [INFO]
> [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @
> hive-shims-0.23 ---
> [INFO] Compiling 4 source files to /home/apache/hive/shims/0.23/target/classes
> [INFO] -------------------------------------------------------------
> [WARNING] COMPILATION WARNING :
> [INFO] -------------------------------------------------------------
> [WARNING]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:
>
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
> uses or overrides a deprecated API.
> [WARNING]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:
> Recompile with -Xlint:deprecation for details.
> [INFO] 2 warnings
> [INFO] -------------------------------------------------------------
> [INFO] -------------------------------------------------------------
> [ERROR] COMPILATION ERROR :
> [INFO] -------------------------------------------------------------
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[25,28]
> cannot find symbol
> symbol: class ReadOption
> location: package org.apache.hadoop.fs
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[28,28]
> cannot find symbol
> symbol: class ByteBufferPool
> location: package org.apache.hadoop.io
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[29,37]
> cannot find symbol
> symbol: class DirectDecompressor
> location: package org.apache.hadoop.io.compress
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[30,63]
> cannot find symbol
> symbol: class SnappyDirectDecompressor
> location: class org.apache.hadoop.io.compress.snappy.SnappyDecompressor
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[32,59]
> cannot find symbol
> symbol: class ZlibDirectDecompressor
> location: class org.apache.hadoop.io.compress.zlib.ZlibDecompressor
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[38,63]
> cannot find symbol
> symbol: class ByteBufferPool
> location: class org.apache.hadoop.hive.shims.ZeroCopyShims
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[59,34]
> cannot find symbol
> symbol: class ReadOption
> location: class org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[61,34]
> cannot find symbol
> symbol: class ReadOption
> location: class org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[94,19]
> cannot find symbol
> symbol: class DirectDecompressor
> location: class
> org.apache.hadoop.hive.shims.ZeroCopyShims.DirectDecompressorAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[96,38]
> cannot find symbol
> symbol: class DirectDecompressor
> location: class
> org.apache.hadoop.hive.shims.ZeroCopyShims.DirectDecompressorAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[45,5]
> method does not override or implement a method from a supertype
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[50,5]
> method does not override or implement a method from a supertype
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[60,17]
> cannot find symbol
> symbol: class ReadOption
> location: class org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[62,13]
> cannot find symbol
> symbol: variable ReadOption
> location: class org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[75,15]
> cannot find symbol
> symbol: class ReadOption
> location: class org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[83,14]
> cannot find symbol
> symbol: method releaseBuffer(java.nio.ByteBuffer)
> location: variable in of type org.apache.hadoop.fs.FSDataInputStream
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[107,5]
> cannot find symbol
> symbol: class DirectDecompressor
> location: class org.apache.hadoop.hive.shims.ZeroCopyShims
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[110,26]
> cannot find symbol
> symbol: class ZlibDirectDecompressor
> location: class org.apache.hadoop.hive.shims.ZeroCopyShims
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[114,26]
> cannot find symbol
> symbol: class ZlibDirectDecompressor
> location: class org.apache.hadoop.hive.shims.ZeroCopyShims
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[118,26]
> cannot find symbol
> symbol: class SnappyDirectDecompressor
> location: class org.apache.hadoop.hive.shims.ZeroCopyShims
> [INFO] 20 errors
> [INFO] -------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Hive .............................................. SUCCESS [2.371s]
> [INFO] Hive Ant Utilities ................................ SUCCESS [1.769s]
> [INFO] Hive Shims Common ................................. SUCCESS [1.020s]
> [INFO] Hive Shims 0.20 ................................... SUCCESS [0.745s]
> [INFO] Hive Shims Secure Common .......................... SUCCESS [1.039s]
> [INFO] Hive Shims 0.20S .................................. SUCCESS [0.607s]
> [INFO] Hive Shims 0.23 ................................... FAILURE [1.617s]
> [INFO] Hive Shims ........................................ SKIPPED
> [INFO] Hive Common ....................................... SKIPPED
> [INFO] Hive Serde ........................................ SKIPPED
> [INFO] Hive Metastore .................................... SKIPPED
> [INFO] Hive Query Language ............................... SKIPPED
> [INFO] Hive Service ...................................... SKIPPED
> [INFO] Hive JDBC ......................................... SKIPPED
> [INFO] Hive Beeline ...................................... SKIPPED
> [INFO] Hive CLI .......................................... SKIPPED
> [INFO] Hive Contrib ...................................... SKIPPED
> [INFO] Hive HBase Handler ................................ SKIPPED
> [INFO] Hive HCatalog ..................................... SKIPPED
> [INFO] Hive HCatalog Core ................................ SKIPPED
> [INFO] Hive HCatalog Pig Adapter ......................... SKIPPED
> [INFO] Hive HCatalog Server Extensions ................... SKIPPED
> [INFO] Hive HCatalog Webhcat Java Client ................. SKIPPED
> [INFO] Hive HCatalog Webhcat ............................. SKIPPED
> [INFO] Hive HCatalog HBase Storage Handler ............... SKIPPED
> [INFO] Hive HCatalog Streaming ........................... SKIPPED
> [INFO] Hive HWI .......................................... SKIPPED
> [INFO] Hive ODBC ......................................... SKIPPED
> [INFO] Hive Shims Aggregator ............................. SKIPPED
> [INFO] Hive TestUtils .................................... SKIPPED
> [INFO] Hive Packaging .................................... SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 9.910s
> [INFO] Finished at: Thu Jul 10 10:28:54 CST 2014
> [INFO] Final Memory: 47M/493M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile)
> on project hive-shims-0.23: Compilation failure: Compilation failure:
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[25,28]
> cannot find symbol
> [ERROR] symbol: class ReadOption
> [ERROR] location: package org.apache.hadoop.fs
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[28,28]
> cannot find symbol
> [ERROR] symbol: class ByteBufferPool
> [ERROR] location: package org.apache.hadoop.io
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[29,37]
> cannot find symbol
> [ERROR] symbol: class DirectDecompressor
> [ERROR] location: package org.apache.hadoop.io.compress
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[30,63]
> cannot find symbol
> [ERROR] symbol: class SnappyDirectDecompressor
> [ERROR] location: class
> org.apache.hadoop.io.compress.snappy.SnappyDecompressor
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[32,59]
> cannot find symbol
> [ERROR] symbol: class ZlibDirectDecompressor
> [ERROR] location: class org.apache.hadoop.io.compress.zlib.ZlibDecompressor
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[38,63]
> cannot find symbol
> [ERROR] symbol: class ByteBufferPool
> [ERROR] location: class org.apache.hadoop.hive.shims.ZeroCopyShims
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[59,34]
> cannot find symbol
> [ERROR] symbol: class ReadOption
> [ERROR] location: class
> org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[61,34]
> cannot find symbol
> [ERROR] symbol: class ReadOption
> [ERROR] location: class
> org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[94,19]
> cannot find symbol
> [ERROR] symbol: class DirectDecompressor
> [ERROR] location: class
> org.apache.hadoop.hive.shims.ZeroCopyShims.DirectDecompressorAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[96,38]
> cannot find symbol
> [ERROR] symbol: class DirectDecompressor
> [ERROR] location: class
> org.apache.hadoop.hive.shims.ZeroCopyShims.DirectDecompressorAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[45,5]
> method does not override or implement a method from a supertype
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[50,5]
> method does not override or implement a method from a supertype
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[60,17]
> cannot find symbol
> [ERROR] symbol: class ReadOption
> [ERROR] location: class
> org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[62,13]
> cannot find symbol
> [ERROR] symbol: variable ReadOption
> [ERROR] location: class
> org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[75,15]
> cannot find symbol
> [ERROR] symbol: class ReadOption
> [ERROR] location: class
> org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[83,14]
> cannot find symbol
> [ERROR] symbol: method releaseBuffer(java.nio.ByteBuffer)
> [ERROR] location: variable in of type org.apache.hadoop.fs.FSDataInputStream
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[107,5]
> cannot find symbol
> [ERROR] symbol: class DirectDecompressor
> [ERROR] location: class org.apache.hadoop.hive.shims.ZeroCopyShims
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[110,26]
> cannot find symbol
> [ERROR] symbol: class ZlibDirectDecompressor
> [ERROR] location: class org.apache.hadoop.hive.shims.ZeroCopyShims
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[114,26]
> cannot find symbol
> [ERROR] symbol: class ZlibDirectDecompressor
> [ERROR] location: class org.apache.hadoop.hive.shims.ZeroCopyShims
> [ERROR]
> /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[118,26]
> cannot find symbol
> [ERROR] symbol: class SnappyDirectDecompressor
> [ERROR] location: class org.apache.hadoop.hive.shims.ZeroCopyShims
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :hive-shims-0.23
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)