[
https://issues.apache.org/jira/browse/HBASE-17989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995240#comment-15995240
]
Yi Liang commented on HBASE-17989:
----------------------------------
Hi Mike,
HBase-spark is scala & java mixed module, there is no good way to generate
javadoc for scala code. The javadoc errors may be caused by above class(all
those class are java class) want to read javadoc of some scala class.
> hbase-spark silent compilation failures
> ---------------------------------------
>
> Key: HBASE-17989
> URL: https://issues.apache.org/jira/browse/HBASE-17989
> Project: HBase
> Issue Type: Bug
> Components: build, spark
> Environment: Apache Maven 3.5.0
> (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-03T14:39:06-05:00)
> Maven home: /opt/apache-maven-3.5.0
> Java version: 1.8.0_131, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-8-oracle/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "3.13.0-116-generic", arch: "amd64", family: "unix"
> Reporter: Mike Drob
> Priority: Blocker
> Fix For: 2.0.0
>
>
> This is very possibly an issue with my local environment, but it seems
> strange enough that I'm not sure.
> There are tons of compilation problems in the hbase-spark module. I first
> noticed them because eclipse was complaining very loudly, but was very
> confused when {{mvn package}} seemed to succeed. In trying to investigate, I
> took a look at the generated class file and saw what looks like javac error
> output:
> {noformat}
> $ less
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter.class
> <CA><FE><BA><BE>^@^@^@4^@R^G^@^B^A^@4org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter^G^@^D^A^@)org/apache/hadoop/hbase/filter/FilterBase^A^@^Clog^A^@
>
> Lorg/apache/commons/logging/Log;^A^@^VdynamicLogicExpression^A^@^XLDynamicLogicExpression;^A^@^SvalueFromQueryArray^A^@^C[[B^A^@ESCcurrentCellToColumnIndexMap^A^@^SLjava/util/HashMap;^A^@
>
> Signature^A^@fLjava/util/HashMap<LByteArrayComparable;Ljava/util/HashMap<LByteArrayComparable;Ljava/lang/String;>;>;^A^@^ZcolumnToCurrentRowValueMap^A^@<Ljava/util/HashMap<Ljava/lang/String;LByteArrayComparable;>;^A^@^LrowKeyFamily^A^@^B[B^A^@^OrowKeyQualifier^A^@^PencoderClassName^A^@^RLjava/lang/String;^A^@^F<init>^A^@C(LDynamicLogicExpression;[[BLjava/util/HashMap;Ljava/lang/String;)V^A^@<96>(LDynamicLogicExpression;[[BLjava/util/HashMap<LByteArrayComparable;Ljava/util/HashMap<LByteArrayComparable;Ljava/lang/String;>;>;Ljava/lang/String;)V^A^@^DCode^G^@ESC^A^@^Ojava/lang/Erro^@^]^A^M"Unresolved
> compilation problems:
> The import org.apache.hadoop.hbase.spark.datasources.BytesEncoder
> cannot be resolved
> The import org.apache.hadoop.hbase.spark.datasources.JavaBytesEncoder
> cannot be resolved
> The import org.apache.spark.sql.datasources.hbase.Field cannot be
> resolved
> DynamicLogicExpression cannot be resolved to a type
> ByteArrayComparable cannot be resolved to a type
> ByteArrayComparable cannot be resolved to a type
> ByteArrayComparable cannot be resolved to a type
> DynamicLogicExpression cannot be resolved to a type
> <snip>
> {noformat}
> This problem is present in several classes.
> {noformat}
> $ grep -lrF 'Unresolved compilation problem' **/*.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkDeleteExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkGetExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkLoadExample$BulkLoadFunction.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkLoadExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseDistributedScan.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseMapGetPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseStreamingBulkPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext$BulkLoadFunction.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext$BulkLoadThinRowsFunction.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext.class
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
