[
https://issues.apache.org/jira/browse/HBASE-17989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995476#comment-15995476
]
Mike Drob commented on HBASE-17989:
-----------------------------------
Cleaning everything and then rerunning maven everything seemed better this
time. Continued digging indicates that my Eclipse install doesn't know what to
do with scala sources. I'll do more research on my own, but I think it's safe
to assume the problem is on my end.
> hbase-spark silent compilation failures
> ---------------------------------------
>
> Key: HBASE-17989
> URL: https://issues.apache.org/jira/browse/HBASE-17989
> Project: HBase
> Issue Type: Bug
> Components: build, spark
> Environment: Apache Maven 3.5.0
> (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-03T14:39:06-05:00)
> Maven home: /opt/apache-maven-3.5.0
> Java version: 1.8.0_131, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-8-oracle/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "3.13.0-116-generic", arch: "amd64", family: "unix"
> Reporter: Mike Drob
> Priority: Blocker
> Fix For: 2.0.0
>
>
> This is very possibly an issue with my local environment, but it seems
> strange enough that I'm not sure.
> There are tons of compilation problems in the hbase-spark module. I first
> noticed them because eclipse was complaining very loudly, but was very
> confused when {{mvn package}} seemed to succeed. In trying to investigate, I
> took a look at the generated class file and saw what looks like javac error
> output:
> {noformat}
> $ less
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter.class
> <CA><FE><BA><BE>^@^@^@4^@R^G^@^B^A^@4org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter^G^@^D^A^@)org/apache/hadoop/hbase/filter/FilterBase^A^@^Clog^A^@
>
> Lorg/apache/commons/logging/Log;^A^@^VdynamicLogicExpression^A^@^XLDynamicLogicExpression;^A^@^SvalueFromQueryArray^A^@^C[[B^A^@ESCcurrentCellToColumnIndexMap^A^@^SLjava/util/HashMap;^A^@
>
> Signature^A^@fLjava/util/HashMap<LByteArrayComparable;Ljava/util/HashMap<LByteArrayComparable;Ljava/lang/String;>;>;^A^@^ZcolumnToCurrentRowValueMap^A^@<Ljava/util/HashMap<Ljava/lang/String;LByteArrayComparable;>;^A^@^LrowKeyFamily^A^@^B[B^A^@^OrowKeyQualifier^A^@^PencoderClassName^A^@^RLjava/lang/String;^A^@^F<init>^A^@C(LDynamicLogicExpression;[[BLjava/util/HashMap;Ljava/lang/String;)V^A^@<96>(LDynamicLogicExpression;[[BLjava/util/HashMap<LByteArrayComparable;Ljava/util/HashMap<LByteArrayComparable;Ljava/lang/String;>;>;Ljava/lang/String;)V^A^@^DCode^G^@ESC^A^@^Ojava/lang/Erro^@^]^A^M"Unresolved
> compilation problems:
> The import org.apache.hadoop.hbase.spark.datasources.BytesEncoder
> cannot be resolved
> The import org.apache.hadoop.hbase.spark.datasources.JavaBytesEncoder
> cannot be resolved
> The import org.apache.spark.sql.datasources.hbase.Field cannot be
> resolved
> DynamicLogicExpression cannot be resolved to a type
> ByteArrayComparable cannot be resolved to a type
> ByteArrayComparable cannot be resolved to a type
> ByteArrayComparable cannot be resolved to a type
> DynamicLogicExpression cannot be resolved to a type
> <snip>
> {noformat}
> This problem is present in several classes.
> {noformat}
> $ grep -lrF 'Unresolved compilation problem' **/*.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkDeleteExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkGetExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkLoadExample$BulkLoadFunction.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkLoadExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseDistributedScan.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseMapGetPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseStreamingBulkPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext$BulkLoadFunction.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext$BulkLoadThinRowsFunction.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext.class
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
