[ https://issues.apache.org/jira/browse/HBASE-17989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995446#comment-15995446 ]
Sean Busbey commented on HBASE-17989: ------------------------------------- It's the scala version of ByteArrayComparable: {{hbase-spark/src//main/scala/org/apache/hadoop/hbase/spark/ByteArrayComparable.scala}} Having two of these classes seems like a bad idea. > hbase-spark silent compilation failures > --------------------------------------- > > Key: HBASE-17989 > URL: https://issues.apache.org/jira/browse/HBASE-17989 > Project: HBase > Issue Type: Bug > Components: build, spark > Environment: Apache Maven 3.5.0 > (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-03T14:39:06-05:00) > Maven home: /opt/apache-maven-3.5.0 > Java version: 1.8.0_131, vendor: Oracle Corporation > Java home: /usr/lib/jvm/java-8-oracle/jre > Default locale: en_US, platform encoding: UTF-8 > OS name: "linux", version: "3.13.0-116-generic", arch: "amd64", family: "unix" > Reporter: Mike Drob > Priority: Blocker > Fix For: 2.0.0 > > > This is very possibly an issue with my local environment, but it seems > strange enough that I'm not sure. > There are tons of compilation problems in the hbase-spark module. I first > noticed them because eclipse was complaining very loudly, but was very > confused when {{mvn package}} seemed to succeed. In trying to investigate, I > took a look at the generated class file and saw what looks like javac error > output: > {noformat} > $ less > hbase-spark/target/classes/org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter.class > <CA><FE><BA><BE>^@^@^@4^@R^G^@^B^A^@4org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter^G^@^D^A^@)org/apache/hadoop/hbase/filter/FilterBase^A^@^Clog^A^@ > > Lorg/apache/commons/logging/Log;^A^@^VdynamicLogicExpression^A^@^XLDynamicLogicExpression;^A^@^SvalueFromQueryArray^A^@^C[[B^A^@ESCcurrentCellToColumnIndexMap^A^@^SLjava/util/HashMap;^A^@ > > Signature^A^@fLjava/util/HashMap<LByteArrayComparable;Ljava/util/HashMap<LByteArrayComparable;Ljava/lang/String;>;>;^A^@^ZcolumnToCurrentRowValueMap^A^@<Ljava/util/HashMap<Ljava/lang/String;LByteArrayComparable;>;^A^@^LrowKeyFamily^A^@^B[B^A^@^OrowKeyQualifier^A^@^PencoderClassName^A^@^RLjava/lang/String;^A^@^F<init>^A^@C(LDynamicLogicExpression;[[BLjava/util/HashMap;Ljava/lang/String;)V^A^@<96>(LDynamicLogicExpression;[[BLjava/util/HashMap<LByteArrayComparable;Ljava/util/HashMap<LByteArrayComparable;Ljava/lang/String;>;>;Ljava/lang/String;)V^A^@^DCode^G^@ESC^A^@^Ojava/lang/Erro^@^]^A^M"Unresolved > compilation problems: > The import org.apache.hadoop.hbase.spark.datasources.BytesEncoder > cannot be resolved > The import org.apache.hadoop.hbase.spark.datasources.JavaBytesEncoder > cannot be resolved > The import org.apache.spark.sql.datasources.hbase.Field cannot be > resolved > DynamicLogicExpression cannot be resolved to a type > ByteArrayComparable cannot be resolved to a type > ByteArrayComparable cannot be resolved to a type > ByteArrayComparable cannot be resolved to a type > DynamicLogicExpression cannot be resolved to a type > <snip> > {noformat} > This problem is present in several classes. > {noformat} > $ grep -lrF 'Unresolved compilation problem' **/*.class > hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkDeleteExample.class > hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkGetExample.class > hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkLoadExample$BulkLoadFunction.class > hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkLoadExample.class > hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkPutExample.class > hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseDistributedScan.class > hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseMapGetPutExample.class > hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseStreamingBulkPutExample.class > hbase-spark/target/classes/org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter.class > hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext$BulkLoadFunction.class > hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext$BulkLoadThinRowsFunction.class > hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext.class > {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)