[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14088899#comment-14088899
]
Sean Owen commented on SPARK-1297:
----------------------------------
(CC [~ted.m]) I believe this will have some implications regarding Hadoop
compatibility, but, I'm not an expert on this. I believe 0.96 has provisions
for both Hadoop 1 and 2 compatibility; does 0.98?
Right now HBase is only used in examples, so it would not matter greatly if
that part only worked with Hadoop 2. I know there is some work to create a more
proper HBase integration module, which might make this matter more.
I also recall from talking to Ted that this is going to require some work with
profiles to get right. Not only are 0.96+'s modules different, they differ from
Hadoop 1 to Hadoop 2 as it has "hadoop1-compat" and "hadoop2-compat" artifacts.
We would actually have to have a "hadoop1" profile in the entire build to make
this work I think? or else I've missed a clever way to finesse this.
Or, don't bother and say HBase integration is Hadoop 2+ only.
Probably doable but needs some thought!
> Upgrade HBase dependency to 0.98.0
> ----------------------------------
>
> Key: SPARK-1297
> URL: https://issues.apache.org/jira/browse/SPARK-1297
> Project: Spark
> Issue Type: Task
> Reporter: Ted Yu
> Priority: Minor
>
> HBase 0.94.6 was released 11 months ago.
> Upgrade HBase dependency to 0.98.0
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
