[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605657#comment-14605657 ]
Lars Francke commented on SPARK-2447: ------------------------------------- Hey Ted et. al, thanks for the work on this. SparkOnHBase is super useful and clients are happily using it. I wonder however what the future direction will be. Any progress on the question whether it's going to be integrated into Spark or not? I don't have a strong opinion either but I also don't feel that it would be _wrong_ to put it into core... > Add common solution for sending upsert actions to HBase (put, deletes, and > increment) > ------------------------------------------------------------------------------------- > > Key: SPARK-2447 > URL: https://issues.apache.org/jira/browse/SPARK-2447 > Project: Spark > Issue Type: New Feature > Components: Spark Core, Streaming > Reporter: Ted Malaska > Assignee: Ted Malaska > > Going to review the design with Tdas today. > But first thoughts is to have an extension of VoidFunction that handles the > connection to HBase and allows for options such as turning auto flush off for > higher through put. > Need to answer the following questions first. > - Can it be written in Java or should it be written in Scala? > - What is the best way to add the HBase dependency? (will review how Flume > does this as the first option) > - What is the best way to do testing? (will review how Flume does this as the > first option) > - How to support python? (python may be a different Jira it is unknown at > this time) > Goals: > - Simple to use > - Stable > - Supports high load > - Documented (May be in a separate Jira need to ask Tdas) > - Supports Java, Scala, and hopefully Python > - Supports Streaming and normal Spark -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org