Re: RFC: Remote "HBaseTest" from examples?

2016-04-21 Thread Zhan Zhang
FYI: There are several pending patches for DataFrame support on top of HBase. Thanks. Zhan Zhang On Apr 20, 2016, at 2:43 AM, Saisai Shao <sai.sai.s...@gmail.com<mailto:sai.sai.s...@gmail.com>> wrote: +1, HBaseTest in Spark Example is quite old and obsolete, the HBase connector i

[jira] [Commented] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-04-21 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252595#comment-15252595 ] Zhan Zhang commented on HBASE-15333: This patch has been there for a while. [~tedyu] how about we

Re: SparkSQL - Limit pushdown on BroadcastHashJoin

2016-04-18 Thread Zhan Zhang
Thanks Reynold. Not sure why doExecute is not invoked, since CollectLimit does not support wholeStage case class CollectLimit(limit: Int, child: SparkPlan) extends UnaryNode { I will dig further into this. Zhan Zhang On Apr 18, 2016, at 10:36 PM, Reynold Xin <r...@databricks.com<ma

Re: SparkSQL - Limit pushdown on BroadcastHashJoin

2016-04-18 Thread Zhan Zhang
, SinglePartition, serializer)) shuffled.mapPartitionsInternal(_.take(limit)) } Thus, there is no way to avoid processing all data before the shuffle. I think that is the reason. Do I understand correctly? Thanks. Zhan Zhang On Apr 18, 2016, at 10:08 PM, Reynold Xin <r...@databricks.com<ma

Re: Read Parquet in Java Spark

2016-04-18 Thread Zhan Zhang
You can try something like below, if you only have one column. val rdd = parquetFile.javaRDD().map(row => row.getAs[String](0) Thanks. Zhan Zhang On Apr 18, 2016, at 3:44 AM, Ramkumar V <ramkumar.c...@gmail.com<mailto:ramkumar.c...@gmail.com>> wrote: HI, Any idea on this ?

Re: Why Spark having OutOfMemory Exception?

2016-04-18 Thread Zhan Zhang
What kind of OOM? Driver or executor side? You can use coredump to find what cause the OOM. Thanks. Zhan Zhang On Apr 18, 2016, at 9:44 PM, 李明伟 <kramer2...@126.com<mailto:kramer2...@126.com>> wrote: Hi Samaga Thanks very much for your reply and sorry for the delay reply. Cassa

Re: SparkSQL - Limit pushdown on BroadcastHashJoin

2016-04-18 Thread Zhan Zhang
>From the physical plan, the limit is one level up than the WholeStageCodegen, >Thus, I don’t think shouldStop would work here. To move it work, the limit has >to be part of the wholeStageCodeGen. Correct me if I am wrong. Thanks. Zhan Zhang On Apr 18, 2016, at 11:09 AM, Reynol

Re: more uniform exception handling?

2016-04-18 Thread Zhan Zhang
+1 Both of the would be very helpful in debugging Thanks. Zhan Zhang On Apr 18, 2016, at 1:18 PM, Evan Chan <velvia.git...@gmail.com> wrote: > +1000. > > Especially if the UI can help correlate exceptions, and we can reduce > some exceptions. > > There a

[jira] [Commented] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-04-08 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233248#comment-15233248 ] Zhan Zhang commented on HBASE-15333: [~jmhsieh] any comments? > Enhance the filter to handle sh

[jira] [Updated] (HBASE-15335) Add composite key support in row key

2016-04-07 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15335: --- Status: Patch Available (was: Open) > Add composite key support in row

[jira] [Updated] (HBASE-15335) Add composite key support in row key

2016-04-07 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15335: --- Assignee: Zhan Zhang > Add composite key support in row

[jira] [Updated] (HBASE-15335) Add composite key support in row key

2016-04-07 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15335: --- Attachment: HBASE-15335-1.patch > Add composite key support in row

[jira] [Updated] (HBASE-15335) Add composite key support in row key

2016-04-07 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15335: --- Attachment: (was: HBASE-15335-1.patch) > Add composite key support in row

[jira] [Updated] (HBASE-15335) Add composite key support in row key

2016-04-07 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15335: --- Attachment: HBASE-15335-1.patch This patch is built on top of HBASE-15333, which delayed for a while

[jira] [Commented] (HBASE-15473) Documentation for the usage of hbase dataframe user api (JSON, Avro, etc)

2016-04-07 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231629#comment-15231629 ] Zhan Zhang commented on HBASE-15473: Currently the dataframe support has several places broken, e.g

[jira] [Updated] (HBASE-15473) Documentation for the usage of hbase dataframe user api (JSON, Avro, etc)

2016-04-07 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15473: --- Assignee: Zhan Zhang > Documentation for the usage of hbase dataframe user api (JSON, Avro,

[jira] [Commented] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-04-06 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15228730#comment-15228730 ] Zhan Zhang commented on HBASE-15333: [~ted.m] Thanks for the review. The main purpose of this patch

[jira] [Commented] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-04-04 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225490#comment-15225490 ] Zhan Zhang commented on HBASE-15333: [~jmhsieh] [~ted.m] Would you like take a final review before

[jira] [Commented] (HBASE-15572) Adding optional timestamp semantics to HBase-Spark

2016-04-01 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1542#comment-1542 ] Zhan Zhang commented on HBASE-15572: [~WeiqingYang] Can you please add a description in the ./src

[jira] [Commented] (HBASE-15572) Adding optional timestamp semantics to HBase-Spark

2016-03-31 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220657#comment-15220657 ] Zhan Zhang commented on HBASE-15572: Please open reviewboard for the review. > Adding optio

[jira] [Updated] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-03-30 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15333: --- Attachment: HBASE-15333-5.patch > Enhance the filter to handle short, integer, long, fl

[jira] [Commented] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-03-29 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217053#comment-15217053 ] Zhan Zhang commented on HBASE-15333: [~jmhsieh] [~ted.m] Would you like to take a look? > Enha

[jira] [Updated] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-03-29 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15333: --- Attachment: HBASE-15333-4.patch > Enhance the filter to handle short, integer, long, fl

[jira] [Updated] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-03-28 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15333: --- Attachment: HBASE-15333-3.patch > Enhance the filter to handle short, integer, long, fl

[jira] [Updated] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-03-23 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15333: --- Attachment: HBASE-15333-2.patch > Enhance the filter to handle short, integer, long, fl

[jira] [Commented] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-03-23 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209046#comment-15209046 ] Zhan Zhang commented on HBASE-15333: /cc [~jmhsieh] [~ted.m] > Enhance the filter to handle sh

[jira] [Commented] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-03-23 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209041#comment-15209041 ] Zhan Zhang commented on HBASE-15333: [~ndimiduk] The patch does not assume any specific encoding

[jira] [Updated] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-03-23 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15333: --- Status: Patch Available (was: Open) > Enhance the filter to handle short, integer, long, fl

[jira] [Updated] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-03-23 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15333: --- Attachment: HBASE-15333-1.patch Will create reviewboard later > Enhance the filter to handle sh

[jira] [Created] (HBASE-15473) Documentation for the usage of hbase dataframe user api (JSON, Avro, etc)

2016-03-19 Thread Zhan Zhang (JIRA)
Zhan Zhang created HBASE-15473: -- Summary: Documentation for the usage of hbase dataframe user api (JSON, Avro, etc) Key: HBASE-15473 URL: https://issues.apache.org/jira/browse/HBASE-15473 Project: HBase

[jira] [Commented] (HBASE-15334) Add avro support for spark hbase connector

2016-03-19 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198535#comment-15198535 ] Zhan Zhang commented on HBASE-15334: I created a documentation jira HBASE-15473, and add

[jira] [Commented] (HBASE-15334) Add avro support for spark hbase connector

2016-03-19 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200024#comment-15200024 ] Zhan Zhang commented on HBASE-15334: Thanks [~tedyu] for the review. > Add avro support for sp

[jira] [Created] (HBASE-15473) Documentation for the usage of hbase dataframe user api (JSON, Avro, etc)

2016-03-19 Thread Zhan Zhang (JIRA)
Zhan Zhang created HBASE-15473: -- Summary: Documentation for the usage of hbase dataframe user api (JSON, Avro, etc) Key: HBASE-15473 URL: https://issues.apache.org/jira/browse/HBASE-15473 Project: HBase

[jira] [Updated] (HBASE-15334) Add avro support for spark hbase connector

2016-03-18 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15334: --- Description: Avro is a popular format for hbase storage. User may want the support natively

[jira] [Updated] (HBASE-15334) Add avro support for spark hbase connector

2016-03-18 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15334: --- Description: Avro is a popular format for hbase storage. User may want the support natively

[jira] [Updated] (HBASE-15334) Add avro support for spark hbase connector

2016-03-15 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15334: --- Attachment: HBASE-15334-5.patch > Add avro support for spark hbase connec

[jira] [Commented] (HBASE-15334) Add avro support for spark hbase connector

2016-03-14 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193784#comment-15193784 ] Zhan Zhang commented on HBASE-15334: [~jmhsieh] [~ted.m] Would you like to take a look at the patch

[jira] [Updated] (HBASE-15334) Add avro support for spark hbase connector

2016-03-14 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15334: --- Attachment: (was: HBASE-15334-4.patch) > Add avro support for spark hbase connec

[jira] [Updated] (HBASE-15334) Add avro support for spark hbase connector

2016-03-14 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15334: --- Attachment: HBASE-15334-4.patch > Add avro support for spark hbase connec

[jira] [Updated] (HBASE-15334) Add avro support for spark hbase connector

2016-03-10 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15334: --- Attachment: HBASE-15334-4.patch Not sure why the 3.patch failed. resubmit. > Add avro supp

[jira] [Updated] (HBASE-15334) Add avro support for spark hbase connector

2016-03-10 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15334: --- Attachment: HBASE-15334-3.patch > Add avro support for spark hbase connec

[jira] [Commented] (HBASE-15334) Add avro support for spark hbase connector

2016-03-10 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189928#comment-15189928 ] Zhan Zhang commented on HBASE-15334: [~tedyu] attach the diff to review board. Regarding the nullable

[jira] [Updated] (HBASE-15334) Add avro support for spark hbase connector

2016-03-10 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15334: --- Attachment: HBASE-15334-2.patch > Add avro support for spark hbase connec

[jira] [Updated] (HBASE-15334) Add avro support for spark hbase connector

2016-03-10 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15334: --- Status: Patch Available (was: Open) > Add avro support for spark hbase connec

[jira] [Commented] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-03-10 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189831#comment-15189831 ] Zhan Zhang commented on HBASE-14801: [~jerryhe] The schema is defined on the application level

[jira] [Commented] (HBASE-15336) Support Dataframe writer to the spark connector

2016-03-10 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189669#comment-15189669 ] Zhan Zhang commented on HBASE-15336: Thanks [~tedyu] for the review. > Support Dataframe wri

[jira] [Updated] (HBASE-15336) Support Dataframe writer to the connector

2016-03-09 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15336: --- Attachment: HBASE-15336-3.patch > Support Dataframe writer to the connec

[jira] [Resolved] (HBASE-15350) Enable individual unit test in hbase-spark module

2016-03-09 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang resolved HBASE-15350. Resolution: Duplicate > Enable individual unit test in hbase-spark mod

[jira] [Resolved] (HBASE-15350) Enable individual unit test in hbase-spark module

2016-03-09 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang resolved HBASE-15350. Resolution: Duplicate > Enable individual unit test in hbase-spark mod

[jira] [Commented] (HBASE-15336) Support Dataframe writer to the connector

2016-03-09 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188033#comment-15188033 ] Zhan Zhang commented on HBASE-15336: [~tedyu] Review comments solved, and open review board, please

[jira] [Updated] (HBASE-15336) Support Dataframe writer to the connector

2016-03-09 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15336: --- Attachment: HBASE-15336-2.patch > Support Dataframe writer to the connec

[jira] [Updated] (HBASE-15336) Support Dataframe writer to the connector

2016-03-09 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15336: --- Status: Patch Available (was: Open) > Support Dataframe writer to the connec

[jira] [Commented] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-03-09 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187627#comment-15187627 ] Zhan Zhang commented on HBASE-14801: [~jmhsieh] [~ted_yu] Thanks a lot for the review. > Enha

[jira] [Commented] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-03-08 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186361#comment-15186361 ] Zhan Zhang commented on HBASE-14801: [~jmhsieh] Mind taking a final pass? > Enhance the Spark-HB

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-03-08 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Attachment: HBASE-14801-8.patch > Enhance the Spark-HBase connector catalog with json for

[jira] [Commented] (HBASE-15334) Add avro support for spark hbase connector

2016-03-07 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184044#comment-15184044 ] Zhan Zhang commented on HBASE-15334: [~ted_yu] Thanks for the quick response. I am trying to upload

[jira] [Commented] (HBASE-15334) Add avro support for spark hbase connector

2016-03-07 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184020#comment-15184020 ] Zhan Zhang commented on HBASE-15334: This patch is for pre-view, and it depends on HBAE-14801

[jira] [Updated] (HBASE-15334) Add avro support for spark hbase connector

2016-03-07 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15334: --- Attachment: HBASE-15334-1.patch > Add avro support for spark hbase connec

[jira] [Updated] (HBASE-15336) Support Dataframe writer to the connector

2016-03-04 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15336: --- Attachment: HBASE-15336-1.patch This is the patch for dataframe writer, which relies on the patch

[jira] [Commented] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-03-03 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179222#comment-15179222 ] Zhan Zhang commented on HBASE-14801: [~jmhsieh] Any other concerns? > Enhance the Spark-HB

[jira] [Assigned] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-03-03 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang reassigned HBASE-15333: -- Assignee: Zhan Zhang > Enhance the filter to handle short, integer, long, float and dou

[jira] [Assigned] (HBASE-15336) Support Dataframe writer to the connector

2016-03-03 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang reassigned HBASE-15336: -- Assignee: Zhan Zhang > Support Dataframe writer to the connec

[jira] [Assigned] (HBASE-15334) Add avro support for spark hbase connector

2016-03-03 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang reassigned HBASE-15334: -- Assignee: Zhan Zhang > Add avro support for spark hbase connec

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-03-02 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Attachment: HBASE-14801-7.patch > Enhance the Spark-HBase connector catalog with json for

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-03-02 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Attachment: HBASE-14801-6.patch > Enhance the Spark-HBase connector catalog with json for

[jira] [Commented] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-03-01 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174376#comment-15174376 ] Zhan Zhang commented on HBASE-14801: The purpose of this patch is to change the hbase catalog

[jira] [Commented] (HBASE-15350) Enable individual unit test in hbase-spark module

2016-02-29 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172897#comment-15172897 ] Zhan Zhang commented on HBASE-15350: duplicate of HBASE-14167 > Enable individual unit test in hb

[jira] [Updated] (HBASE-15350) Enable individual unit test in hbase-spark module

2016-02-29 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15350: --- Status: Open (was: Patch Available) > Enable individual unit test in hbase-spark mod

[jira] [Updated] (HBASE-15350) Enable individual unit test in hbase-spark module

2016-02-26 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15350: --- Summary: Enable individual unit test in hbase-spark module (was: Enable unit test in hbase-spark

[jira] [Commented] (HBASE-15350) Enable unit test in hbase-spark module

2016-02-26 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169962#comment-15169962 ] Zhan Zhang commented on HBASE-15350: [~jmhsieh] Thanks for the quick response. The purpose

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-26 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Issue Type: Sub-task (was: Improvement) Parent: HBASE-14789 > Enhance the Spark-HB

[jira] [Updated] (HBASE-15350) Enable unit test in hbase-spark module

2016-02-26 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15350: --- Attachment: HBASE-15350-2.patch > Enable unit test in hbase-spark mod

[jira] [Commented] (HBASE-15350) Enable unit test in hbase-spark module

2016-02-26 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169877#comment-15169877 ] Zhan Zhang commented on HBASE-15350: [~jmhsieh] Yes. It works. Now patch uploaded. > Enable u

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-26 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Attachment: HBASE-14801-5.patch > Enhance the Spark-HBase connector catalog with json for

[jira] [Commented] (HBASE-15350) Enable unit test in hbase-spark module

2016-02-26 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169849#comment-15169849 ] Zhan Zhang commented on HBASE-15350: [~ted_yu] Can you help review on this. It is relatively small

[jira] [Commented] (HBASE-15350) Enable unit test in hbase-spark module

2016-02-26 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169847#comment-15169847 ] Zhan Zhang commented on HBASE-15350: With the patch, you can run individual test, for example

[jira] [Updated] (HBASE-15350) Enable unit test in hbase-spark module

2016-02-26 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15350: --- Status: Patch Available (was: Open) > Enable unit test in hbase-spark mod

[jira] [Updated] (HBASE-15350) Enable unit test in hbase-spark module

2016-02-26 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-15350: --- Attachment: HBASE-15350-1.patch > Enable unit test in hbase-spark mod

[jira] [Created] (HBASE-15350) Enable unit test in hbase-spark module

2016-02-26 Thread Zhan Zhang (JIRA)
Zhan Zhang created HBASE-15350: -- Summary: Enable unit test in hbase-spark module Key: HBASE-15350 URL: https://issues.apache.org/jira/browse/HBASE-15350 Project: HBase Issue Type: Sub-task

[jira] [Assigned] (HBASE-15350) Enable unit test in hbase-spark module

2016-02-26 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang reassigned HBASE-15350: -- Assignee: Zhan Zhang > Enable unit test in hbase-spark mod

[jira] [Created] (HBASE-15350) Enable unit test in hbase-spark module

2016-02-26 Thread Zhan Zhang (JIRA)
Zhan Zhang created HBASE-15350: -- Summary: Enable unit test in hbase-spark module Key: HBASE-15350 URL: https://issues.apache.org/jira/browse/HBASE-15350 Project: HBase Issue Type: Sub-task

[jira] [Commented] (HBASE-14789) Enhance the current spark-hbase connector

2016-02-25 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168106#comment-15168106 ] Zhan Zhang commented on HBASE-14789: Add a number extra jiras to improve the current connector

[jira] [Created] (HBASE-15336) Support Dataframe writer to the connector

2016-02-25 Thread Zhan Zhang (JIRA)
Zhan Zhang created HBASE-15336: -- Summary: Support Dataframe writer to the connector Key: HBASE-15336 URL: https://issues.apache.org/jira/browse/HBASE-15336 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-15336) Support Dataframe writer to the connector

2016-02-25 Thread Zhan Zhang (JIRA)
Zhan Zhang created HBASE-15336: -- Summary: Support Dataframe writer to the connector Key: HBASE-15336 URL: https://issues.apache.org/jira/browse/HBASE-15336 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-15335) Add composite key support in row key

2016-02-25 Thread Zhan Zhang (JIRA)
Zhan Zhang created HBASE-15335: -- Summary: Add composite key support in row key Key: HBASE-15335 URL: https://issues.apache.org/jira/browse/HBASE-15335 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-15335) Add composite key support in row key

2016-02-25 Thread Zhan Zhang (JIRA)
Zhan Zhang created HBASE-15335: -- Summary: Add composite key support in row key Key: HBASE-15335 URL: https://issues.apache.org/jira/browse/HBASE-15335 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-15334) Add avro support for spark hbase connector

2016-02-25 Thread Zhan Zhang (JIRA)
Zhan Zhang created HBASE-15334: -- Summary: Add avro support for spark hbase connector Key: HBASE-15334 URL: https://issues.apache.org/jira/browse/HBASE-15334 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-02-25 Thread Zhan Zhang (JIRA)
Zhan Zhang created HBASE-15333: -- Summary: Enhance the filter to handle short, integer, long, float and double Key: HBASE-15333 URL: https://issues.apache.org/jira/browse/HBASE-15333 Project: HBase

[jira] [Created] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-02-25 Thread Zhan Zhang (JIRA)
Zhan Zhang created HBASE-15333: -- Summary: Enhance the filter to handle short, integer, long, float and double Key: HBASE-15333 URL: https://issues.apache.org/jira/browse/HBASE-15333 Project: HBase

[jira] [Commented] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166418#comment-15166418 ] Zhan Zhang commented on HBASE-14801: [~ted.m] Can you help to review the patch as well, and provide

[jira] [Commented] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166413#comment-15166413 ] Zhan Zhang commented on HBASE-14801: [~ted_yu] The latest patch attached to review board. I quickly

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Attachment: HBASE-14801-4.patch > Enhance the Spark-HBase connector catalog with json for

[jira] [Work started] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-14801 started by Zhan Zhang. -- > Enhance the Spark-HBase connector catalog with json for

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Status: Open (was: Patch Available) > Enhance the Spark-HBase connector catalog with json for

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Status: Patch Available (was: In Progress) > Enhance the Spark-HBase connector catalog with j

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Attachment: (was: HBASE-14801-3.patch) > Enhance the Spark-HBase connector catalog with j

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Attachment: HBASE-14801-3.patch > Enhance the Spark-HBase connector catalog with json for

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Status: Patch Available (was: In Progress) > Enhance the Spark-HBase connector catalog with j

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Status: In Progress (was: Patch Available) > Enhance the Spark-HBase connector catalog with j

[jira] [Updated] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated HBASE-14801: --- Attachment: HBASE-14801-3.patch > Enhance the Spark-HBase connector catalog with json for

<    1   2   3   4   5   6   >