phenix spark Plugin not working for spark 2.0

2016-09-26 Thread dalin.qin
Hi I'm trying some test with spark 2.0 together with phoenix 4.8 . My enviroment is HDP 2.5 , I installed phoenix 4.8 by myself. I got everything working perfectly under spark 1.6.2 >>> df = sqlContext.read \ ... .format("org.apache.phoenix.spark") \ ... .option("table", "TABLE1") \ ... .op

Re: phenix spark Plugin not working for spark 2.0

2016-09-26 Thread Josh Mahonin
Hi Dalin, It looks like Spark may have gone and broken their API again for Spark 2.0. Could you file a JIRA ticket please? Thanks, Josh On Mon, Sep 26, 2016 at 1:17 PM, dalin.qin wrote: > Hi I'm trying some test with spark 2.0 together with phoenix 4.8 . My > enviroment is HDP 2.5 , I install

Re: How are Dataframes partitioned by default when using spark?

2016-09-26 Thread Josh Mahonin
Hi, The phoenix-spark integration inherits the underlying splits provided by Phoenix, which is a function of the HBase regions, salting and other aspects determined by the Phoenix Query Planner. Re: #1, as I understand the Spark JDBC connector, it evenly segments the range, although it will only

Re: phenix spark Plugin not working for spark 2.0

2016-09-26 Thread dalin.qin
Hi Josh, below is the link , this is the first time in my life to create a JIRA,I'm not sure whehter the link is a correct "JIRA ticket" (by the way I love the number , I'll remember this number ) https://issues.apache.org/jira/browse/PHOENIX- Thanks Dalin On Mon, Sep 26, 2016 at 3:54 P

Re: property object is being modified

2016-09-26 Thread Josh Elser
Did you ever create this issue, Prabhjyot? I don't recall seeing it come across my inbox but I might have missed it... Josh Elser wrote: Thanks Prabhjyot. Feel free to assign it directly to me. I can help triage/fix it. Prabhjyot Singh wrote: Thank you Josh, sure I'll do that. On 2016-09-22

Re: property object is being modified

2016-09-26 Thread Prabhjyot Singh
Yes, I did, https://issues.apache.org/jira/browse/PHOENIX-3315. and somehow didn't tag you. On 27 September 2016 at 07:57, Josh Elser wrote: > Did you ever create this issue, Prabhjyot? I don't recall seeing it come > across my inbox but I might have missed it... > > Josh Elser wrote: > >> Thank