Re: how dose count(1) works?

2016-07-05 Thread kevin
0: jdbc:phoenix:master> select count(1) from STORE_SALES; +--+ | COUNT(1) | +--+ java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException:

Re: NoClassDefFoundError org/apache/hadoop/hbase/HBaseConfiguration

2016-07-05 Thread Chris Tarnas
For HDP 2.4.2 this is what we ended up with to get it to work: /usr/hdp/2.4.2.0-258/phoenix/lib/phoenix-core-4.4.0.2.4.2.0-258.jar /usr/hdp/2.4.2.0-258/phoenix/lib/phoenix-spark-4.4.0.2.4.2.0-258.jar /usr/hdp/2.4.2.0-258/phoenix/lib/hbase-client.jar

Re: NoClassDefFoundError org/apache/hadoop/hbase/HBaseConfiguration

2016-07-05 Thread Sergey Soldatov
Robert, you should use the phoenix-4*-spark.jar that is located in root phoenix directory. Thanks, Sergey On Tue, Jul 5, 2016 at 8:06 AM, Josh Elser wrote: > Looking into this on the HDP side. Please feel free to reach out via HDP > channels instead of Apache channels. >

Re: Phoenix-Spark: is DataFrame saving a single threaded operation?

2016-07-05 Thread Josh Mahonin
Hi Vamsi, The DataFrame has an underlying number of partitions associated with it, which will be processed by however many workers you have in your Spark cluster. You can check the number of partitions with: df.rdd.partitions.size And you can alter the partitions using:

Re: CsvBulkLoadTool not populating Actual Table & Local Index Table when '-it' option specified

2016-07-05 Thread Vamsi Krishna
Thanks Rajeshbabu. On Tue, Jul 5, 2016 at 5:59 AM rajeshb...@apache.org < chrajeshbab...@gmail.com> wrote: > Hi Vamsi, > > There is a bug with local indexes in 4.4.0 which is fixed in 4.7.0 > https://issues.apache.org/jira/browse/PHOENIX-2334 > > Thanks, > Rajeshbabu. > > On Tue, Jul 5, 2016 at

Phoenix-Spark: is DataFrame saving a single threaded operation?

2016-07-05 Thread Vamsi Krishna
Team, In Phoenix-Spark plugin is DataFrame save operation single threaded? df.write \ .format("org.apache.phoenix.spark") \ .mode("overwrite") \ .option("table", "TABLE1") \ .option("zkUrl", "localhost:2181") \ .save() Thanks, Vamsi Attluri -- Vamsi Attluri

Re: NoClassDefFoundError org/apache/hadoop/hbase/HBaseConfiguration

2016-07-05 Thread Josh Elser
Looking into this on the HDP side. Please feel free to reach out via HDP channels instead of Apache channels. Thanks for letting us know as well. Josh Mahonin wrote: Hi Robert, I recommend following up with HDP on this issue. The underlying problem is that the

Re: NoClassDefFoundError org/apache/hadoop/hbase/HBaseConfiguration

2016-07-05 Thread Josh Mahonin
Hi Robert, I recommend following up with HDP on this issue. The underlying problem is that the 'phoenix-spark-4.4.0.2.4.0.0-169.jar' they've provided isn't actually a fat client JAR, it's missing many of the required dependencies. They might be able to provide the correct JAR for you, but you'd

Re: CsvBulkLoadTool not populating Actual Table & Local Index Table when '-it' option specified

2016-07-05 Thread rajeshb...@apache.org
Hi Vamsi, There is a bug with local indexes in 4.4.0 which is fixed in 4.7.0 https://issues.apache.org/jira/browse/PHOENIX-2334 Thanks, Rajeshbabu. On Tue, Jul 5, 2016 at 6:21 PM, Vamsi Krishna wrote: > Team, > > I'm working on HDP 2.3.2 (Phoenix 4.4.0, HBase 1.1.2).

CsvBulkLoadTool not populating Actual Table & Local Index Table when '-it' option specified

2016-07-05 Thread Vamsi Krishna
Team, I'm working on HDP 2.3.2 (Phoenix 4.4.0, HBase 1.1.2). When I use '-it' option of CsvBulkLoadTool neither Acutal Table nor Local Index Table is loaded. *Command:* *HADOOP_CLASSPATH=/usr/hdp/current/hbase-master/lib/hbase-protocol.jar:/etc/hbase/conf yarn jar

NoClassDefFoundError org/apache/hadoop/hbase/HBaseConfiguration

2016-07-05 Thread Robert James
I'm trying to use Phoenix on Spark, and can't get around this error: java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration at org.apache.phoenix.spark.PhoenixRDD.getPhoenixConfiguration(PhoenixRDD.scala:82) DETAILS: 1. I'm running HDP 2.4.0.0-169 2. Using