Re: Multiple upserts via JDBC

2016-02-19 Thread Sergey Soldatov
Zack, Actually command line and GUI tools are using the same JDBC layer. It would be nice if you provide more information about the application itself. Meanwhile you may try to set autocommit to false for the connection and use .commit when all upserts were done. Thanks, Sergey On Fri, Feb 19,

question about a config property

2016-02-19 Thread ashish tapdiya
Hi, Is phoenix.query.maxGlobalMemoryPercentage a server side property? Thanks, ~Ashish

Re: Spark Phoenix Plugin

2016-02-19 Thread Benjamin Kim
Hi Josh, When I run the following code in spark-shell for spark 1.6: import org.apache.phoenix.spark._ val df = sqlContext.load("org.apache.phoenix.spark", Map("table" -> "TEST.MY_TEST", "zkUrl" -> “zk1,zk2,zk3:2181")) df.select(df("ID")).show() I get this error:

Re: Spark Phoenix Plugin

2016-02-19 Thread Josh Mahonin
What specifically doesn't work for you? I have a Docker image that I used to do some basic testing on it with and haven't run into any problems: https://github.com/jmahonin/docker-phoenix/tree/phoenix_spark On Fri, Feb 19, 2016 at 12:40 PM, Benjamin Kim wrote: > All, > >

Re: YCSB with Phoenix?

2016-02-19 Thread Andrew Purtell
Never mind that last question. Check the email thread and ye shall find the answer... > On Feb 19, 2016, at 11:10 AM, Andrew Purtell wrote: > > The brianfrankcooper github repo (https://github.com/brianfrankcooper/YCSB) > is still the "official" home of YCSB as far

Re: YCSB with Phoenix?

2016-02-19 Thread Andrew Purtell
The brianfrankcooper github repo (https://github.com/brianfrankcooper/YCSB) is still the "official" home of YCSB as far as I know. YCSB ships with a JDBC client driver. Just use that with the Phoenix client jar on the classpath and the correct connection string for Phoenix. What patch is this

Re: YCSB with Phoenix?

2016-02-19 Thread James Taylor
I believe some folks over in the HBase community have revived YCSB, but I'm not sure where it's new home is. Also, not sure if they applied Mujtaba's patch. I'd recommend asking over on the HBase dev or user list. FWIW, we developed Pherf to enable Phoenix users to compare various Phoenix

Re: YCSB with Phoenix?

2016-02-19 Thread Mujtaba Chohan
You can apply this patch on YCSB to test out Phoenix with variable number of VARCHAR fields as well as test out combination of single/multiple CFs, compression and salt buckets. See usage details here

YCSB with Phoenix?

2016-02-19 Thread Gaurav Kanade
Hi All I am relatively new to Phoenix and was working on some performance tuning/benchmarking experiments and tried to search online for whether there exists YCSB client to go through Phoenix. I came across this https://github.com/brianfrankcooper/YCSB/pull/178 and some related links but it

Re: Spark Phoenix Plugin

2016-02-19 Thread Benjamin Kim
All, Thanks for the help. I have switched out Cloudera’s HBase 1.0.0 with the current Apache HBase 1.1.3. Also, I installed Phoenix 4.7.0, and everything works fine except for the Phoenix Spark Plugin. I wonder if it’s a version incompatibility issue with Spark 1.6. Has anyone tried compiling

RE: Multiple upserts via JDBC

2016-02-19 Thread Riesland, Zack
Thanks Sergey, The upserts are much faster via command line or a GUI tool like Aquadata Studio. Table structure is below. I'm creating a new user with 8 permissions. So 9 total upserts. Individually, via command line, this is almost instantaneous. But via JDBC, it takes tens of seconds to

Re: Multiple upserts via JDBC

2016-02-19 Thread Sergey Soldatov
Hi Zack, Have you tried to use sqlline to manually do those upserts to check the performance? Information about the tables structures would be useful as well. Thanks, Sergey On Tue, Feb 16, 2016 at 8:10 AM, Riesland, Zack wrote: > I have a handful of VERY small