Re: Problems with Phoenix SqlLine loading large amounts of data

2015-09-28 Thread Gabriel Reid
Hi Gaurav, Looking at your DDL statement, I'm guessing that your table is currently made up of 33 regions, which means that the time to do a full count query will take at least as long as it takes to count 27 million rows with a single thread (900 million threads divided by 33 regions). The

Re: Problems with Phoenix SqlLine loading large amounts of data

2015-09-28 Thread Gaurav Kanade
Hey Gabriel Thanks a lot for the suggestion; it turns out we were not quite utilizing our phoenix client (the sqlline program) correctly - having the right configs in the right place for the client etc. As a result I tried with a bunch of different salt bucket configs and we were not seeing any

Problems with Phoenix SqlLine loading large amounts of data

2015-09-25 Thread Gaurav Kanade
Hello Guys I was able to load my large data set (200 G) with phoenix bulk load tool with your help last week. But I am running into other problem running queries on this now using sqlline. All I am trying to do is run a simple count(*) query. Initially I hit timeout issues due to a