RE: Unable to query data from hdfs

2015-04-11 Thread Sivasubramaniam, Latha
Please let me know if you are able to access the jar file. I tried different things and am still stuck with this problem. Appreciate your help/ any pointers on what is causing the issue and if there are any other alternatives. Thanks, Latha From: Sivasubramaniam, Latha Sent: Wednesday, April 08

Re: Flatten function limit on large nested JSON array

2015-04-11 Thread Jason Altekruse
Hello Phil, Unfortunately this was a bug that was in flatten all along that ended up being exposed when we fixed another system-wide issue with supporting large lists and very wide strings. I have posted a patch that fixes this issue that is in review, and I want to do a little additional cleanup

Flatten function limit on large nested JSON array

2015-04-11 Thread Willett, Phil
First, congratulations on vastly improving the speed and size of JSON nested array parsing! I have run into a new problem when I try to flatten those large arrays now: Query Failed: An Error Occurred org.apache.drill.exec.rpc.RpcException: RemoteRpcException: Failure while running fragment., Inc

Re: Counting large numbers of unique values

2015-04-11 Thread Ted Dunning
Jason I attribute the existence of such nice javadoc to your influence. But should that doc say something about how ordinary types are injected? Or the protocol used to decode when state should be serialized? Even just a pointer would be handy. Sent from my iPhone > On Apr 10, 2015, at 11:

Re: Counting large numbers of unique values

2015-04-11 Thread Marcin Karpinski
Thanks guys for all the answers. I was suspecting that parallelization could wreck my approach but that was something I wanted to find out. In all cases, I'm going to experiment more with the sort-based aggregation - perhaps with enough computing power it will simply by sufficient. If not, we can e