Re: How deep can Drill drill?

2015-09-24 Thread Stefán Baxter
Hi Chun, Can you please explain to me what you mean by nesting levels? Because the way I understand it, having 1800 nesting levels makes no sense :). Regards, -Stefan On Thu, Sep 24, 2015 at 9:18 PM, Chun Chang wrote: > For JSON data format, what is the

How deep can Drill drill?

2015-09-24 Thread Chun Chang
For JSON data format, what is the recommended/supported nesting levels Drill can handle? I think we should establish a limit and make it into the documentation. I tried querying a json file with 1800 nesting levels. The query never came back, even after three hours. Thanks, Chun

Re: How deep can Drill drill?

2015-09-24 Thread Chun Chang
Hi Stefan, Yeah, that many level doesn't make too much practical sense. It's just an example how people may test it with. Chun { "level0_lab0_bool" : false, "level0_lab1_float" : 0.03461426496505737, "level0_lab2_int" : -1001861650, "level0_lab3_double" : 0.015721726429861027,

Re: How deep can Drill drill?

2015-09-24 Thread rahul challapalli
I am not sure about the impact that nesting would cause, but if you have a lot of fields (nested or not) in one record, then drill might have some trouble in allocating memory for each field. If I just want to test how deep drill can dig, I will create a json document which has a single field at