RE: Drill error with large sort

2016-02-26 Thread Paul Friedman
Thanks for this, these parameters fixed it! ---Paul -Original Message- From: Abdel Hakim Deneche [mailto:adene...@maprtech.com] Sent: Thursday, February 25, 2016 5:32 PM To: user <user@drill.apache.org> Subject: Re: Drill error with large sort Not so short answer: In Drill

Re: Drill error with large sort

2016-02-25 Thread Abdel Hakim Deneche
finish if u add a limit / top clause? >> # what do the logs say? >> >> >> From: Paul Friedman <paul.fried...@streetlightdata.com> >> Sent: Thursday, February 25, 2016 7:07:12 PM >> To: user@drill.apache.org >> Subject: Dri

Re: Drill error with large sort

2016-02-25 Thread Jeff Maass
<paul.fried...@streetlightdata.com> Sent: Thursday, February 25, 2016 7:07:12 PM To: user@drill.apache.org Subject: Drill error with large sort I’ve got a query reading from a large directory of parquet files (41 GB) and I’m consistently getting this error: Error: RESOURCE ERROR: One or more nod

Drill error with large sort

2016-02-25 Thread Paul Friedman
I’ve got a query reading from a large directory of parquet files (41 GB) and I’m consistently getting this error: Error: RESOURCE ERROR: One or more nodes ran out of memory while executing the query. Unable to allocate sv2 for 1023 records, and not enough batchGroups to spill.