Abhishek Girish created DRILL-3365: -------------------------------------- Summary: Query with window function on large dataset fails with "IOException: Mkdirs failed to create spill directory" Key: DRILL-3365 URL: https://issues.apache.org/jira/browse/DRILL-3365 Project: Apache Drill Issue Type: Bug Components: Execution - Flow Affects Versions: 1.1.0 Reporter: Abhishek Girish Assignee: Chris Westin Priority: Minor
Dataset: TPC-DS SF100 Parquet Query: {code:sql} SELECT sum(ss.ss_net_paid_inc_tax) OVER (PARTITION BY ss.ss_store_sk ORDER BY ss.ss_customer_sk) AS PartialSum FROM store_sales ss GROUP BY ss.ss_net_paid_inc_tax, ss.ss_store_sk, ss.ss_customer_sk LIMIT 20; java.lang.RuntimeException: java.sql.SQLException: SYSTEM ERROR: java.io.IOException: Mkdirs failed to create /tmp/drill/spill/2a74ac18-0679-ab99-26c6-af41b9af7f4e/major_fragment_1/minor_fragment_17/operator_4 (exists=false, cwd=file:///opt/mapr/drill/drill-1.1.0/bin) Fragment 1:17 [Error Id: 4905b400-fc0f-4287-beba-d1ca18359986 on abhi5.qa.lab:31010] at sqlline.IncrementalRows.hasNext(IncrementalRows.java:73) at sqlline.TableOutputFormat$ResizingRowsProvider.next(TableOutputFormat.java:85) at sqlline.TableOutputFormat.print(TableOutputFormat.java:116) at sqlline.SqlLine.print(SqlLine.java:1583) at sqlline.Commands.execute(Commands.java:852) at sqlline.Commands.sql(Commands.java:751) at sqlline.SqlLine.dispatch(SqlLine.java:738) at sqlline.SqlLine.begin(SqlLine.java:612) at sqlline.SqlLine.start(SqlLine.java:366) at sqlline.SqlLine.main(SqlLine.java:259) {code} Was unable to find corresponding logs. This was consistently seen via JDBC program and sqlline. After I restarted Drillbits the issue seems to have been resolved. But wanted to report this anyway. Possible explanation is DRILL-2917 (one or more drillbits were in an inconsistent state) -- This message was sent by Atlassian JIRA (v6.3.4#6332)