Can you please share your query that generates/creates the CSV ?
What is the size of the CSV file ?
What version of Drill are you on ?
Thanks,
Khurram
________________________________
From: Rahul Raj <rahul....@option3consulting.com>
Sent: Tuesday, October 17, 2017 7:09:35 PM
To: user@drill.apache.org
Subject: Queries getting CANCELED
I have a web app that generates CSV files using Drill. When the CSV size
gets larger, the query state moves to CANCELED and results are always
partial/truncated. The same happens with larger parquet files too and works
fine with smaller data sets.
Code snippet is similar to:
try(Connection connection = ctx.getConnection()){
try(Statement st = connection.createStatement()){
st.executeQuery("alter session set `store.format` ='csv'");
st.executeQuery(query);
st.executeQuery("alter session set `store.format` ='parquet'");
}
}
The connections are wrapped within DBCP connection pool, I suspect DBCP
connection pool cancelling the queries. I set queryTimeout as 0, tried
adding some delays to see if its related to finishing the CSV writer, still
getting cancelled.
When the same queries are executed from Drill Web Console, complete results
are generated. Anyone faced similar issues? What could be wrong the the
scenario above?
Regards,
Rahul
--
**** This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom it is
addressed. If you are not the named addressee then you should not
disseminate, distribute or copy this e-mail. Please notify the sender
immediately and delete this e-mail from your system.****
