Re: subsequent CTAS statements getting cancelled

> Adam, > > Adam Lau wrote: >> Hi all, >> >> I'm running multiple CTAS statements that selects and filters a json > > file to produce another json file on my local filesystem. The first > > ctas works but subsequent ones ... > > Do you execute the subsequent SQL statements using a separate JDBC

Re: Memory error

Thank you Ted next time I will make sure I would select a larger machine. I have tried below suggested changes and I was able to atleast start the Drill for now. Regards, Alok Tanna Sent from my iPhone > On Apr 22, 2015, at 6:12 PM, Ted Dunning wrote: > > You have allocated 4GB to Java's heap

Re: Query performance Comparison - Drill and Impala

Any errors from each drillbit log? Can you run any simple drill query from any drillbit as of now? On Wed, Apr 22, 2015 at 5:09 PM, Sivasubramaniam, Latha < latha.sivasubraman...@aspect.com> wrote: > Hi Hao, > > I am yet to run the tests with the queries you had asked for. I have to > get the re

RE: Query performance Comparison - Drill and Impala

Hi Hao, I am yet to run the tests with the queries you had asked for. I have to get the results for 15 concurrent queries before that. I am using sqlline, so I had setup 15 terminals ( since running as a background process does not seem to work) and submitted 15 queries. Initial behavior was s

Re: Memory error

You have allocated 4GB to Java's heap and the rest of the 4GB RAM (i.e. zero) you have allocated to data storage. Try 1) running on a larger machine. Having >8G memory will make these worries go away. 2) decreasing memory requirements. Here is one possibility that may or may not work out well:

Re: Memory error

OS RAM is 4 GB and below is the drill memory configuration from drill-env.sh DRILL_MAX_DIRECT_MEMORY="8G" DRILL_MAX_HEAP="4G" export DRILL_JAVA_OPTS="-Xms1G -Xmx$DRILL_MAX_HEAP -XX:MaxDirectMemorySize=$DRILL_MAX_DIRECT_MEMORY -XX:MaxPermSize= -X512M X:ReservedCodeCacheSize=1G -ea" # Class unload

Re: Memory error

OS runs OOM. What is the OS RAMs and Drill memory configurations? Thanks, Hao On Wed, Apr 22, 2015 at 2:30 PM, Alok Tanna wrote: > I was trying to load 500 thousand row csv file in Drill and I am getting > below error . Now I am not even able to start the Drill . Any suggestions > .Attached i

Memory error

I was trying to load 500 thousand row csv file in Drill and I am getting below error . Now I am not even able to start the Drill . Any suggestions .Attached is the error log. [root@ apache-drill-0.8.0]# bin/sqlline -u jdbc:drill:zk=local Drill log directory /var/log/drill does not exist or is no

Re: subsequent CTAS statements getting cancelled

Adam, Adam Lau wrote: Hi all, I'm running multiple CTAS statements that selects and filters a json > file to produce another json file on my local filesystem. The first > ctas works but subsequent ones ... Do you execute the subsequent SQL statements using a separate JDBC Statement object (fr

Re: Proper syntax for CTAS w/ Partition By

Auto partitioning using CTAS syntax is not available yet. > On Apr 22, 2015, at 7:23 AM, Sivasubramaniam, Latha > wrote: > > I was looking for the same and did not find a syntax for that. One of the > earlier post indicated that it is not supported yet. > > -Latha > > -Original Message--

RE: Proper syntax for CTAS w/ Partition By

I was looking for the same and did not find a syntax for that. One of the earlier post indicated that it is not supported yet. -Latha -Original Message- From: Andy Pernsteiner [mailto:apernstei...@maprtech.com] Sent: Wednesday, April 22, 2015 5:34 AM To: user@drill.apache.org Subject: P

subsequent CTAS statements getting cancelled

Hi all, I'm running multiple CTAS statements that selects and filters a json file to produce another json file on my local filesystem. The first ctas works but subsequent ones end up not completing fully and somehow end up getting cancelled. The table is created (as a json file) but the data i

Re: New Drillbits joining cluster causes severe performance spike

Adam, There has been some auto-scaling experimentation done outside the list in which drillbits stay alive, but don't accept work and don't allocate memory until they are needed. That avoids startup transients for the most part. This scaling work is still quite immature, but I will encourage tho

Proper syntax for CTAS w/ Partition By

I'm trying to use CTAS in drill to create a parquet table that is partitioned by 2 columns (equity -> date). I'm not finding a direct reference on how to do this. Does someone have an example of how they were able to accomplish this? -- Andy Pernsteiner Manager, Field Enablement ph: 206.228