RE: Query performance Comparison - Drill and Impala

2015-04-23 Thread Sivasubramaniam, Latha
: user@drill.apache.org Subject: Re: Query performance Comparison - Drill and Impala Any errors from each drillbit log? Can you run any simple drill query from any drillbit as of now? On Wed, Apr 22, 2015 at 5:09 PM, Sivasubramaniam, Latha < latha.sivasubraman...@aspect.com> wrote: &g

RE: Query performance Comparison - Drill and Impala

2015-04-22 Thread Sivasubramaniam, Latha
in this case. > > Thanks, > Hao > > On Tue, Apr 21, 2015 at 2:32 PM, Jinfeng Ni wrote: > >> The query you used is a 15-table join query. We know that Drill's >> cost based optimizer will see performance overhead increase >> significantly with increased # of

RE: Proper syntax for CTAS w/ Partition By

2015-04-22 Thread Sivasubramaniam, Latha
I was looking for the same and did not find a syntax for that. One of the earlier post indicated that it is not supported yet. -Latha -Original Message- From: Andy Pernsteiner [mailto:apernstei...@maprtech.com] Sent: Wednesday, April 22, 2015 5:34 AM To: user@drill.apache.org Subject: P

RE: Query performance Comparison - Drill and Impala

2015-04-21 Thread Sivasubramaniam, Latha
after the SQL finished. For Drill, you can go to the web GUI, and copy/paste the complete "Full JSON Profile". I want to compare what is the major performance difference between them two. Thanks, Hao On Tue, Apr 21, 2015 at 10:43 AM, Sivasubramaniam, Latha < latha.sivasu

RE: Query performance Comparison - Drill and Impala

2015-04-21 Thread Sivasubramaniam, Latha
"Full JSON Profile". I want to compare what is the major performance difference between them two. Thanks, Hao On Tue, Apr 21, 2015 at 10:43 AM, Sivasubramaniam, Latha < latha.sivasubraman...@aspect.com> wrote: > Neeraja, I removed some columns from select list and shorten

RE: Query performance Comparison - Drill and Impala

2015-04-21 Thread Sivasubramaniam, Latha
Message- From: Neeraja Rentachintala [mailto:nrentachint...@maprtech.com] Sent: Monday, April 20, 2015 9:22 PM To: user@drill.apache.org Subject: Re: Query performance Comparison - Drill and Impala Latha What error are you getting when doing explain plan. On Mon, Apr 20, 2015 at 4:40 PM, Sivas

RE: Query performance Comparison - Drill and Impala

2015-04-20 Thread Sivasubramaniam, Latha
ssing both might be an issue given the times you are seeing. On Apr 20, 2015 6:46 PM, "Sivasubramaniam, Latha" < latha.sivasubraman...@aspect.com> wrote: > Hi, > > I am running performance tests for our use cases on Impala and Drill > to make a choice and pick one for

Query performance Comparison - Drill and Impala

2015-04-20 Thread Sivasubramaniam, Latha
Hi, I am running performance tests for our use cases on Impala and Drill to make a choice and pick one for our Data warehouse implementation on top of Hadoop. I used the same cluster for both the tests. Select Query that takes ~20 seconds in impala, takes around 440 seconds in drill on same ha

RE: Unable to query data from hdfs

2015-04-11 Thread Sivasubramaniam, Latha
Please let me know if you are able to access the jar file. I tried different things and am still stuck with this problem. Appreciate your help/ any pointers on what is causing the issue and if there are any other alternatives. Thanks, Latha From: Sivasubramaniam, Latha Sent: Wednesday, April

RE: Unable to query data from hdfs

2015-04-08 Thread Sivasubramaniam, Latha
Hope this link works. https://drive.google.com/folderview?id=0ByB1-EsAGxA8MkhIdF9qczdBWFU&usp=sharing Regards, Latha From: Sivasubramaniam, Latha Sent: Wednesday, April 08, 2015 2:06 PM To: 'user@drill.apache.org' Subject: RE: Unable to query data from hdfs Ramana, Please

RE: Unable to query data from hdfs

2015-04-08 Thread Sivasubramaniam, Latha
Ramana, Please find attached dservices.tar file. Thanks for your help. -Latha From: Sivasubramaniam, Latha Sent: Wednesday, April 08, 2015 1:33 PM To: 'user@drill.apache.org' Subject: RE: Unable to query data from hdfs Thanks for all the responses. Once I renamed files within dire

RE: Unable to query data from hdfs

2015-04-08 Thread Sivasubramaniam, Latha
there any utility to do that. Thanks for all the help. Latha From: Sivasubramaniam, Latha Sent: Wednesday, April 08, 2015 8:00 AM To: 'user@drill.apache.org' Subject: RE: Unable to query data from hdfs Hi, Thanks for your responses. Even though I had done use hdfs, only when I fully

RE: Unable to query data from hdfs

2015-04-08 Thread Sivasubramaniam, Latha
Hi, Thanks for your responses. Even though I had done use hdfs, only when I fully qualified the file name it worked. But I am not able to access files without .csv extension. I modified "csv": { "type": "text", "extensions": [ "csv" ], "delimiter": "," To "csv

Unable to query data from hdfs

2015-04-07 Thread Sivasubramaniam, Latha
Hi, I have the hdfs storage system registered, below is the storage plugin details, it got registered successfully. { "type": "file", "enabled": true, "connection": "hdfs://:8020/", "workspaces": { "root": { "location": "/user/root/", "writable": true, "defaultInput