Re: [DRILL HANGOUT] Topics for 5/16/2017

2017-05-15 Thread Jinfeng Ni
My feeling is that either temp table or putting 100k values into a separate parquet files makes more sense than putting 100k values in a IN list. Although for such long IN list Drill planner will convert into a JOIN (which is same as temp table / parquet table solutions), there is a big difference

RE: [DRILL HANGOUT] Topics for 5/16/2017

2017-05-15 Thread jasbir.sing
Hi, I am stuck in a problem where instance of apache drill stops working. My topic of discussion will be - For a scenario, I have 25 parquet file with around 400K-500K records with around 10 columns. My select query is such that for one column in clause values are around 100K. When I run these

Re: Run Multiple Queries as a Single query Apache Drill

2017-05-15 Thread Kunal Khatua
You could try to set the value through the OPTIONS tab on the top right. This will be a permanent 'system' level setting and not a temporary 'session'-level setting. You can have your API also do this using the 'alter system set ...' to achieve the same end goal. ___

Re: Drill embedded mode

2017-05-15 Thread Paul Rogers
It may be a misunderstanding of terminology. “Embedded” means the Drill Java code running in a process other than the Drill server. The most common community example of an embedded Drill is when Drill runs inside of the Sqlline command-line app. In fact, if you run the drill-embedded script, wh

Run Multiple Queries as a Single query Apache Drill

2017-05-15 Thread Spandan Harithas Karamchedu
Hi, I am planning to run the queries on Apache Drill using web console. I am facing an issue of running two queries as a single query. For example, I want to run the below query "select * from dfs.root.`/Users/skaramchedu/hourly-job/2017/05/09/00/output/part-r-0` limit 1" But before that,

[DRILL HANGOUT] Topics for 5/16/2017

2017-05-15 Thread Jinfeng Ni
Hi All, Out bi-weekly Drill hangout is tomorrow (5/16/2017, 10AM PDT). Please respond with suggestion of topics for discussion. We will also collect topics at the beginning of handout tomorrow. Thanks, Jinfeng

Re: creating tables in S3

2017-05-15 Thread Padma Penumarthy
I am wondering if location information in plugin configuration should be "location": “/drill-tmp” (instead of “location":”drill-tmp”) Thanks, Padma > On May 15, 2017, at 1:34 PM, Charles Givre wrote: > > Hi Michael, > A few questions: > 1. Does the origin query work? > > SELECT COLUMNS[0

Re: creating tables in S3

2017-05-15 Thread Charles Givre
Hi Michael, A few questions: 1. Does the origin query work? SELECT COLUMNS[0] x, COLUMNS[1] y FROM s3.`path/to/my.tbl` One thing that jumps out at me is that I think "columns" has to be lower case. 2. Did you set up the .tbl extension to read pipe separated files? That also could be causing pr

creating tables in S3

2017-05-15 Thread Knapp, Michael
Hi, So I have a directory full of pipe separated value files. I was hoping to convert these to parquet using Drill’s CTAS command. I tried this: create table s3.tmp.`my_table` (x, y) as SELECT COLUMNS[0] x, COLUMNS[1] y FROM s3.`path/to/my.tbl` after a little time, I get this error: org.apac

Re: Drill embedded mode

2017-05-15 Thread Kunal Khatua
Is there a reason you want to use Drill in Embedded mode and not as a standalone server? You can always use a screen session and start up Drill embedded mode and then detach that session. From: Selvarajan Thangavel Sent: Sunday, May 14, 2017 7:31:58 AM To: use

Re: Not Able to suscribe

2017-05-15 Thread Kunal Khatua
Did this not work? https://drill.apache.org/mailinglists/ From: Arvind Sharma Sent: Monday, May 15, 2017 12:00:33 AM To: user@drill.apache.org Subject: Not Able to suscribe

Not Able to suscribe

2017-05-15 Thread Arvind Sharma

Drill embedded mode

2017-05-15 Thread Selvarajan Thangavel
Hi, We have installed drill in embedded mode on our Linux server to query some of our csv files and produce json data via rest api(8047) to our web application. When I run the command "./drill-embedded" the drill service started and the rest api service is getting connected and all looks good. B