what's the differenct between drill and optiq

2015-05-27 Thread 陈礼剑
Hi: I just want to know the difference between drill and optiq. Is drill just 'extend' optiq to support many other 'stores'(hadoop, mongodb, ...)? ---from davy Thanks.

Re: JAVA API for Drill

2015-05-27 Thread Nishith Maheshwari
Thank you Martin and Rajkumar for your prompt responses. I am actually looking if some API is available which provides this functionality. In the documentation it is mentioned in : https://drill.apache.org/docs/architecture-introduction - *You can connect to Apache Drill through the following

Re: what's the differenct between drill and optiq

2015-05-27 Thread Rajkumar Singh
Optiq(now known as calcite) is an api for query parser,planner and optimization, drill uses it for the SQL parsing,validation and optimization.Drill query planner applies its own custom planner rules to build the query logical plan. Rajkumar Singh On May 27, 2015, at 12:04 PM, 陈礼剑

RE: what's the differenct between drill and optiq

2015-05-27 Thread PHANI KUMAR YADAVILLI
Yes hive uses calcite. You can refer hive documentation. On May 27, 2015 6:01 PM, Andrew Brust andrew.br...@bluebadgeinsights.com wrote: Folks at Hortonworks told me that Hive now uses Calcite as well. Can anyone here confirm or deny that? -Original Message- From: Rajkumar Singh

RE: what's the differenct between drill and optiq

2015-05-27 Thread Andrew Brust
Folks at Hortonworks told me that Hive now uses Calcite as well. Can anyone here confirm or deny that? -Original Message- From: Rajkumar Singh [mailto:rsi...@maprtech.com] Sent: Wednesday, May 27, 2015 6:52 AM To: user@drill.apache.org Subject: Re: what's the differenct between drill

Re: Query local files on cluster? [Beginner]

2015-05-27 Thread Matt
Drill can process a lot of data quickly, and for best performance and consistency you will likely find that the sooner you get the data to the DFS the better. Already most of the way there. Initial confusion came from the features to query the local / native filesystem, and how that does not

Re: what's the differenct between drill and optiq

2015-05-27 Thread Ted Dunning
Andrew, What Hive does not have is the extensions that Drill has that allow SQL to be type flexible. The ALL type and all of the implications both in terms of implementation and user impact it has are a really big deal. On Wed, May 27, 2015 at 6:08 AM, Andrew Brust

Re: what's the differenct between drill and optiq

2015-05-27 Thread Hanifi Gunes
Calcite does parsing planning of queries. Drill executes in a very flexible distributed columnar fashion with late binding. On Wed, May 27, 2015 at 8:34 AM, Ted Dunning ted.dunn...@gmail.com wrote: Andrew, What Hive does not have is the extensions that Drill has that allow SQL to be type

AW: JAVA API for Drill

2015-05-27 Thread MOIS Martin (MORPHO)
Hi, you can use the JDBC driver shipped with the distribution, to execute SQL queries against an HBase database: String className = org.apache.drill.jdbc.Driver; try { Class.forName(className); } catch (ClassNotFoundException e) { System.err.println(Failed to load JDBC driver '

RE: what's the differenct between drill and optiq

2015-05-27 Thread Andrew Brust
That makes sense. Just having trouble mapping that back on Ted's comment. But I tend to think that's me and my ignorance. -Original Message- From: Hanifi Gunes [mailto:hgu...@maprtech.com] Sent: Wednesday, May 27, 2015 4:48 PM To: user Subject: Re: what's the differenct between drill

Re: what's the differenct between drill and optiq

2015-05-27 Thread Jacques Nadeau
Andrew, As others have pointed out there are definitely differences in how each different community project leverages Calcite (remember, Apache Kylin, Phoenix and I believe Flink also use it). Remember, Calcite--at its core--is a developers toolkit that other applications/systems incorporate.

Re: what's the differenct between drill and optiq

2015-05-27 Thread Ted Dunning
Andrew, Sorry for being cryptic. Hanifi is more clear. My point was directed at the differences between where Hive may ultimately go and where Drill is now. Hanifi was providing a good summary of where Drill is now. As he said, Calcite does query parsing and planning. Ultimately, it will do

Re: what's the differenct between drill and optiq

2015-05-27 Thread Jinfeng Ni
Besides the different optimization rule sets and cost model (Calcite is very extensive in that sense) used by Hive and Drill, I see the following difference of the way how Calcite is used in these two systems. 1. Drill supports query against schema-less storage (text, JSON etc). For Hive or