Re: avro in HBase columns?

Hi, DRILL-1512 only works for reading Avro files off a filesystem such as HDFS. As far as I know the convert_from() function only supports JSON at the moment. Hope that helps. - Andrew > On May 29, 2015, at 10:16 AM, Vince Gonzalez wrote: > > Does Drill have any support for Avro

Re: drill java code for adding a new storage plugin

I was able to write a storage plugin by looking at the code for mongo, hive, and hbase in the contrib directory. Start by implementing AbstractStoragePlugin and StoragePluginConfigBase. > On Jul 9, 2015, at 11:22 PM, HAFIZ MUJADID KHALID > wrote: > > Hi all! > > I am new to drill and I wa

Re: drill java code for adding a new storage plugin

I was able to write a storage plugin by looking at the code for mongo, hive, and hbase in the contrib directory. Start by implementing AbstractStoragePlugin and StoragePluginConfigBase. > On Jul 9, 2015, at 11:22 PM, HAFIZ MUJADID KHALID > wrote: > > Hi all! > > I am new to drill and I wa

Re: drill java code for adding a new storage plugin

I was able to write a storage plugin by looking at the code for mongo, hive, and hbase in the contrib directory. Start by implementing AbstractStoragePlugin and StoragePluginConfigBase. > On Jul 9, 2015, at 11:22 PM, HAFIZ MUJADID KHALID > wrote: > > Hi all! > > I am new to drill and I wa

Re: Various ramblings of a newbie

Hi, Thanks for this list. I think it would be helpful if you could create some JIRA tickets around these bugs at https://issues.apache.org/jira/browse/DRILL/ . It’s easier to track issues that way than by email. - A > On Jul 11, 2015, at 11:40 AM

Re: UnsupportedOperationException: Unimplemented type: UNION

If you go to the review board, you can download the patch: https://reviews.apache.org/r/36187/ . Use the ‘Download Diff’ button. Once you have the diff you can use git to patch it in to master, assuming you’ve got the source. Note that this patch is schedul

Re: JDBC driver for MySQL - storage plugin config and push down ?

source. The second issue is that the bootstrap-storage-plugins.json provided is wrong. I’ll send a note to the list once I’ve published a PR. - Andrew > On Oct 6, 2015, at 9:09 AM, Ulf Andreasson @ MapR > wrote: > > Jacques et al, > > CP includes /usr/share/java/mysql-connect

RE: Announcing new committer: Ellen Friedman

Excellent news! -Original Message- From: Jacques Nadeau [mailto:jacq...@apache.org] Sent: Sunday, November 22, 2015 7:38 PM To: d...@drill.apache.org; user@drill.apache.org Subject: Announcing new committer: Ellen Friedman The Apache Drill PMC is very pleased to announce Ellen Friedman a

Apache Drill, Query PostgreSQL text or Jsonb as if it were from a json storage type?

"12", "events": {"event": [{"date": "08/06/2014", "type": "Request: Action", "comment": "900125-Request for Action \n Filed/Issued By"}}} Thank you for your time, Andrew Evans Java/Scala/Python Programmer at Hygenics Data,LLC

RE: Apache Drill, Query PostgreSQL text or Jsonb as if it were from a json storage type?

of a set of JSON objects, but you would have to declare the types in the call. On 25 May 2016, at 12:26, Andrew Evans wrote: > Drill Members, > > I have an intriguing problem where I have hundreds of thousands or > even millions of records stored in jsonb format in uneven JSon ob

One more with Excepting Columns by name

method. I really want to avoid anything manual. I am looking for something like: SELECT flatten(filter_not(record[column],array['col1','col2'])) FROM table All help is greatly appreciated. Thanks, Andrew Evans

RE: One more with Excepting Columns by name

stem would be great. Thanks for the help. The tool is really beneficial in lowering maintenance time costs for ETL. -Andrew Evans From: Andries Engelbrecht [aengelbre...@maprtech.com] Sent: Wednesday, May 25, 2016 3:47 PM To: user@drill.apache.org Subject: Re

RE: One more with Excepting Columns by name

Thu, May 26, 2016 at 4:09 PM, Andrew Evans wrote: > I ended up with this. I just don't know why some things don't exist. Some, > I think are new but others such as being able to read strings as json from > a database would be really helpful. Being able to read in Json, Hst

RE: We're now a TLP

I wrote up Drill's TLP graduation for my weekly review on the Gigaom research Blog. It will go up at 6am Pacific. Watch for my tweet or keep an eye on : http://research.gigaom.com/ (under Analyst Blog, below the fold) Spoiler: it's rather supportive of your efforts :-) -Original Message--

RE: We're now a TLP

e.org; drill-...@incubator.apache.org Subject: Re: We're now a TLP A!!we!!some!! That's great achievement On 3 Dec 2014 16:13, "AnilKumar B" wrote: > Awesome. Great news. > > Congrats to everyone. > > Thanks & Regards, > B Anil Kumar. > > On Wed

RE: Which [open-souce] SQL engine atop Hadoop?

Not sure Drill -- or any of the other SQL-on-Hadoop engines -- are truly well-suited to CRUD. They excel at the "R" -- the "CUD" is not their forte. -Original Message- From: Samuel Marks [mailto:samuelma...@gmail.com] Sent: Friday, January 30, 2015 8:50 AM To: user@drill.apache.org Subj

Re: Which [open-souce] SQL engine atop Hadoop?

It's designed for data discovery/analytical use. Not CRUD/operational applications. Sent from my phone - Reply message - From: "Samuel Marks" To: "user@drill.apache.org" Subject: Which [open-souce] SQL engine atop Hadoop? Date: Fri, Jan 30, 2015 8:59 PM Thank

RE: Drill In the Enterprise

I have no wisdom to share, but I am also very interested in the topic and hope others can advise. I think it's really a key question for Drill -- and even for Big Data and the Data Lake architecture. -Original Message- From: John Omernik [mailto:j...@omernik.com] Sent: Tuesday, April 2

RE: what's the differenct between drill and optiq

Folks at Hortonworks told me that Hive now uses Calcite as well. Can anyone here confirm or deny that? -Original Message- From: Rajkumar Singh [mailto:rsi...@maprtech.com] Sent: Wednesday, May 27, 2015 6:52 AM To: user@drill.apache.org Subject: Re: what's the differenct between drill an

Re: what's the differenct between drill and optiq

Thanks! Sent from my phone - Reply message - From: "PHANI KUMAR YADAVILLI" To: "user@drill.apache.org" Subject: what's the differenct between drill and optiq Date: Wed, May 27, 2015 8:33 AM Yes hive uses calcite. You can refer hive documentation. On May

RE: what's the differenct between drill and optiq

AM To: user@drill.apache.org Subject: Re: what's the differenct between drill and optiq Andrew, What Hive does not have is the extensions that Drill has that allow SQL to be type flexible. The ALL type and all of the implications both in terms of implementation and user impact it has are a

RE: what's the differenct between drill and optiq

t between drill and optiq Calcite does parsing & planning of queries. Drill executes in a very flexible distributed columnar fashion with late binding. On Wed, May 27, 2015 at 8:34 AM, Ted Dunning wrote: > Andrew, > > What Hive does not have is the extensions that Drill has

RE: what's the differenct between drill and optiq

binding functionality. -Original Message- From: Ted Dunning [mailto:ted.dunn...@gmail.com] Sent: Thursday, May 28, 2015 1:10 AM To: user@drill.apache.org Subject: Re: what's the differenct between drill and optiq Andrew, Sorry for being cryptic. Hanifi is more clear. My point was d

RE: what's the differenct between drill and optiq

tween drill and optiq Andrew, As others have pointed out there are definitely differences in how each different community project leverages Calcite (remember, Apache Kylin, Phoenix and I believe Flink also use it). Remember, Calcite--at its core--is a developers toolkit that other applications/sy

Re: Drill not picking up a UDF

Hi, all. I’m just a fly on the wall here, as usual. This was an interesting thread to follow. Two observations: 1. It seems to me like Drill is at a point where, if you thread the needle perfectly, things generally work as advertised. That’s certainly an advance over the old, old days, wher

Re: Drill not picking up a UDF

I think you should include that text verbatim, in the docs. Very helpful to developing an instinct for writing UDFs that work. And if I can understand it (and I do), then I would think most good Java devs will too. On 7/20/15, 11:15 AM, "Jacques Nadeau" wrote: >Hey Stefan, > >Can you prop

Re: Drill not picking up a UDF

(Heh, sorry, guess that was *five* observations :-) ) On 7/20/15, 11:22 AM, "Andrew Brust" wrote: >Hi, all. I’m just a fly on the wall here, as usual. This was an interesting >thread to follow. Two observations: > >1. It seems to me like Drill is at a point wh

Re: Drill not picking up a UDF

Yes, agreed. Fair point and apologies for not articulating same in my comment. On 7/20/15, 4:10 PM, "Ted Dunning" wrote: >On Mon, Jul 20, 2015 at 8:22 AM, Andrew Brust < >andrew.br...@bluebadgeinsights.com> wrote: > >> 1. It seems to me like Drill is at a

RE: Benchmarks for Apache Drill

I have to admit, I didn't realize columnar was such a big part of Drill. I guess that's consistent with Dremel, so it makes sense. I always thought the emphasis was on heterogenous data access, not on perf. Cool! So with that in mind, does drill do much with vector processing/SIMD operation?

RE: Benchmarks for Apache Drill

Sun, Aug 16, 2015 at 10:22 PM, Andrew Brust < andrew.br...@bluebadgeinsights.com> wrote: > I have to admit, I didn't realize columnar was such a big part of Drill. > I guess that's consistent with Dremel, so it makes sense. I always > thought the emphasis was on heterog

RE: Benchmarks for Apache Drill

mapr-demos/simple-drill-functions On Sun, Aug 16, 2015 at 11:06 PM, Andrew Brust < andrew.br...@bluebadgeinsights.com> wrote: > >> the unusual code-embedding UDF system that Drill has << > Have a good link where I could read more about that? > > -Original Message--

Re: JDBC driver for MySQL - storage plugin config and push down ?

There are 2 issues with the latest build that make the JDBC storage plugin unusable. I will be publishing a fix for both later today. The first issue is that the assembly phase wasn’t including the drill-module.conf for the JDBC plugin, so you could never actually register a JDBC source. The s

RE: MapR Drill 1.2 Package

MapR Ships Apache Drill 1.2 in its Distribution Launches new Quick Start Solution for self-service data exploration San Jose, CA, – October 21, 2015 – MapR Technologies, Inc., provider of the top-ranked distribution for Apache™ Hadoop® that integrates web-scale enterprise storage and real-ti

How to force Drill to offload performing LIMIT onto the target storage?

onder - is it possible to tune Drill somehow to perform limit/group-by using the storage capabilities (Impala in my case)? Or if such optimization is something do be developed - is it absent only for JDBC connections or for all storage types? -- With kind regards, Andrew Pashkin. cell phone - +375 (