Re: MongoDB Question

Hi Charles, As this is a system/session level property, so, not sure if we can set as part of storage plugin configuration. One option seems to be overriding in $DRILL_HOME/conf/drill-env.sh https://drill.apache.org/docs/configuration-options-introduction/ Thanks & Regards, B Anil Kumar. On

Re: [ANNOUNCE] New Committer: Hanumath Rao Maduri

Congratulations Hanumath. Thanks & Regards, B Anil Kumar. On Thu, Nov 1, 2018 at 9:39 AM Vitalii Diravka wrote: > Congratulations! > > Kind regards > Vitalii > > > On Thu, Nov 1, 2018 at 5:43 PM salim achouche > wrote: > > > Congrats Hanu! > > > > On Thu, Nov 1, 2018 at 6:05 AM Arina

Re: Cassandra storage plugin

Hi Matt, >> I note there are some old Jira issues about Cassandra storage, and have this concept as to why it could be very valuable for Drill. Can anyone support or refute the idea? I agree, this will be a very valuable feature for Drill. >> Cassandra is an excellent engine for high volume

Re: Can Apache Drill perform streaming queries?

o change partition values to minimize the > scans right? > > Also I guess I can build some notification mechanism in case if my older > partitions have an update. > > Thanks! > > > > > On Thu, Nov 9, 2017 at 11:58 AM, AnilKumar B <akumarb2...@gmail.com> > wr

Re: Can Apache Drill perform streaming queries?

Hi Kant, If I understand your questions properly, you are looking for incremental queries. Drill supports predicates pushed down with most of the Data sources. In your case, suppose you are generating hourly partitions in HDFS using Spark aplication. Then Drill is optmized to scan specific

Re: Execute Mongo functions through Drill

Hi, Seems Drill already has geospatial query support https://issues.apache.org/jira/browse/DRILL-3914. Can you please take a look into https://github.com/k255/drill-gis and https://github.com/k255/drill-gis/blob/master/src/main/java/org/apache/drill/exec/expr/fn/impl/gis/STIntersects.java

Re: [MongoDB] How does drill aggregate data

Hi Andy, Please find the answer inline. Then, i have 2 thinking on this: 1. Drill will use aggregate from MongoDB's api to do GROUP BY >> Currently Drill's mongo plugin will not push down group by operator to mongo DB. 2. Drill will filter data ( find from Mongo API) then it will do aggregation

Re: Querying Streaming Data using Drill

Hi Padma & Chetan, Just wanted to update on https://issues.apache.org/jira/browse/DRILL-4779 We have developed and tested kafka integration and currently it's working for JSON messages. And currently we are working on test cases and Avro support. We are planning to present this on Sept 18th

Re: How could I get _id from MongoDB?

Hi Dana, Please take look into following JIRA for _id issue which you have asked. https://issues.apache.org/jira/browse/DRILL-4307 Thanks & Regards, B Anil Kumar. On Wed, Dec 7, 2016 at 11:15 PM, yousuf wrote: > try this > > set store.mongo.bson.record.reader =

Re: Suggestions for hangout topics for 06/14

Hi Aman, Shall we consider cassandra plugin discussion? As most of the users are interested in it. Seems most of the work is already done, but seems final review comments are pending on it. Thanks & Regards, B Anil Kumar. On Mon, Jun 13, 2016 at 11:00 AM, Aman Sinha

Re: How to connect to mongodb over SSL

Hi, Can you once try with below configuration? { type: mongo, connection: mongodb://drill_check:check@serverhost:27017/?ssl=true, enabled: true } Thanks Regards, B Anil Kumar. On Sat, Jul 11, 2015 at 4:13 AM, Trang T. M. TRUONG ttmtr...@gmail.com wrote: Hi, I'm learning how to use

Re: Drill and ElasticSearch support?

Hi Virin, As of now, Drill doesn't support Elastic Search. If you are interested in contributing to Drill, then you are most welcome. You can take reference of storage plugins like HBase/Mongo/Hive etc. Thanks Regards, B Anil Kumar. On Thu, May 21, 2015 at 9:09 PM, Virinchi Garimella

Re: Mongo query speed

Thanks for pointing this issue. We agree that BSON - JSON String - Drill Vector conversion could be a potential performance issue. When we started implementing mongo storage plugin, we thought of reusing JSON Reader rather than implementing parsing BSON. We will soon start working on BSON Record