Hi Padma & Chetan, Just wanted to update on https://issues.apache.org/jira/browse/DRILL-4779
We have developed and tested kafka integration and currently it's working for JSON messages. And currently we are working on test cases and Avro support. We are planning to present this on Sept 18th Drill Developer's day. Due to multiple reasons, this feature delayed from long time, but we are almost there. Repo: https://github.com/akumarb2010/incubator-drill/tree/master/contrib/storage-kafka Thanks & Regards, B Anil Kumar. On Tue, Aug 29, 2017 at 10:26 AM, Chetan Kothari <[email protected]> wrote: > Thanks Padma for quick response. > > > > This will be very critical feature to support in Drill as user will look > for > > single SQL Engine which supports querying both batch and streaming data. > > > > Any inputs on when support for querying streaming data will be supported? > > > > Regards > > Chetan > > > > -----Original Message----- > From: Padma Penumarthy [mailto:[email protected]] > Sent: Tuesday, August 29, 2017 10:53 PM > To: [email protected] > Subject: Re: Querying Streaming Data using Drill > > > > Currently, we do not have support for these storage plugins. > > I see an open JIRA for Kafka, not sure how much progress was made (as last > update was a while back). > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues. > apache.org_jira_browse_DRILL-2D4779&d=DwIFAg&c= > RoP1YumCXCgaWHvlZYR8PQcxBKCX5YTpkKY057SbK10&r=XdafK486- > x96ZJoTcDF35EpcYc2j9nO0sbpt27_VGCg&m=bHLm9AOBdeCey8wjxCKXHxHTwlpzXu > JF3dhrqs-qX-0&s=UCGsbhOa9QLDAmUEfJYiq_cOfGg5dUi1RdcPB7YTMMQ&e= > > > > Thanks, > > Padma > > > > > > On Aug 29, 2017, at 10:14 AM, Chetan Kothari <HYPERLINK "mailto: > [email protected]%3cmailto:[email protected]"; > [email protected]<mailto:[email protected]>> wrote: > > > > Is there any support for querying streaming data using Drill? > > > > Presto provides out-of-box Kafka and Amazon Kinesis Connectors for > querying streaming data. > > > > > > > > Regards > > > > Chetan > > > > >
