Re: Slow download of segments from deep storage

2019-02-18 Thread Samarth Jain
I have created an issue https://github.com/apache/incubator-druid/issues/7068 that outlines the limitations in current approach which prevents us from parallelizing the segment load/drop workload. Also have raised a PR https://github.com/apache/incubator-druid/pull/7088 to help address it. On

Re: docker build

2019-02-18 Thread Gaurav Bhatnagar
I have been thinking if automated scripts can be provided to end users in Druid for "Additional Dependencies" for user initiated installation and configuration of optional dependencies to avoid licensing issues. Later these scripts can be integrated in admin UI as configuration wizards. On Mon,

Re: docker build

2019-02-18 Thread Don Bowman
reading that link its not clear that mysql is the only concern given that bash et al is present. but druid is written such that it requires bash (all the run-scripts are bash-specific, not sh). i guess i'll wait a bit to see what happens. On Mon, 18 Feb 2019 at 17:03, Gian Merlino wrote: > I

Re: docker build

2019-02-18 Thread Gian Merlino
I think people definitely do want it, but since the connector is GPL and GPL is Category X, we need to dot our i's and cross our t's when considering whether / how to include it. Removing it pending the completion of that discussion is definitely the path of least resistance. On Mon, Feb 18, 2019

Re: docker build

2019-02-18 Thread Don Bowman
i can just remove the mysql, the postgres works, i was just assuming folks wanted it. On Mon, 18 Feb 2019 at 16:58, Gian Merlino wrote: > A discussion is progressing on > https://issues.apache.org/jira/browse/LEGAL-437. It doesn't seem to have > got anywhere firm yet. > > On Fri, Feb 8, 2019

Re: docker build

2019-02-18 Thread Gian Merlino
A discussion is progressing on https://issues.apache.org/jira/browse/LEGAL-437. It doesn't seem to have got anywhere firm yet. On Fri, Feb 8, 2019 at 12:23 PM Gian Merlino wrote: > I don't think anything is strictly needed from you at this point, but > things happen when people drive them, and

Re: Use add support for using dropwizard metrics

2019-02-18 Thread Gian Merlino
The only caveat I could think of is whether/how it would integrate with the existing metrics emitter system (Emitter, ServiceEmitter, LoggingEmitter, & friends). I am not too familiar with Dropwizard so I don't have much to say about how the integration could work. On Thu, Feb 14, 2019 at 1:15 PM

Re: Knowledge sharing between Druid developers via technical talks

2019-02-18 Thread Gian Merlino
I am interested especially if the format is something live. An in-person meetup with a recording distributed afterwards would be my preference, if people are into that. Maybe something at one of the Druid meetups? On Wed, Feb 13, 2019 at 8:38 PM Eyal Yurman wrote: > Hi, > > This is something

Online aggregation / Interactive Query Session Protocol

2019-02-18 Thread Roman Leventov
Dusting off an idea from several years ago: https://github.com/apache/incubator-druid/issues/7087