Hi Jacques, I think we can best answer that together. I didn't yet dive into all the details of Drill, but from a high level it seems that we could maybe provide connectivity to a wide set of databases and file formats, which you could leverage. The query syntax for all MetaModel connectors is exactly the same, only the schema/table model may differ. But that means to me that if you plug in one connector, you probably have them all. The main complication as I see it is how to mediate the Drill queries to MetaModel queries. Your query language seems to be richer than MetaModel's, containing more functions and operators. So how can we best ensure that the maximum amount of the query gets passed on to MetaModel, without passing on stuff that MetaModel wouldn't support.
Best regards, Kasper 2015-09-30 13:43 GMT+02:00 Jacques Nadeau <jacq...@dremio.com>: > I think I can speak for everyone here that the Drill community is also > interested in working with other projects, especially Apache products. > There definitely seems to be some overlap. When we discussed this on the > list here a couple weeks ago, I think the question was what would be a good > first step. Do you have any ideas on that front? > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Wed, Sep 30, 2015 at 6:57 AM, Kasper Sørensen < > i.am.kasper.soren...@gmail.com> wrote: > > > Hi guys, > > > > I'm PMC of Apache MetaModel and was just watching Tugdual Grall's talk > here > > at Apache: Big Data Europe. I have the feeling that we should try to work > > together, or at least explore some cooperation, since the way I see it > > there's a big overlap with what MetaModel tries to archieve and what > Drill. > > And some differences of course. It seems MetaModel is "metadata first" > > while Drill allows for a lot more dynamic querying capabilities. > > > > Either way, some way of integrating the two projects would be very > > interesting I think. I'm very open for helping out and giving my input. > > > > Someone noticed the lower activity-level we have. Yes, MetaModel isn't > the > > biggest project. Basically this conference (Apache: Big Data) is the > first > > "PR move" we ever did. I did get a lot of interesting feedback from my > talk > > here and I expect that we will attract more people as the word spreads. > > Integrating with other projects such as Drill is also instrumental for us > > in doing that, obviously. The other reason might be that Apache MetaModel > > actually has a pretty long history already, first being founded in > > 2010-2011 outside of Apache, it's certainly already quite mature and is > > powering both other open source products (such as DataCleaner) and > > commercial ones (Stratio Datavis, Human Inference DataHub). Probably more > > that I don't know of. > > > > Anyways... Hope you guys might be interested to do some experimentation > > here. I think both projects could benefit. > > > > Best regards, > > Kasper Sørensen > > >
