Re: Apache MetaModel - an interesting future integration target

[Kasper Sørensen]

Hi Jacques,

I think we can best answer that together. I didn't yet dive into all the
details of Drill, but from a high level it seems that we could maybe
provide connectivity to a wide set of databases and file formats, which you
could leverage. The query syntax for all MetaModel connectors is exactly
the same, only the schema/table model may differ. But that means to me that
if you plug in one connector, you probably have them all. The main
complication as I see it is how to mediate the Drill queries to MetaModel
queries. Your query language seems to be richer than MetaModel's,
containing more functions and operators. So how can we best ensure that the
maximum amount of the query gets passed on to MetaModel, without passing on
stuff that MetaModel wouldn't support.

Best regards,
Kasper

2015-09-30 13:43 GMT+02:00 Jacques Nadeau :

> I think I can speak for everyone here that the Drill community is also
> interested in working with other projects, especially Apache products.
> There definitely seems to be some overlap. When we discussed this on the
> list here a couple weeks ago, I think the question was what would be a good
> first step. Do you have any ideas on that front?
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Wed, Sep 30, 2015 at 6:57 AM, Kasper Sørensen <
> i.am.kasper.soren...@gmail.com> wrote:
>
> > Hi guys,
> >
> > I'm PMC of Apache MetaModel and was just watching Tugdual Grall's talk
> here
> > at Apache: Big Data Europe. I have the feeling that we should try to work
> > together, or at least explore some cooperation, since the way I see it
> > there's a big overlap with what MetaModel tries to archieve and what
> Drill.
> > And some differences of course. It seems MetaModel is "metadata first"
> > while Drill allows for a lot more dynamic querying capabilities.
> >
> > Either way, some way of integrating the two projects would be very
> > interesting I think. I'm very open for helping out and giving my input.
> >
> > Someone noticed the lower activity-level we have. Yes, MetaModel isn't
> the
> > biggest project. Basically this conference (Apache: Big Data) is the
> first
> > "PR move" we ever did. I did get a lot of interesting feedback from my
> talk
> > here and I expect that we will attract more people as the word spreads.
> > Integrating with other projects such as Drill is also instrumental for us
> > in doing that, obviously. The other reason might be that Apache MetaModel
> > actually has a pretty long history already, first being founded in
> > 2010-2011 outside of Apache, it's certainly already quite mature and is
> > powering both other open source products (such as DataCleaner) and
> > commercial ones (Stratio Datavis, Human Inference DataHub). Probably more
> > that I don't know of.
> >
> > Anyways... Hope you guys might be interested to do some experimentation
> > here. I think both projects could benefit.
> >
> > Best regards,
> > Kasper Sørensen
> >
>

Re: Apache MetaModel - an interesting future integration target

[Jacques Nadeau]

I think I can speak for everyone here that the Drill community is also
interested in working with other projects, especially Apache products.
There definitely seems to be some overlap. When we discussed this on the
list here a couple weeks ago, I think the question was what would be a good
first step. Do you have any ideas on that front?

--
Jacques Nadeau
CTO and Co-Founder, Dremio

On Wed, Sep 30, 2015 at 6:57 AM, Kasper Sørensen <
i.am.kasper.soren...@gmail.com> wrote:

> Hi guys,
>
> I'm PMC of Apache MetaModel and was just watching Tugdual Grall's talk here
> at Apache: Big Data Europe. I have the feeling that we should try to work
> together, or at least explore some cooperation, since the way I see it
> there's a big overlap with what MetaModel tries to archieve and what Drill.
> And some differences of course. It seems MetaModel is "metadata first"
> while Drill allows for a lot more dynamic querying capabilities.
>
> Either way, some way of integrating the two projects would be very
> interesting I think. I'm very open for helping out and giving my input.
>
> Someone noticed the lower activity-level we have. Yes, MetaModel isn't the
> biggest project. Basically this conference (Apache: Big Data) is the first
> "PR move" we ever did. I did get a lot of interesting feedback from my talk
> here and I expect that we will attract more people as the word spreads.
> Integrating with other projects such as Drill is also instrumental for us
> in doing that, obviously. The other reason might be that Apache MetaModel
> actually has a pretty long history already, first being founded in
> 2010-2011 outside of Apache, it's certainly already quite mature and is
> powering both other open source products (such as DataCleaner) and
> commercial ones (Stratio Datavis, Human Inference DataHub). Probably more
> that I don't know of.
>
> Anyways... Hope you guys might be interested to do some experimentation
> here. I think both projects could benefit.
>
> Best regards,
> Kasper Sørensen
>

Re: Apache MetaModel - an interesting future integration target

[Jim Scott]

I went reading through the site. Very interesting. Edmon, in case you
didn't notice, that project is  TLP at Apache as of Nov 2014.

Edmon, thanks a lot for pointing that project out. It looks pretty darn
compelling.

On Fri, Sep 18, 2015 at 10:04 PM, Edmon Begoli  wrote:

> Yeah, that was a bit of my concern. It looks also like a do-it-all
> solution. I'll keep it on eye.
>
> On Friday, September 18, 2015, Ted Dunning  wrote:
>
> > Could be useful. It doesn't look like a very active project. 9 issues
> > resolved in 30 days.
> >
> >
> >
> > On Fri, Sep 18, 2015 at 4:06 PM, Edmon Begoli  > > wrote:
> >
> > > I was researching today some options for non-traditional, broader MDM
> > > approach, and I ran into recently incubated Apache project called
> > > MetaModel:
> > >
> > > http://metamodel.apache.org/
> > >
> > > Is anyone familiar with it?
> > >
> > > It looks to me, architecturally, that there could be a possible Drill
> > 2.0+
> > > intersecting scenario where Drill could query MetaModel.
> > >
> >
>



-- 
*Jim Scott*
Director, Enterprise Strategy & Architecture
+1 (347) 746-9281
@kingmesal 


[image: MapR Technologies] 

Now Available - Free Hadoop On-Demand Training

Re: Apache MetaModel - an interesting future integration target

[Ted Dunning]

Could be useful. It doesn't look like a very active project. 9 issues
resolved in 30 days.



On Fri, Sep 18, 2015 at 4:06 PM, Edmon Begoli  wrote:

> I was researching today some options for non-traditional, broader MDM
> approach, and I ran into recently incubated Apache project called
> MetaModel:
>
> http://metamodel.apache.org/
>
> Is anyone familiar with it?
>
> It looks to me, architecturally, that there could be a possible Drill 2.0+
> intersecting scenario where Drill could query MetaModel.
>

Re: Apache MetaModel - an interesting future integration target

[Edmon Begoli]

Yeah, that was a bit of my concern. It looks also like a do-it-all
solution. I'll keep it on eye.

On Friday, September 18, 2015, Ted Dunning  wrote:

> Could be useful. It doesn't look like a very active project. 9 issues
> resolved in 30 days.
>
>
>
> On Fri, Sep 18, 2015 at 4:06 PM, Edmon Begoli  > wrote:
>
> > I was researching today some options for non-traditional, broader MDM
> > approach, and I ran into recently incubated Apache project called
> > MetaModel:
> >
> > http://metamodel.apache.org/
> >
> > Is anyone familiar with it?
> >
> > It looks to me, architecturally, that there could be a possible Drill
> 2.0+
> > intersecting scenario where Drill could query MetaModel.
> >
>

Apache MetaModel - an interesting future integration target

[Edmon Begoli]

I was researching today some options for non-traditional, broader MDM
approach, and I ran into recently incubated Apache project called MetaModel:

http://metamodel.apache.org/

Is anyone familiar with it?

It looks to me, architecturally, that there could be a possible Drill 2.0+
intersecting scenario where Drill could query MetaModel.