Re: Implementing TinkerPop on top of GraphX

phs >>> and >>> > think the idea of using Tinkerpop as the API for GraphX is a great >>> idea and >>> > hope you are still headed in that direction. I noticed that Tinkerpop >>> 3 is >>> > moving into the Apache family: >>> > http

Re: Implementing TinkerPop on top of GraphX

aphs and >> > think the idea of using Tinkerpop as the API for GraphX is a great idea >> and >> > hope you are still headed in that direction. I noticed that Tinkerpop >> 3 is >> > moving into the Apache family: >> > http://wiki.apache.org/incubator/TinkerPopPropos

Re: Implementing TinkerPop on top of GraphX

ut having an API definition "outside" of Spark. > > > > Thanks, > > > > > > > > > > -- > > View this message in context: > > > http://apache-spark-developers-list.1001551.n3.nabble.com/Implementing-TinkerPop-on-top-of-GraphX-tp9169p10126.html

Re: Implementing TinkerPop on top of GraphX

aving an API definition "outside" of Spark. > > Thanks, > > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/Implementing-TinkerPop-on-top-of-GraphX-tp9169p10126.html > Sent from the Ap

Re: Implementing TinkerPop on top of GraphX

/TinkerPopProposal which might alleviate concerns about having an API definition "outside" of Spark. Thanks, -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Implementing-TinkerPop-on-top-of-GraphX-tp9169p10126.html Sent from the Apache Spark Devel

Re: Implementing TinkerPop on top of GraphX

into the Spark >>>>>> ecosystem. >>>>>> * TinkerPop can continue to maintain and own a solid / feature-rich >>>>>> graph API that has already been accepted by a wide audience, relieving >>>>>> the >>>>>> pre

Re: Implementing TinkerPop on top of GraphX

;>> * GraphX can demonstrate its ability to be a key player in the GraphDB >>>>> space sitting inline with other major distributions (Neo4j, Titan, etc.). >>>>> * Allows for the abstract graph traversal logic (query API) to be >>>>> owned and maintained

Re: Implementing TinkerPop on top of GraphX

t;>>> * GraphX doesn’t own the API for its graph query capability. This could >>>> be seen as good or bad, but it might make GraphX-specific implementation >>>> additions more tricky (possibly). Also, GraphX will need to maintain the >>>> features described w

Re: Implementing TinkerPop on top of GraphX

om>>, "dev@spark.apache.org<mailto:dev@spark.apache.org>" mailto:dev@spark.apache.org>>, Matthias Broecheler mailto:matth...@thinkaurelius.com>> Subject: Re: Implementing TinkerPop on top of GraphX Who here would be interested in helping to work on an implementat

Re: Implementing TinkerPop on top of GraphX

re tricky (possibly). Also, GraphX will need to maintain the >>> features described within the TinkerPop API as that might change in the >>> future. >>> >>> From: Kushal Datta >>> Date: Thursday, November 6, 2014 at 4:00 PM >>> To: "York, Brenn

Re: Implementing TinkerPop on top of GraphX

ge in the >> future. >> >> From: Kushal Datta >> Date: Thursday, November 6, 2014 at 4:00 PM >> To: "York, Brennon" >> Cc: Kyle Ellrott , Reynold Xin < >> r...@databricks.com>, "dev@spark.apache.org" , >> Matthias Broecheler >&

Re: Implementing TinkerPop on top of GraphX

tain the > features described within the TinkerPop API as that might change in the > future. > > From: Kushal Datta > Date: Thursday, November 6, 2014 at 4:00 PM > To: "York, Brennon" > Cc: Kyle Ellrott , Reynold Xin , > "dev@spark.apache.org" , Matth

Re: Implementing TinkerPop on top of GraphX

.apache.org<mailto:dev@spark.apache.org>" mailto:dev@spark.apache.org>>, Matthias Broecheler mailto:matth...@thinkaurelius.com>> Subject: Re: Implementing TinkerPop on top of GraphX Before we dive into the implementation details, what are the high level thoughts on Gremlin/Grap

Re: Implementing TinkerPop on top of GraphX

Ellrott > Date: Thursday, November 6, 2014 at 12:10 PM > To: Kushal Datta > Cc: Reynold Xin , "York, Brennon" < > brennon.y...@capitalone.com>, "dev@spark.apache.org" , > Matthias Broecheler > Subject: Re: Implementing TinkerPop on top of GraphX > &g

Re: Implementing TinkerPop on top of GraphX

; > brennon.y...@capitalone.com>, "dev@spark.apache.org" , > Matthias Broecheler > Subject: Re: Implementing TinkerPop on top of GraphX > > I still have to dig into the Tinkerpop3 internals (I started my work long > before it had been released), but I can say that to get the Ti

Re: Implementing TinkerPop on top of GraphX

ennon.y...@capitalone.com>>, "dev@spark.apache.org<mailto:dev@spark.apache.org>" mailto:dev@spark.apache.org>>, Matthias Broecheler mailto:matth...@thinkaurelius.com>> Subject: Re: Implementing TinkerPop on top of GraphX I still have to dig into the Tinkerpop3 internals (I st

Re: Implementing TinkerPop on top of GraphX

I still have to dig into the Tinkerpop3 internals (I started my work long before it had been released), but I can say that to get the Tinerpop2 Gremlin pipeline to work in the GraphX was a bit of a hack. The whole Tinkerpop2 Gremlin design was based around streaming pipes of data, rather then large

Re: Implementing TinkerPop on top of GraphX

Great stuffs! I've got some thoughts about that, and I was wondering if it would be first interesting to have something like for spark-core (let's say): 0/ Core API offering basic (or advanced → HeLP) primitives 1/ catalyst optimizer for a text base system (SPARQL, Cypher, custom SQL3, whatnot) 2/

Re: Implementing TinkerPop on top of GraphX

What do you guys think about the Tinkerpop3 Gremlin interface? It has MapReduce to run Gremlin operators in a distributed manner and Giraph to execute vertex programs. The Tinkpop3 is better suited for GraphX. On Thu, Nov 6, 2014 at 11:48 AM, Kyle Ellrott wrote: > I've taken a crack at implemen

Re: Implementing TinkerPop on top of GraphX

I've taken a crack at implementing the TinkerPop Blueprints API in GraphX ( https://github.com/kellrott/sparkgraph ). I've also implemented portions of the Gremlin Search Language and a Parquet based graph store. I've been working out finalize some code details and putting together better code exam

Re: Implementing TinkerPop on top of GraphX

cc Matthias In the past we talked with Matthias and there were some discussions about this. On Thu, Nov 6, 2014 at 11:34 AM, York, Brennon wrote: > All, was wondering if there had been any discussion around this topic yet? > TinkerPop is a great abstraction for gr

Implementing TinkerPop on top of GraphX

All, was wondering if there had been any discussion around this topic yet? TinkerPop is a great abstraction for graph databases and has been implemented across various graph database backends / gaining traction. Has anyone thought about integrating the TinkerPop frame