Hello everyone,
It seems unanimous that people want Hadoop2. Regardless, the VOTE was basically
closed in my mind after Danny Quest voted.
http://vignette3.wikia.nocookie.net/p__/images/2/2d/Jonny_quest-show.jpg/revision/latest?cb=20120316162151&path-prefix=protagonist
But whatever… if it makes you feel better that your vote mattered, sure.
TinkerPop3 master/ now supports the following:
Apache Hadoop 2.7.1 (up from 1.2.1)
Apache Giraph 1.1.0 (up from 1.0.0)
Apache Spark 1.5.0 (up from 1.2.1)
There is one integration test failing in Giraph (around sorted MapReduce
output) and I haven't written up the docs (need to work with Daniel on this).
But all in all, TinkerPop 3.1.0 (when released) will have support for the
versions above. I suspect over the remainder of today and tomorrow all the
bumps will be sorted out, docs written, and full integration test suite passing.
Thanks for your input Danny Quest (aka. my hero),
Marko.
http://markorodriguez.com
On Sep 10, 2015, at 11:44 AM, Tim Dunlevy <[email protected]> wrote:
> +1
>
> On Wednesday, September 9, 2015 at 12:44:46 PM UTC-4, Marko A. Rodriguez
> wrote:
> Hello everyone,
>
> I decided to make this its own thread as opposed to a discussion off a TP3
> Hadoop question from Don Dra(p)e(r).
>
> TinkerPop is not interested in maintaining numerous connectors to various
> vendors (and their various versions). After TP2, we decided that vendors will
> maintain their own connectors to TP3. TP3 would only provide 3 "reference
> implementations" -- TinkerGraph (POJO in-memory OLTP and OLAP), Neo4j (OLTP),
> and Hadoop (OLAP -- Giraph/Spark).
>
> Currently we only support Hadoop1 in TP3. However, there is good reason to
> support Hadoop2.
>
> 1. SparkServer works inside YARN.
> 2. All the major Hadoop distributions (Cloudera, Hortonworks, etc.) are
> using Hadoop2.
> 3. Hadoop2 is newer than Hadoop1.
>
> I am more than happy to bump TP3 support to Hadoop2, but am not willing to
> support both Hadoop1 and Hadoop2 (as that means we will then have
> Giraph1/Giraph2, Spark1/Spark2, etc.). With that, can people reply to this
> email with:
>
> +1 (please have TP 3.1.0 support Hadoop2)
> -1 (please have TP 3.1.0 support Hadoop1) [keep it the same]
>
> If you wish to provide a comment with your +1/-1, please do.
>
> Thanks everyone,
> Marko.
>
> http://markorodriguez.com
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Gremlin-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/gremlin-users/b7c1d61a-ca00-4375-b771-f256cd33eab8%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
