Re: Flink on Tez

2014-11-08 Thread Flavio Pompermaier
Sorry for the newbie question but for me it's not clear when users should switch from flink runtime to tez, they seems to do the same thing right? On Sat, Nov 8, 2014 at 6:02 PM, Aljoscha Krettek wrote: > Yes, but the beauty of it is that Flink is designed in such a way that > we can switch unde

Re: Type extraction with generic variables

2014-11-08 Thread Vasiliki Kalavri
Hello again, I tried out your suggestion and made a variation of the mapVertices method, which takes the class of the new value as an argument. In order to extract the type from the class, I use the TypeExtractor.getForClass() method. Is this what you had in mind? When testing, this seems to work

Re: Flink on Tez

2014-11-08 Thread Aljoscha Krettek
Yes, but the beauty of it is that Flink is designed in such a way that we can switch underlying runtime execution strategies and systems. Tez will never be required, it's just another possible execution mode. Regards, Aljoscha On Sat, Nov 8, 2014 at 12:07 PM, sirinath wrote: > Great news. > > Bu

RE: Flink on Tez

2014-11-08 Thread sirinath
Great news. But as I see it if you are looking to use Flink standalone and embedded best is to try to have own implementation in the long run. Besides this is more optimized or created with Hadoop and related projects in mind and is not a simple library dependency. Again great to see the initiati

Re: Embeded Use

2014-11-08 Thread sirinath
Perhaps you can add more on this in the documentation. Embedded use in not very clear. -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Embeded-Use-tp2412p2415.html Sent from the Apache Flink (Incubator) Mailing List archive. mailing list

Re: Embeded Use

2014-11-08 Thread Stephan Ewen
Hi! Flink works stand alone already, YARN is only optional (for convenience) for those that have a YARN cluster already. The default setup guide describes the stand alone mode. Flink also runs embedded with virtually no memory and thread overheads. That was one of the features in the latest relea