Re: Flink Streaming Scala API

See if there is anything you can borrow from Akka Streaming API for Flink Streams: http://doc.akka.io/docs/akka-stream-and-http-experimental/1.0-M2/scala.html The DSL looks good and perhaps might stimulate some ideas. -- View this message in context: http://apache-flink-incubator-mailing-list

Distributed Data Frame (DFF) Support

Hi, Is it possible to support DFF (http://ddf.io/) in Flink? Suminda -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Distributed-Data-Frame-DFF-Support-tp2892.html Sent from the Apache Flink (Incubator) Mailing List archive. mailing li

Re: [VOTE] Graduate Flink from the Incubator

+1 (binding) -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/VOTE-Graduate-Flink-from-the-Incubator-tp2737p2758.html Sent from the Apache Flink (Incubator) Mailing List archive. mailing list archive at Nabble.com.

Re: Java Primitive Collections in Flink

Koloboke is the fastest. Also speeds may improve further. May be you can as the library author to implement some of the features you want as he makes that request. See: https://github.com/OpenHFT/Koloboke/wiki/Koloboke:-roll-the-collection-implementation-with-features-you-need -- View this mess

Re: Java Primitive Collections in Flink

There is also https://github.com/OpenHFT/Koloboke But I feel Flink can have its own collections which are more optimized for Flink use cases. You can bench mark and see what works best. -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Ja

Re: Flink on Tez

All this is good where you can swap engines but at this point I think you should make the internal engine as good as possible to it dominated all other engines. This way there will be not use to change. Also relying or running on top of software designed for other ecosystems is not a good trent. B

Re: Flink on Tez

Why don't you have an internal engine which addresses both the concerns raised than one over the other. Also configuration can help towards which type of optimisation is done in cases where things are mutually exclusive. -- View this message in context: http://apache-flink-incubator-mailing-lis

RE: Flink on Tez

Great news. But as I see it if you are looking to use Flink standalone and embedded best is to try to have own implementation in the long run. Besides this is more optimized or created with Hadoop and related projects in mind and is not a simple library dependency. Again great to see the initiati

Re: Embeded Use

Perhaps you can add more on this in the documentation. Embedded use in not very clear. -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Embeded-Use-tp2412p2415.html Sent from the Apache Flink (Incubator) Mailing List archive. mailing list

Embeded Use

Hi, Flink will be very useful if it is embeddable in applications and can discover other nodes and cluster without relying on YARN or Hadoop. So it would be an idea to make it stand alone. Suminda -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.n

Making Fink More HFT / Trading Friendly

Hi, In response to the message exchanged in LinkedIn I am shooting a few ideas. To make Flink a great product in the Financial as well as real time, low latency, high throughput analytics following features would be a great help: - Move object allocation to off heap GC does not get triggered - t

Re: Make Streaming Interoperable with Reactive Streams, Java Streams and Rx

What I ment was to have stream connectors for Java Streams, Rx (http://reactivex.io/), Reactive Streams (reactive-streams.org), JCTools (https://github.com/JCTools/JCTools), Chronicles (https://github.com/OpenHFT), Vertex (http://vertx.io/), Vertigo (https://github.com/kuujo/vertigo), Akka, Quasar

Make Streaming Interoperable with Reactive Streams, Java Streams and Rx

Hi, Is it possible to add interop with the following projects in Streaming: - http://reactive-streams.org/ specification - Java Streams - If possible http://reactivex.io/ Suminda -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Make

Re: [DISCUSS] Bump the minimum Java requirement to Java 7 for Flink

I think it is best to drop support a JVM when it reaches the end of life cycle or some time before reaching this date (when announcement is made). You can publish this as a policy so there is not surprises. -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008