Re: Upserts with Flink-elasticsearch

Without indexRequest ES2 throws `document does not exit exception`. Based on https://www.elastic.co/guide/en/elasticsearch/client/java-api/current/java-docs-update.html#java-docs-update-api-upsert the upsert works althrough not sure it's the best way. return new UpdateRequest()

Re: Upserts with Flink-elasticsearch

Hi Zach, For using upsert in ES2, I guess it looks like as follows? However I cannot find which method in Request returns UpdateRequest while Requests.indexRequest() returns IndexRequest. Can I ask did you know it? public static UpdateRequest updateIndexRequest(String element) {

Re: InetSocketAddress is not serializable

Thank for your explanation. Yes the InetSocketAddress you used is imported from java.net instead of elaticsearh2. Very cool! -- View this message in context:

Re: InetSocketAddress is not serializable

Can I ask why List can become serilizable? Best, Sendoh -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/InetSocketAddress-is-not-serializable-when-building-ElasticSearch2-connector-tp5296p5299.html Sent from the Apache Flink User Mailing

Re: InetSocketAddress is not serializable

Thank you. Very nice usage and It works! -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/InetSocketAddress-is-not-serializable-when-building-ElasticSearch2-connector-tp5296p5298.html Sent from the Apache Flink User Mailing List archive.

Re: The way to itearte instances in AllWindowFunction in current Master branch

An update. The following situation works as expected. The data arrives after Flink job starts to execute. 1> (2016-02-25T17:46:25.00,13) 2> (2016-02-25T17:46:40.00,16) 3> (2016-02-25T17:46:50.00,11) 4> (2016-02-25T17:47:10.00,12) But for the data arrives long time before. Strange behavior

Re: The way to itearte instances in AllWindowFunction in current Master branch

Thank you for your reply. Please let me know if other classes o full code is needed. /** * Count how many total events */ StreamExecutionEnvironment env = StreamExecutionEnvironment.createLocalEnvironment(4, env_config); env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime);

Re: The way to itearte instances in AllWindowFunction in current Master branch

Thanks you. I can be sure this way is correct now. I have tried this but the windows are not aggregating as well. Instead, the AllWindowFunction only works as flatMap. Shouldn't it only output for one window range? The most strange part is the first output is aggregating while others are not.

Re: The way to itearte instances in AllWindowFunction in current Master branch

Thank you for your reply. The following in the current master looks like not iterable? because the parameter is IN rather than Iterable So I still have problem to iterate,,, @Public public interface AllWindowFunction extends Function, Serializable { /**

Re: Problem with Kafka 0.9 Client

Had the same problem as Javier's. 3450 [Thread-10] DEBUG org.apache.kafka.clients.consumer.internals.AbstractCoordinator - Group metadata response ClientResponse(receivedTimeMs=1455811593680, disconnected=false, request=ClientRequest(expectResponse=true,

Change #TaskSlots in web interface

Hi, I remember there is a web interface(port: 6XXX) that can change configuration of Job Manager. e.g. taskmanager.numberOfTaskSlots, taskmanager.heap.mb But I can only find port 8081 that showing the configuration and I cannot change them. Did I miss anything? Best, Sendoh -- View this

Re: Cannot start FlinkMiniCluster.WebServer using different port in FlinkMiniCluster

The following message is obtained after putting BasicConfigurator.configure() in main(); But I don't understand the reason `flink-runtime-web is not in the classpath`. For me the strange part is using the scala version works well whereas my java version throws exception. 1413 [main] ERROR

Re: Cannot start FlinkMiniCluster.WebServer using different port in FlinkMiniCluster

After adding the dependency it totally works! Thank you a lot! -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Cannot-start-FlinkMiniCluster-WebServer-using-different-port-in-FlinkMiniCluster-tp4414p4455.html Sent from the Apache Flink User

Cannot start FlinkMiniCluster.WebServer using different port in FlinkMiniCluster

The original port is used so I'm changing the web port but it fails to. Can I ask which part I made a mistake? The error: Exception in thread "main" java.lang.NullPointerException at org.apache.flink.runtime.minicluster.FlinkMiniCluster.startWebServer(FlinkMiniCluster.scala:295) at

Re: Cannot start FlinkMiniCluster.WebServer using different port in FlinkMiniCluster

Yea I'm wondering why the web server cannot be instantiated because changing the port 8081 to works well in the following demo sample of Flink. https://github.com/dataArtisans/flink-streaming-demo/blob/master/src/main/scala/com/dataartisans/flink_demo/utils/DemoStreamEnvironment.scala so is

Re: Flink plus Elastic Search plus Kibana

Found the answer here http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Elasticsearch-connector-support-for-elasticsearch-2-0-td3910.html -- View this message in context:

Re: error in reduceGroup operator when changing the Flink version from 0.7 to 0.8

Thank you!This is complete solving the problem. -- View this message in context: http://apache-flink-incubator-user-mailing-list-archive.2336050.n4.nabble.com/Error-in-reduceGroup-operator-when-changing-the-Flink-version-from-0-7-to-0-8-tp785p793.html Sent from the Apache Flink (Incubator)

Multiple sources shortest path

Hi, In graph api there's an single source shortest path library. DataSetVertexlt;Long,Double singleSourceShortestPaths = graph.run(new SingleSourceShortestPathsLong(srcVertexId, maxIterations)).getVertices(); For Multiple Source, would it be possible to run it for all nodes