Deactive a job like storm

How can I deactive a job like storm? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Deactive-a-job-like-storm-tp13088.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: ConnectedStream keyby issues

private static class MergeFunction extends RichProcessFunction, Tuple2> { private ValueState> state; @Override public void open(Configuration parameters) throws Exception { state = getRuntimeContext().getState(new ValueStateDescriptor<>("mystate", TypeInformatio

Re: ConnectedStream keyby issues

In upstairs example, it seems I should clear the state in onTimer function in order to free resource like follows: public void onTimer(long l, OnTimerContext onTimerContext, Collector> collector) throws Exception { if (state.value() != null) { collector.collect(state.v

Re: Deactive a job like storm

This is called "stop" in Flink. You can find a short description here: https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/cli.html " The difference between cancelling and stopping a (streaming) job is the following: On a cancel call, the operators in a job immediately receive a

Gelly - generics with custom vertex value

Hi, a part of my bachelor thesis is an implementation of the Semi-Clustering algorithm [1]. I’m using the Scatter-Gather-Iteration. Each vertex has to know its neighbors and the edge-value between of that. Because Gelly’s vertex doesn’t provide both information, I wrote an CustomVertexValue cla

Re: Gelly - generics with custom vertex value

Looks like java.util.ArrayList$SubList does not work out of the box with Kryo / Flink. Try registering a custom serializer for it... On Wed, May 10, 2017 at 4:16 PM, Kaepke, Marc wrote: > Hi, > > a part of my bachelor thesis is an implementation of the Semi-Clustering > algorithm [1]. > I’m usi

issue running flink in docker

Hi everyone, We are attempting to run flink 1.2 in a distributed dockerized environment and are running into issues when running jobs in parallel. The exception we are getting fairly quickly after start up is: org.apache.flink.runtime.io.network.partition.PartitionNotFoundException: Partition d3

Re: issue running flink in docker

Hi! Can it be that some hostname / IP address mapping / etc gets thrown off somewhere in the process? This exception looks like the following happens: - JobManager gets a message from a TaskManager that a partition is ready, notifies other TaskManagers - TaskManager gets the update message,

Re: issue running flink in docker

Stephan, Thanks for pointing us in the right direction on the different addresses. That was the issue. David On Wed, May 10, 2017 at 3:03 PM, Stephan Ewen wrote: > Hi! > > Can it be that some hostname / IP address mapping / etc gets thrown off > somewhere in the process? > > This exception loo

Re: Weird serialization bug?

Hi, thanks for the help! Making the class fooo static did the trick. I was just a bit confused, because I'm using a similar contruction somewhere else in the code and it works flawlessy. Best regards, Sebastian

Re:Re: Re: ElasticsearchSink on DataSet

Hi Flavio, I made a PR for this : https://github.com/apache/flink/pull/3869 And it also support ActionRequestFailureHandler in DataSet's ElasticsearchSink Best 在2017年05月09 15时30分, "Flavio Pompermaier"写道: Just one note: I took a look at your connector and it doesn't provide any failure handl

Re: Deactive a job like storm

But why FlinkKafkaConsumerBase don't implement the StoppableFunction interface? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Deactive-a-job-like-storm-tp13088p13099.html Sent from the Apache Flink User Mailing List archive. mailing list a

Re: Gelly - generics with custom vertex value

Thanks for the hint. I focused on it and get a strange behavior. If I change from EdgeDirection.ALL (what I need) to EdgeDirection.OUT (or .IN), everything seems okey. The sublist operation was still active. Then I replaced the sublist with the entire list and there was no exception (EdgeDirect