Fetching TaskManager log failed
I run a flink job,when run one hour,there have a error: ERROR org.apache.flink.runtime.webmonitor.handlers.TaskManagerLogHandler - Fetching TaskManager log failed. java.util.NoSuchElementException: None.get
Re: Using latency markers
Hi all! I'm having the same issues. I get NaN in the Task metrics. The version is 1.3.1. Maybe I'm completely missing something... There are questions about FLINK-7692, it can Solve the problem above? What should I do in my version. Thanks! 2017-10-11 23:30 GMT+08:00 Aljoscha Krettek : > This is the Jira issue: https://issues.apache.org/jira/browse/FLINK-7608 > > > On 27. Sep 2017, at 12:22, Martin Eden wrote: > > Any follow-up on this? Jira? PR? > > On Wed, Sep 13, 2017 at 11:30 AM, Tzu-Li (Gordon) Tai > wrote: > >> Hi Aitozi, >> >> Yes, I think we haven’t really pin-pointed out the actual cause of the >> problem, but if you have a fix for that and can provide a PR we can >> definitely look at it! That would be helpful. >> Before opening a PR, also make sure to first open a JIRA for the issue (I >> don’t think there is one yet for this issue). >> >> Cheers, >> Gordon >> >> On 13 September 2017 at 12:14:42 PM, aitozi (gjying1...@gmail.com) wrote: >> >> Hi, Aljoscha, >> >> the dashboard shown NAN is just because the value of the latencyGague is >> not >> numerical， so it can't be shown in dashboard, i removed the other >> latencydescprition except the sink, so i can see the latency in >> dashboard, >> do i need to post a pr? >> >> thanks, >> Aitozi >> >> >> >> -- >> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4. >> nabble.com/ >> >> > >
MergingWindow
Hi,
i cant unserstand usage of this snippest of the code in
MergingWindowSet.java, can anyone explain this for me ?
if (!(mergedWindows.contains(mergeResult) && mergedWindows.size() == 1)) {
mergeFunction.merge(mergeResult,
mergedWindows,
this.mapping.get(mergeResult),
mergedStateWindows);
}
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Mergingwindow
Hi, i cant understand the usage of this snippest of this code , can anyone explain foe me ? thanks -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
merging window
Hi, i cant understand the usage of this snippest of this code , can anyone explain foe me ? thanks -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Apache Flink - broadcasting DataStream
Hi: I am trying to understand broadcast functionality for DataStream and the documentation indicates that it 'Broadcasts elements to every partition.' My question is that since streams are unbounded: 1 What elements get broad to the partitions ?2. What happens as new elements are added to the stream ? Are only the new elements broadcast ?3. Since the broadcast operation returns a DataStream can it be used in join how do new (and old) elements affect the join results ? 4. Similarly how does broadcast work with connected streams ? If there are some examples please let me know. Thanks Mans
flink yarn-cluster run job --files
Hi,all in spark,the submit job can have --files,this means" Comma-separated list of files to be placed in the working directory of each executor." so,in flink,if there have the same method,i use --classpath file:///,but the job run error,there has not the file.
How to stop FlinkKafkaConsumer and make job finished?
I would like to stop FlinkKafkaConsumer consuming data from kafka manually. But I find it won't be close when I invoke "cancel()" method. What I am trying to do is add an EOF symbol meaning the end of my kafka data, and when the FlatMap operator read the symbol it will invoke FlinkKafkaConsumer "cancel()" method. It doesn't work. Flink streaming job won't finish unless it get canceled or failed, when I use kafka as source. Somebody knowing gives me some help, thx~~
