Re: Flink slots, threads, task, etc

2017-04-21 Thread Aljoscha Krettek
Hi, there are currently no built-in metrics for InputSplit consumption but I do see that this could be quite helpful. I think you can have a custom RichInputFormat that uses metrics to record stuff, though. I think adding built-in metrics should be possible at this point in the code: https://gi

Re: Flink slots, threads, task, etc

2017-04-19 Thread Flavio Pompermaier
Hi Aljoscha, thanks for the reply, it was not urgent and I was aware of the FF...btw, congratulations for it, I saw many interesting talks! Flink community has grown a lot since it was Stratosphere ;) Just one last question: in many of my use cases it could be helpful to see how many of the created

Re: Flink slots, threads, task, etc

2017-04-18 Thread Aljoscha Krettek
Hi, sorry for not getting any responses but I think everyone was quite busy with Flink Forward SF. I’m also no expert on the topic but I’ll try and give some answers. Regarding a Google Doc version, I don’t think that there is any. You would have to modify the Markdown version we have in the do

Re: Flink slots, threads, task, etc

2017-04-11 Thread Flavio Pompermaier
Any feedback here..? On Wed, Apr 5, 2017 at 7:43 PM, Flavio Pompermaier wrote: > Hi to all, > I had a very long but useful chat with Fabian and I understood a lot of > concepts that was not clear at all to me. We started from the Flink runtime > documentation page (https://ci.apache.org/projects

Flink slots, threads, task, etc

2017-04-05 Thread Flavio Pompermaier
Hi to all, I had a very long but useful chat with Fabian and I understood a lot of concepts that was not clear at all to me. We started from the Flink runtime documentation page ( https://ci.apache.org/projects/flink/flink-docs-release-1.2/concepts/runtime.html) but I discovered that the terminolog