Hey guys,
Is there any way to monitor the backpressure in the Flink job? I find it
hard to debug slow operators because of the backpressure mechanism so it
would be good to get some info out of the network layer on what exactly
caused the backpressure.
For example:
task1 -> task2 -> task3 -> tas
I discussed about this quite a bit with other people.
It is not totally straightforward. One could try and measure exhaustion of
the output buffer pools, but that fluctuates a lot - it would need some
work to get a stable metric from that...
If you have a profiler that you can attach to the proce
Maximilian Michels created FLINK-3127:
-
Summary: Measure backpressure in Flink jobs
Key: FLINK-3127
URL: https://issues.apache.org/jira/browse/FLINK-3127
Project: Flink
Issue Type: Improv
Thanks Stephan,
I will try with the profiler for now.
Gyula
Stephan Ewen ezt írta (időpont: 2015. dec. 7., H, 10:51):
> I discussed about this quite a bit with other people.
>
> It is not totally straightforward. One could try and measure exhaustion of
> the output buffer pools, but that fluct
Hi Sachin,
I can understand your dissatisfaction with the review process of your ML
PRs. They are open for a long time without much activity from a committer
even though you've spent a lot of effort writing them. I'm sorry for this,
since it's probably mainly because of me lacking the time resourc
Fridtjof Sander created FLINK-3128:
--
Summary: Add Isotonic Regression To ML Library
Key: FLINK-3128
URL: https://issues.apache.org/jira/browse/FLINK-3128
Project: Flink
Issue Type: New Featu
Robert Metzger created FLINK-3129:
-
Summary: Add tooling to ensure interface stability
Key: FLINK-3129
URL: https://issues.apache.org/jira/browse/FLINK-3129
Project: Flink
Issue Type: Sub-tas
Ufuk Celebi created FLINK-3130:
--
Summary: Visualize throughput of tasks
Key: FLINK-3130
URL: https://issues.apache.org/jira/browse/FLINK-3130
Project: Flink
Issue Type: Improvement
Com
Ufuk Celebi created FLINK-3131:
--
Summary: Expose checkpoint metrics
Key: FLINK-3131
URL: https://issues.apache.org/jira/browse/FLINK-3131
Project: Flink
Issue Type: Improvement
Compone
Ufuk Celebi created FLINK-3132:
--
Summary: Restructure streaming guide
Key: FLINK-3132
URL: https://issues.apache.org/jira/browse/FLINK-3132
Project: Flink
Issue Type: Improvement
Compo
Hi All,
I am really thrill with Apache Flink community work which is going. Can we
have the PDF versions of these web-pages so that even offline user can use
for reference.
Cheer's,
Nyamath Ulla Khan
On Mon, Dec 7, 2015 at 7:23 PM, Ufuk Celebi (JIRA) wrote:
> Ufuk Celebi created FLINK-3132:
>
Maximilian Michels created FLINK-3133:
-
Summary: Introduce collect()/coun()/print() methods in DataStream
API
Key: FLINK-3133
URL: https://issues.apache.org/jira/browse/FLINK-3133
Project: Flink
Maximilian Michels created FLINK-3134:
-
Summary: Make YarnJobManager's allocate call asynchronous
Key: FLINK-3134
URL: https://issues.apache.org/jira/browse/FLINK-3134
Project: Flink
Issu
Fabian Hueske created FLINK-3135:
Summary: Add chainable driver for UNARY_NO_OP strategy
Key: FLINK-3135
URL: https://issues.apache.org/jira/browse/FLINK-3135
Project: Flink
Issue Type: Impro
Stephan Ewen created FLINK-3136:
---
Summary: Scala Closure Cleaner uses wrong ASM import
Key: FLINK-3136
URL: https://issues.apache.org/jira/browse/FLINK-3136
Project: Flink
Issue Type: Bug
Ted Yu created FLINK-3137:
-
Summary: Missing break in OutputEmitter ctor
Key: FLINK-3137
URL: https://issues.apache.org/jira/browse/FLINK-3137
Project: Flink
Issue Type: Bug
Reporter: Ted
Stephan Ewen created FLINK-3138:
---
Summary: Method References are not supported as lambda expressions
Key: FLINK-3138
URL: https://issues.apache.org/jira/browse/FLINK-3138
Project: Flink
Issue T
Chengxiang Li created FLINK-3139:
Summary: NULL values handling in Table API
Key: FLINK-3139
URL: https://issues.apache.org/jira/browse/FLINK-3139
Project: Flink
Issue Type: Task
Co
Chengxiang Li created FLINK-3140:
Summary: NULL value data layout in Row Serializer/Comparator
Key: FLINK-3140
URL: https://issues.apache.org/jira/browse/FLINK-3140
Project: Flink
Issue Type:
Hi,
Summary of our discussion about NULL value handling in FLink:
1. Read from data source to Table/Row DataSet directly is necessary for NULL
value handling.
2. NULL value representation in Row object, this would change its binary data
layout, so we would need new Row Serializer/Comparator(and
Chengxiang Li created FLINK-3141:
Summary: Design of NULL values handling in operation
Key: FLINK-3141
URL: https://issues.apache.org/jira/browse/FLINK-3141
Project: Flink
Issue Type: Sub-tas
Matthias J. Sax created FLINK-3142:
--
Summary: CheckpointCoordinatorTest fails
Key: FLINK-3142
URL: https://issues.apache.org/jira/browse/FLINK-3142
Project: Flink
Issue Type: Bug
C
Hi,
I had a failing build due to "Maven produced no output for 300 seconds."
It seems that
> JobManagerCheckpointRecoveryITCase.testCheckpointedStreamingSumProgram()
got stuck. Did anyone see this before? Should I open an "instable-test"
JIRA?
https://travis-ci.org/mjsax/flink/jobs/95439206
-M
23 matches
Mail list logo
