Yichi Zhang created BEAM-8998: --------------------------------- Summary: Avoid excessive bundle progress polling in JRH Key: BEAM-8998 URL: https://issues.apache.org/jira/browse/BEAM-8998 Project: Beam Issue Type: Improvement Components: runner-dataflow Reporter: Yichi Zhang
Dataflow Java runner uses 0.1 secs interval for polling bundle progress from SDK Harness, and use the result to decide whether data delivery should be throttled. This can potentially overload SDK Harness. We should try to come up with a way to avoid the throttling and lower the bundle progress request frequency significantly. -- This message was sent by Atlassian Jira (v8.3.4#803005)