[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=393160=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-393160 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 26/Feb/20 03:40 Start Date: 26/Feb/20 03:40 Worklog Time Spent: 10m Work Description: lukecwik commented on pull request #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 393160) Time Spent: 2h 40m (was: 2.5h) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 2h 40m > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=393060=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-393060 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 23:52 Start Date: 25/Feb/20 23:52 Worklog Time Spent: 10m Work Description: lukecwik commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-591145850 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 393060) Time Spent: 2.5h (was: 2h 20m) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 2.5h > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=393043=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-393043 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 22:59 Start Date: 25/Feb/20 22:59 Worklog Time Spent: 10m Work Description: lukecwik commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-591118720 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 393043) Time Spent: 2h 10m (was: 2h) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 2h 10m > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=393044=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-393044 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 22:59 Start Date: 25/Feb/20 22:59 Worklog Time Spent: 10m Work Description: lukecwik commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-591118770 Run Go PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 393044) Time Spent: 2h 20m (was: 2h 10m) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 2h 20m > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=393038=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-393038 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 22:58 Start Date: 25/Feb/20 22:58 Worklog Time Spent: 10m Work Description: lukecwik commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-591118421 Run RAT PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 393038) Time Spent: 1h 20m (was: 1h 10m) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 1h 20m > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=393042=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-393042 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 22:58 Start Date: 25/Feb/20 22:58 Worklog Time Spent: 10m Work Description: lukecwik commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-591118668 Run JavaPortabilityApi PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 393042) Time Spent: 2h (was: 1h 50m) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 2h > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=393041=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-393041 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 22:58 Start Date: 25/Feb/20 22:58 Worklog Time Spent: 10m Work Description: lukecwik commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-591118582 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 393041) Time Spent: 1h 50m (was: 1h 40m) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 1h 50m > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=393039=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-393039 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 22:58 Start Date: 25/Feb/20 22:58 Worklog Time Spent: 10m Work Description: lukecwik commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-591118468 Run PythonLint PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 393039) Time Spent: 1.5h (was: 1h 20m) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 1.5h > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=393040=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-393040 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 22:58 Start Date: 25/Feb/20 22:58 Worklog Time Spent: 10m Work Description: lukecwik commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-591118518 Run Python2_PVR_Flink PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 393040) Time Spent: 1h 40m (was: 1.5h) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 1h 40m > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=392755=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-392755 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 18:20 Start Date: 25/Feb/20 18:20 Worklog Time Spent: 10m Work Description: lukecwik commented on pull request #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#discussion_r384039927 ## File path: sdks/python/apache_beam/runners/worker/operations.py ## @@ -812,6 +813,36 @@ def progress_metrics(self): current_element_progress.fraction_remaining) return metrics + def monitoring_infos(self, transform_id): Review comment: Your not wrong, there is no operations_test.py. A bunch of the testing in the Python SDK relies on pipeline level tests which test execution e2e. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 392755) Time Spent: 1h 10m (was: 1h) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 1h 10m > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=392299=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-392299 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 05:54 Start Date: 25/Feb/20 05:54 Worklog Time Spent: 10m Work Description: HuangLED commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-590697229 LGTM. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 392299) Time Spent: 40m (was: 0.5h) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 40m > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=392301=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-392301 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 05:54 Start Date: 25/Feb/20 05:54 Worklog Time Spent: 10m Work Description: HuangLED commented on pull request #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#discussion_r383671515 ## File path: sdks/python/apache_beam/runners/worker/operations.py ## @@ -812,6 +813,36 @@ def progress_metrics(self): current_element_progress.fraction_remaining) return metrics + def monitoring_infos(self, transform_id): Review comment: a bit surprised there is no testing file corresponding to operations.py. Maybe I missed something? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 392301) Time Spent: 1h (was: 50m) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 1h > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=392300=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-392300 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 25/Feb/20 05:54 Start Date: 25/Feb/20 05:54 Worklog Time Spent: 10m Work Description: HuangLED commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-590697229 LGTM. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 392300) Time Spent: 50m (was: 40m) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 50m > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=392175=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-392175 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 24/Feb/20 23:20 Start Date: 24/Feb/20 23:20 Worklog Time Spent: 10m Work Description: ananvay commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-590598664 Thanks a lot Luke! LGTM. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 392175) Time Spent: 0.5h (was: 20m) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 0.5h > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=392161=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-392161 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 24/Feb/20 23:12 Start Date: 24/Feb/20 23:12 Worklog Time Spent: 10m Work Description: lukecwik commented on issue #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956#issuecomment-590596115 R: @ananvay @HuangLED CC: @robertwb This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 392161) Time Spent: 20m (was: 10m) > Add support for progress reporting in fn API > > > Key: BEAM-2822 > URL: https://issues.apache.org/jira/browse/BEAM-2822 > Project: Beam > Issue Type: New Feature > Components: beam-model >Reporter: Vikas Kedigehalli >Priority: Minor > Labels: portability > Time Spent: 20m > Remaining Estimate: 0h > > https://s.apache.org/beam-fn-api-progress-reporting > Note that the ULR reference implementation, when ready, should be useful for > every runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-2822) Add support for progress reporting in fn API
[ https://issues.apache.org/jira/browse/BEAM-2822?focusedWorklogId=392160=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-392160 ] ASF GitHub Bot logged work on BEAM-2822: Author: ASF GitHub Bot Created on: 24/Feb/20 23:09 Start Date: 24/Feb/20 23:09 Worklog Time Spent: 10m Work Description: lukecwik commented on pull request #10956: [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed and remaining amounts of work using new metrics format for splittable dofns in the Python SDK. URL: https://github.com/apache/beam/pull/10956 This provides the equivalent to the `metrics.active_elements.fraction_remaining` using the new monitoring APIs. Without these, we cannot enable autoscaling using the new metrics. Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and mention them in a comment (`R: @username`). - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue. - [ ] Update `CHANGES.md` with noteworthy changes. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). See the [Contributor Guide](https://beam.apache.org/contribute) for more tips on [how to make review process smoother](https://beam.apache.org/contribute/#make-reviewers-job-easier). Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/) Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Java11/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)[