[
https://issues.apache.org/jira/browse/BEAM-10852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17548787#comment-17548787
]
Danny McCormick commented on BEAM-10852:
----------------------------------------
This issue has been migrated to https://github.com/apache/beam/issues/20402
> Combine Python streaming load test is too slow on Flink
> -------------------------------------------------------
>
> Key: BEAM-10852
> URL: https://issues.apache.org/jira/browse/BEAM-10852
> Project: Beam
> Issue Type: Bug
> Components: runner-flink, sdk-py-core, testing
> Reporter: Kamil Wasilewski
> Priority: P3
>
> One of the Combine load test cases, which involves a global combiner and data
> stream of 200M elements, takes too long on Flink. Flink is able to process
> only a half of that data stream within 1 hour, which is too long for a
> Jenkins job.
> Job's definition:
> https://github.com/apache/beam/blob/master/.test-infra/jenkins/job_LoadTests_Combine_Flink_Python.groovy#L36
> Test pipeline:
> https://github.com/apache/beam/blob/master/sdks/python/apache_beam/testing/load_tests/combine_test.py
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
