[
https://issues.apache.org/jira/browse/BEAM-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653437#comment-16653437
]
Kasia Kucharczyk commented on BEAM-5758:
----------------------------------------
While [testing
ParDo|https://github.com/apache/beam/blob/faff82860c66e4050f0cfa5e874ffe6035ed0c1c/sdks/python/apache_beam/testing/load_tests/par_do_test.py#L133]
I encountered some problems with DirectRunner. The test contains a loop of no
operation ParDos where the number of iterations is parametrized in pipeline
options. With ~200 iterations the test fails and returns whole INFO logs of
pipeline steps. The only Exception that sometimes appears is:
{code:java}
RuntimeError: maximum recursion depth exceeded{code}
I created another issue with further details about this problem.
> Load tests for SyntheticSources in Python
> -----------------------------------------
>
> Key: BEAM-5758
> URL: https://issues.apache.org/jira/browse/BEAM-5758
> Project: Beam
> Issue Type: Test
> Components: testing
> Reporter: Kasia Kucharczyk
> Assignee: Kasia Kucharczyk
> Priority: Major
>
> For purpose of load testing the SyntheticSources there should be created
> tests with following transformations:
> * ParDo
> * Combine
> * GroupByKey
> * CoGroupByKey.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
