[jira] [Commented] (BEAM-5758) Load tests for SyntheticSources in Python
[ https://issues.apache.org/jira/browse/BEAM-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123077#comment-17123077 ] Beam JIRA Bot commented on BEAM-5758: - This issue is P2 but has been unassigned without any comment for 60 days so it has been labeled "stale-P2". If this issue is still affecting you, we care! Please comment and remove the label. Otherwise, in 14 days the issue will be moved to P3. Please see https://beam.apache.org/contribute/jira-priorities/ for a detailed explanation of what these priorities mean. > Load tests for SyntheticSources in Python > - > > Key: BEAM-5758 > URL: https://issues.apache.org/jira/browse/BEAM-5758 > Project: Beam > Issue Type: Test > Components: testing >Reporter: Kasia Kucharczyk >Priority: P2 > Labels: stale-P2 > Time Spent: 3h > Remaining Estimate: 0h > > For purpose of load testing the SyntheticSources there should be created > tests with metrics which will be sent to BigQuery. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-5758) Load tests for SyntheticSources in Python
[
https://issues.apache.org/jira/browse/BEAM-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653437#comment-16653437
]
Kasia Kucharczyk commented on BEAM-5758:
While [testing
ParDo|https://github.com/apache/beam/blob/faff82860c66e4050f0cfa5e874ffe6035ed0c1c/sdks/python/apache_beam/testing/load_tests/par_do_test.py#L133]
I encountered some problems with DirectRunner. The test contains a loop of no
operation ParDos where the number of iterations is parametrized in pipeline
options. With ~200 iterations the test fails and returns whole INFO logs of
pipeline steps. The only Exception that sometimes appears is:
{code:java}
RuntimeError: maximum recursion depth exceeded{code}
I created another issue with further details about this problem.
> Load tests for SyntheticSources in Python
> -
>
> Key: BEAM-5758
> URL: https://issues.apache.org/jira/browse/BEAM-5758
> Project: Beam
> Issue Type: Test
> Components: testing
>Reporter: Kasia Kucharczyk
>Assignee: Kasia Kucharczyk
>Priority: Major
>
> For purpose of load testing the SyntheticSources there should be created
> tests with following transformations:
> * ParDo
> * Combine
> * GroupByKey
> * CoGroupByKey.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
