kamilwu commented on a change in pull request #12030:
URL: https://github.com/apache/beam/pull/12030#discussion_r443569325
##########
File path: .test-infra/jenkins/job_LoadTests_ParDo_Flink_Python.groovy
##########
@@ -79,29 +79,31 @@ def batchScenarios = { datasetName -> [
environment_type : 'DOCKER',
]
],
- [
- title : 'ParDo Python Load test: 20M 100 byte records
200 times',
- test : 'apache_beam.testing.load_tests.pardo_test',
- runner : CommonTestProperties.Runner.PORTABLE,
- pipelineOptions: [
- job_name :
'load-tests-python-flink-batch-pardo-2-' + now,
- project : 'apache-beam-testing',
- publish_to_big_query : true,
- metrics_dataset : datasetName,
- metrics_table : 'python_flink_batch_pardo_2',
- influx_measurement : 'python_batch_pardo_2',
- input_options : '\'{' +
- '"num_records": 20000000,' +
- '"key_size": 10,' +
- '"value_size": 90}\'',
- iterations : 200,
- number_of_counter_operations: 0,
- number_of_counters : 0,
- parallelism : 5,
- job_endpoint : 'localhost:8099',
- environment_type : 'DOCKER',
- ]
- ],
+// TODO(BEAM-10270): Takes too long time to execute (currently more than 2
hours). Re-enable
Review comment:
> Also the comment should say "more than 4 hours"
From
https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/270/console:
```
16:21:33 INFO:apache_beam.runners.portability.portable_runner:Job state
changed to RUNNING
19:48:20 Build timed out (after 240 minutes). Marking the build as aborted.
```
That gives us slightly more than 3 hours. The rest of time is spent on Pardo
test with 10 iterations. I'll change the comment to "more than 3 hours"
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
