Valentyn Tymofieiev created BEAM-8215: -----------------------------------------
Summary: Wordcount 1GB Python PKB benchmarks sometimes fail without an informative error Key: BEAM-8215 URL: https://issues.apache.org/jira/browse/BEAM-8215 Project: Beam Issue Type: Bug Components: testing Reporter: Valentyn Tymofieiev Assignee: Mark Liu Example: https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/452/console {noformat} 12:09:27 2019-09-11 19:09:27,655 a47400ce MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark 12:09:27 Traceback (most recent call last): 12:09:27 File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", line 841, in RunBenchmark 12:09:27 DoRunPhase(spec, collector, detailed_timer) 12:09:27 File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", line 687, in DoRunPhase 12:09:27 samples = spec.BenchmarkRun(spec) 12:09:27 File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py", line 160, in Run 12:09:27 job_type=job_type) 12:09:27 File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py", line 91, in SubmitJob 12:09:27 assert retcode == 0, "Integration Test Failed." 12:09:27 AssertionError: Integration Test Failed. {noformat} It seems like Job submission failed, but there are no details. I talked with [~markflyhigh], and sounds like we plan to stop using PKB in favor of another framework. Assigning to Mark for now to triage follow up or reassign as appropriate. -- This message was sent by Atlassian Jira (v8.3.2#803003)