[ https://issues.apache.org/jira/browse/BEAM-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16314279#comment-16314279 ]
Ankur Goenka edited comment on BEAM-3411 at 1/6/18 1:48 AM: ------------------------------------------------------------ We missed catching a case where progress report for an unregistered work item is requested from the worker which resulted in an uncaught exceptions. Erroneous Code block: {code:java} worker = self._instruction_id_vs_worker[request.instruction_id] {code} Underlying error stack trace: {code:java} Python sdk harness failed: Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker_main.py", line 134, in main worker_count=_get_worker_count(sdk_pipeline_options)).run() File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker.py", line 97, in run work_request) File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker.py", line 162, in _request_process_bundle_progress worker = self._instruction_id_vs_worker[request.instruction_id] KeyError: u'-39' {code} was (Author: angoenka): We missed catching a case where progress report for an unregistered work item is requested from the worker which resulted in an uncaught exceptions. Erroneous Code block: {code:python} worker = self._instruction_id_vs_worker[request.instruction_id] {code} Underlying error stack trace: {code:python} Python sdk harness failed: Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker_main.py", line 134, in main worker_count=_get_worker_count(sdk_pipeline_options)).run() File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker.py", line 97, in run work_request) File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker.py", line 162, in _request_process_bundle_progress worker = self._instruction_id_vs_worker[request.instruction_id] KeyError: u'-39' {code} > Test apache_beam.examples.wordcount_it_test.WordCountIT times out > ----------------------------------------------------------------- > > Key: BEAM-3411 > URL: https://issues.apache.org/jira/browse/BEAM-3411 > Project: Beam > Issue Type: Bug > Components: sdk-py-core > Reporter: Henning Rohde > Assignee: Ankur Goenka > > Failed run: > https://builds.apache.org/job/beam_PostCommit_Python_Verify/3876/console > Log snippet: > test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) > ... ERROR > ====================================================================== > ERROR: test_wordcount_fnapi_it > (apache_beam.examples.wordcount_it_test.WordCountIT) > ---------------------------------------------------------------------- > Traceback (most recent call last): > File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/plugins/multiprocess.py", > line 812, in run > test(orig) > File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py", > line 45, in __call__ > return self.run(*arg, **kwarg) > File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py", > line 133, in run > self.runTest(result) > File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py", > line 151, in runTest > test(result) > File "/usr/lib/python2.7/unittest/case.py", line 395, in __call__ > return self.run(*args, **kwds) > File "/usr/lib/python2.7/unittest/case.py", line 331, in run > testMethod() > File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/examples/wordcount_it_test.py", > line 77, in test_wordcount_fnapi_it > on_success_matcher=PipelineStateMatcher())) > File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/examples/wordcount_fnapi.py", > line 130, in run > result.wait_until_finish() > File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py", > line 956, in wait_until_finish > time.sleep(5.0) > File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/plugins/multiprocess.py", > line 276, in signalhandler > raise TimedOutException() > TimedOutException: 'test_wordcount_fnapi_it > (apache_beam.examples.wordcount_it_test.WordCountIT)' > ---------------------------------------------------------------------- > Ran 3 tests in 901.290s > FAILED (errors=1) > Build step 'Execute shell' marked build as failure -- This message was sent by Atlassian JIRA (v6.4.14#64029)