[ https://issues.apache.org/jira/browse/BEAM-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Beam JIRA Bot updated BEAM-9150: -------------------------------- Labels: stale-P2 (was: ) > beam_PostRelease_Python_Candidate fails > --------------------------------------- > > Key: BEAM-9150 > URL: https://issues.apache.org/jira/browse/BEAM-9150 > Project: Beam > Issue Type: Bug > Components: build-system > Reporter: Udi Meiri > Priority: P2 > Labels: stale-P2 > Time Spent: 2h 10m > Remaining Estimate: 0h > > https://builds.apache.org/job/beam_PostRelease_Python_Candidate/171/timestamps/?time=HH:mm:ss&timeZone=GMT-8&appendLog&locale=en_US > Some interesting lines: > {code} > 17:48:36 > release/src/main/python-release/run_release_candidate_python_quickstart.sh: > line 144: 20935 Killed python -m > apache_beam.examples.streaming_wordcount --input_topic > projects/$PROJECT_ID/topics/$PUBSUB_TOPIC1 --output_topic > projects/$PROJECT_ID/topics/$PUBSUB_TOPIC2 --streaming > {code} > {code} > 18:05:25 > ############################################################################ > 18:05:25 Running HourlyTeamScore example with DirectRunner > 18:05:25 > ############################################################################ > 18:05:25 > /tmp/tmp.gnpMNIFhcL/temp_virtualenv_python2.7/local/lib/python2.7/site-packages/apache_beam/__init__.py:84: > UserWarning: You are using Apache Beam with Python 2. New releases of Apache > Beam will soon support Python 3 only. > 18:05:25 'You are using Apache Beam with Python 2. ' > 18:05:33 INFO:root:Missing pipeline option (runner). Executing pipeline > using the default runner: DirectRunner. > 18:05:33 INFO:root:Setting socket default timeout to 60 seconds. > 18:05:33 INFO:root:socket default timeout is 60.0 seconds. > 18:05:33 INFO:oauth2client.transport:Attempting refresh to obtain initial > access_token > 18:05:34 > /tmp/tmp.gnpMNIFhcL/temp_virtualenv_python2.7/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py:1220: > BeamDeprecationWarning: options is deprecated since First stable release. > References to <pipeline>.options will not be supported > 18:05:34 experiments = p.options.view_as(DebugOptions).experiments or [] > 18:05:37 INFO:root:==================== <function > annotate_downstream_side_inputs at 0x7f131dc46f50> ==================== > 18:05:37 INFO:root:==================== <function > fix_side_input_pcoll_coders at 0x7f131dc3e0c8> ==================== > 18:05:37 INFO:root:==================== <function lift_combiners at > 0x7f131dc3e140> ==================== > 18:05:37 INFO:root:==================== <function expand_sdf at > 0x7f131dc3e1b8> ==================== > 18:05:37 INFO:root:==================== <function expand_gbk at > 0x7f131dc3e230> ==================== > 18:05:37 INFO:root:==================== <function sink_flattens at > 0x7f131dc3e320> ==================== > 18:05:37 INFO:root:==================== <function greedily_fuse at > 0x7f131dc3e398> ==================== > 18:05:37 INFO:root:==================== <function read_to_impulse at > 0x7f131dc3e410> ==================== > 18:05:37 INFO:root:==================== <function impulse_to_input at > 0x7f131dc3e488> ==================== > 18:05:37 INFO:root:==================== <function inject_timer_pcollections > at 0x7f131dc3e5f0> ==================== > 18:05:37 INFO:root:==================== <function sort_stages at > 0x7f131dc3e668> ==================== > 18:05:37 INFO:root:==================== <function window_pcollection_coders > at 0x7f131dc3e6e0> ==================== > 18:05:37 INFO:root:Creating state cache with size 100 > 18:05:37 INFO:root:Created Worker handler > <apache_beam.runners.portability.fn_api_runner.EmbeddedWorkerHandler object > at 0x7f12fc89c290> for environment urn: "beam:env:embedded_python:v1" > 18:05:37 > 18:05:37 INFO:root:Running > ((ref_AppliedPTransform_ReadInputText/Read/_SDFBoundedSourceWrapper/Impulse_5)+(ReadInputText/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)/PairWithRestriction))+((ReadInputText/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)/SplitAndSizeRestriction)+(ref_PCollection_PCollection_1_split/Write)) > 18:05:38 INFO:root:Running > (ref_PCollection_PCollection_1_split/Read)+((((ReadInputText/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)/Process)+((ref_AppliedPTransform_HourlyTeamScore/ParseGameEventFn_8)+((ref_AppliedPTransform_HourlyTeamScore/FilterStartTime_9)+((ref_AppliedPTransform_HourlyTeamScore/FilterEndTime_10)+((ref_AppliedPTransform_HourlyTeamScore/AddEventTimestamps_11)+((ref_AppliedPTransform_HourlyTeamScore/FixedWindowsTeam_12)+(ref_AppliedPTransform_HourlyTeamScore/ExtractAndSumScore/Map(<lambda > at > hourly_team_score.py:142>)_14)))))))+(HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Precombine))+(HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Group/Write)) > 18:05:39 INFO:root:Running > ((HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Group/Read)+(HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Merge))+((HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/ExtractOutputs)+((ref_AppliedPTransform_TeamScoresDict_22)+((ref_AppliedPTransform_WriteTeamScoreSums/ConvertToRow_24)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/AppendDestination_27)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/AddInsertIds_28)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/AddRandomKeys_30)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/Map(reify_timestamps)_32)+(WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/GroupByKey/Write)))))))) > 18:05:39 INFO:root:Running > (WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/GroupByKey/Read)+(((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/FlatMap(restore_timestamps)_37)+(ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/RemoveRandomKeys_38))+(ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)_40)) > 18:05:40 bq head -n 500 $DATASET.hourly_team_score_python_$1 > 18:05:43 Did not find team scores, retry left: 2 > 18:05:58 bq head -n 500 $DATASET.hourly_team_score_python_$1 > 18:06:00 Did not find team scores, retry left: 1 > 18:06:15 bq head -n 500 $DATASET.hourly_team_score_python_$1 > 18:06:17 Did not find team scores, retry left: 0 > 18:06:32 FAILED: HourlyTeamScore example failed running on direct-runner. > Did not found scores of team AntiqueBrassPlatypus in > beam_postrelease_mobile_gaming.leader_board > 18:06:32 > ############################################################################ > 18:06:32 Validation FAILED > 18:06:32 > ############################################################################ > {code} -- This message was sent by Atlassian Jira (v8.20.1#820001)