[
https://issues.apache.org/jira/browse/BEAM-5340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16729928#comment-16729928
]
Andrew Pilloud commented on BEAM-5340:
--------------------------------------
https://builds.apache.org/job/beam_PostCommit_Python_Verify/6927/consoleFull
{code}
16:49:54 ======================================================================
16:49:54 ERROR: test_big_query_legacy_sql
(apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT)
16:49:54 ----------------------------------------------------------------------
16:49:54 Traceback (most recent call last):
16:49:54 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_it_test.py",
line 135, in test_big_query_legacy_sql
16:49:54 big_query_query_to_table_pipeline.run_bq_pipeline(options)
16:49:54 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py",
line 67, in run_bq_pipeline
16:49:54 result = p.run()
16:49:54 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/testing/test_pipeline.py",
line 107, in run
16:49:54 else test_runner_api))
16:49:54 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/pipeline.py",
line 418, in run
16:49:54 return self.runner.run_pipeline(self, self._options)
16:49:54 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",
line 64, in run_pipeline
16:49:54 self.result.wait_until_finish(duration=wait_duration)
16:49:54 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",
line 1198, in wait_until_finish
16:49:54 (self.state, getattr(self._runner, 'last_error_msg', None)), self)
16:49:54 DataflowRuntimeException: Dataflow pipeline failed. State: FAILED,
Error:
16:49:54 A setup error was detected in
beamapp-jenkins-122700170-12261617-sw83-harness-6vvs. Please refer to the
worker-startup log for detailed information.
{code}
https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-12-26_16_17_11-11287021941018347296?project=apache-beam-testing
{code}
A setup error was detected in
beamapp-jenkins-122700170-12261617-sw83-harness-6vvs. Please refer to the
worker-startup log for detailed information.
{code}
https://pantheon.corp.google.com/logs/viewer?resource=dataflow_step%2Fjob_id%2F2018-12-26_16_17_11-11287021941018347296&interval=NO_LIMIT&project=apache-beam-testing&minLogLevel=0&expandAll=false×tamp=2018-12-27T22:55:34.655000000Z&customFacets=&limitCustomFacetWidth=true&scrollTimestamp=2018-12-27T00:20:41.491255000Z
{code}
jsonPayload: {
line: "boot.go:145"
message: "Failed to install packages: failed to install SDK: exit status 1"
}
{code}
> [beam_PostCommit_Python_Verify][test_hourly_team_score_it][Flake] Failed to
> install packages
> --------------------------------------------------------------------------------------------
>
> Key: BEAM-5340
> URL: https://issues.apache.org/jira/browse/BEAM-5340
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Mikhail Gryzykhin
> Assignee: Ahmet Altay
> Priority: Major
>
> boot.go failed to install SDK.
> Failing job url:
> [https://builds.apache.org/job/beam_PostCommit_Python_Verify/5920/]
> Relevant log:
> Stackdriver logs:
>
> [https://pantheon.corp.google.com/logs/viewer?resource=dataflow_step%2Fjob_id%2F2018-09-07_11_04_49-10526452128675467543&logName=projects%2Fapache-beam-testing%2Flogs%2Fdataflow.googleapis.com%252Fworker-startup&interval=NO_LIMIT&project=apache-beam-testing&minLogLevel=500&expandAll=false×tamp=2018-09-07T19:12:48.643000000Z&customFacets=&limitCustomFacetWidth=true&scrollTimestamp=2018-09-07T18:13:26.584160000Z&dateRangeUnbound=forwardInTime]
>
> +Worker startup:+
> Installing setup packages ...
> Executing: /usr/local/bin/pip install
> /var/opt/google/dataflow/dataflow_python_sdk.tar[gcp]
> Traceback (most recent call last):
> File "/usr/local/bin/pip", line 7, in <module>
> from pip._internal import main
> ImportError : No module named pip._internal
> /usr/local/bin/pip failed with exit status 1
> Dataflow base path override: [https://dataflow.googleapis.com/]
>
> 2018-09-07 11:12:47.377 PDTFailed to install packages: failed to install SDK:
> exit status 1
> {
> insertId: "237402094728839677:887122:0:16965"
> jsonPayload:
> { line: "boot.go:145" message: "Failed to install packages: failed to
> install SDK: exit status 1" }
> labels:
> { compute.googleapis.com/resource_id: "237402094728839677"
> compute.googleapis.com/resource_name:
> "beamapp-jenkins-090718044-09071104-8yaz-harness-dzk6"
> compute.googleapis.com/resource_type: "instance"
> dataflow.googleapis.com/job_id: "2018-09-07_11_04_49-10526452128675467543"
> dataflow.googleapis.com/job_name: "beamapp-jenkins-0907180442-302722"
> dataflow.googleapis.com/region: "us-central1" }
> logName:
> "projects/apache-beam-testing/logs/dataflow.googleapis.com%2Fworker-startup"
> receiveTimestamp: "2018-09-07T18:12:49.639606153Z"
> resource: {
> labels:
> { job_id: "2018-09-07_11_04_49-10526452128675467543" job_name:
> "beamapp-jenkins-0907180442-302722" project_id: "apache-beam-testing"
> region: "us-central1" step_id: "" }
> type: "dataflow_step" }
> severity: "CRITICAL"
> timestamp: "2018-09-07T18:12:47.377871Z" }
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
