See <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesContainer_Dataflow/143/display/redirect>
------------------------------------------ [...truncated 856.64 MB...] Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /usr/local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (0.15.4) Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (3.0.4) Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (2018.4.16) Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (1.22) Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (2.6) Collecting monotonic>=0.1 (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl Requirement already satisfied: google-auth-httplib2 in /usr/local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (0.0.3) Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /usr/local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (1.4.1) Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /usr/local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (0.15.16) Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /usr/local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (0.11.4) Requirement already satisfied: cachetools>=2.0.0 in /usr/local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (2.0.1) Requirement already satisfied: ply==3.8 in /usr/local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (3.8) Requirement already satisfied: future<0.17dev,>=0.16.0 in /usr/local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (0.16.0) Building wheels for collected packages: apache-beam, hdfs, docopt Running setup.py bdist_wheel for apache-beam: started Running setup.py bdist_wheel for apache-beam: still running... Running setup.py bdist_wheel for apache-beam: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/4b/7d/dd/a19128d4b755625dce0a4a284246bffb9f82e49379d8e9d5f5 Running setup.py bdist_wheel for hdfs: started Running setup.py bdist_wheel for hdfs: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/8c/89/59/b95e6bf2d5957541862f2cd109a052f26b61dc2fad2f04a1b4 Running setup.py bdist_wheel for docopt: started Running setup.py bdist_wheel for docopt: finished with status 'done' Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e Successfully built apache-beam hdfs docopt Installing collected packages: protobuf, grpcio, docopt, hdfs, monotonic, fasteners, google-apitools, apache-beam Found existing installation: protobuf 3.3.0 Uninstalling protobuf-3.3.0: Successfully uninstalled protobuf-3.3.0 Found existing installation: grpcio 1.3.0 Uninstalling grpcio-1.3.0: Successfully uninstalled grpcio-1.3.0 Found existing installation: google-apitools 0.5.11 Uninstalling google-apitools-0.5.11: Successfully uninstalled google-apitools-0.5.11 Successfully installed apache-beam-2.5.0.dev0 docopt-0.6.2 fasteners-0.14.1 google-apitools-0.5.20 grpcio-1.11.0 hdfs-2.1.0 monotonic-1.5 protobuf-3.5.2.post1 ---> 1fc7c3f3bd9e Removing intermediate container 419339131fdb Step 7/8 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> 3efcd6d4c287 Removing intermediate container 8cf8d8def14d Step 8/8 : ENTRYPOINT /opt/apache/beam/boot ---> Running in 6fcaebc760e4 ---> 50ba550687ba Removing intermediate container 6fcaebc760e4 Successfully built 50ba550687ba Successfully tagged us.gcr.io/apache-beam-testing/jenkins/python:20180509-163356 :beam-sdks-python-container:docker (Thread[Task worker for ':',5,main]) completed. Took 7 mins 35.004 secs. BUILD SUCCESSFUL in 9m 25s 16 actionable tasks: 14 executed, 2 up-to-date Publishing build scan... https://gradle.com/s/zkmer7j4h2hm2 # Verify it exists docker images | grep $TAG us.gcr.io/apache-beam-testing/jenkins/python 20180509-163356 50ba550687ba 1 second ago 1.59GB # Push the container gcloud docker -- push $CONTAINER The push refers to a repository [us.gcr.io/apache-beam-testing/jenkins/python] f93a17320bfa: Preparing 7480916748b5: Preparing 29983be2013f: Preparing a44c2cadb316: Preparing d447731b3029: Preparing 9e7f313a8c24: Preparing 33cd5f0643d2: Preparing cbdf08184a1e: Preparing 869f7598b187: Preparing 90b8c3cde875: Preparing fbbeadfbd3ca: Preparing 0f6f641d80ca: Preparing 76a66da94657: Preparing 0f3a12fef684: Preparing 9e7f313a8c24: Waiting 33cd5f0643d2: Waiting cbdf08184a1e: Waiting 869f7598b187: Waiting 90b8c3cde875: Waiting fbbeadfbd3ca: Waiting 0f6f641d80ca: Waiting 76a66da94657: Waiting 0f3a12fef684: Waiting 29983be2013f: Pushed d447731b3029: Pushed f93a17320bfa: Pushed 33cd5f0643d2: Pushed 9e7f313a8c24: Pushed 90b8c3cde875: Layer already exists fbbeadfbd3ca: Layer already exists 0f6f641d80ca: Layer already exists 869f7598b187: Pushed 76a66da94657: Layer already exists 0f3a12fef684: Layer already exists 7480916748b5: Pushed cbdf08184a1e: Pushed a44c2cadb316: Pushed 20180509-163356: digest: sha256:36e38a6a27dab4457dbe543d4537759bb431904b4ec6c518bf0f0641131e0aa8 size: 3279 # Run ValidatesRunner tests on Google Cloud Dataflow service echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST" >>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST . sdks/python/build/gradleenv/bin/activate # This file must be used with "source bin/activate" *from bash* # you cannot run it directly deactivate () { unset -f pydoc >/dev/null 2>&1 # reset old environment variables # ! [ -z ${VAR+_} ] returns true if VAR is declared at all if ! [ -z "${_OLD_VIRTUAL_PATH+_}" ] ; then PATH="$_OLD_VIRTUAL_PATH" export PATH unset _OLD_VIRTUAL_PATH fi if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME" export PYTHONHOME unset _OLD_VIRTUAL_PYTHONHOME fi # This should detect bash and zsh, which have a hash command that must # be called to get it to forget past commands. Without forgetting # past commands the $PATH changes we made may not be respected if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then hash -r 2>/dev/null fi if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then PS1="$_OLD_VIRTUAL_PS1" export PS1 unset _OLD_VIRTUAL_PS1 fi unset VIRTUAL_ENV if [ ! "${1-}" = "nondestructive" ] ; then # Self destruct! unset -f deactivate fi } # unset irrelevant variables deactivate nondestructive VIRTUAL_ENV="<https://builds.apache.org/job/beam_PostCommit_Python_ValidatesContainer_Dataflow/ws/src/sdks/python/build/gradleenv";> export VIRTUAL_ENV _OLD_VIRTUAL_PATH="$PATH" PATH="$VIRTUAL_ENV/bin:$PATH" export PATH # unset PYTHONHOME if set if ! [ -z "${PYTHONHOME+_}" ] ; then _OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME" unset PYTHONHOME fi if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then _OLD_VIRTUAL_PS1="$PS1" if [ "x" != x ] ; then PS1="$PS1" else PS1="(`basename \"$VIRTUAL_ENV\"`) $PS1" fi export PS1 fi basename "$VIRTUAL_ENV" # Make sure to unalias pydoc if it's already there alias pydoc 2>/dev/null >/dev/null && unalias pydoc pydoc () { python -m pydoc "$@" } # This should detect bash and zsh, which have a hash command that must # be called to get it to forget past commands. Without forgetting # past commands the $PATH changes we made may not be respected if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then hash -r 2>/dev/null fi python setup.py nosetests \ --attr ValidatesContainer \ --nocapture \ --processes=1 \ --process-timeout=900 \ --test-pipeline-options=" \ --runner=TestDataflowRunner \ --project=$PROJECT \ --worker_harness_container_image=$CONTAINER:$TAG \ --staging_location=$GCS_LOCATION/staging-validatesrunner-test \ --temp_location=$GCS_LOCATION/temp-validatesrunner-test \ --output=$GCS_LOCATION/output \ --sdk_location=$SDK_LOCATION \ --num_workers=1" python: can't open file 'setup.py': [Errno 2] No such file or directory Build step 'Execute shell' marked build as failure [Set GitHub commit status (universal)] ERROR on repos [GHRepository@3cfd0a51[description=Apache Beam,homepage=,name=beam,fork=false,size=58730,milestones={},language=Java,commits={},source=<null>,parent=<null>,responseHeaderFields={null=[HTTP/1.1 200 OK], Access-Control-Allow-Origin=[*], Access-Control-Expose-Headers=[ETag, Link, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval], Cache-Control=[private, max-age=60, s-maxage=60], Content-Encoding=[gzip], Content-Security-Policy=[default-src 'none'], Content-Type=[application/json; charset=utf-8], Date=[Wed, 09 May 2018 16:44:07 GMT], ETag=[W/"5c9d6c3689c17a1bcebc550b5488695c"], Last-Modified=[Wed, 09 May 2018 16:41:32 GMT], OkHttp-Received-Millis=[1525884247274], OkHttp-Response-Source=[NETWORK 200], OkHttp-Selected-Protocol=[http/1.1], OkHttp-Sent-Millis=[1525884246905], Referrer-Policy=[origin-when-cross-origin, strict-origin-when-cross-origin], Server=[GitHub.com], Status=[200 OK], Strict-Transport-Security=[max-age=31536000; includeSubdomains; preload], Transfer-Encoding=[chunked], Vary=[Accept, Authorization, Cookie, X-GitHub-OTP], X-Accepted-OAuth-Scopes=[repo], X-Content-Type-Options=[nosniff], X-Frame-Options=[deny], X-GitHub-Media-Type=[github.v3; format=json], X-GitHub-Request-Id=[CDFC:4F41:11813A2:258E92D:5AF32556], X-OAuth-Scopes=[admin:repo_hook, repo, repo:status], X-RateLimit-Limit=[5000], X-RateLimit-Remaining=[4969], X-RateLimit-Reset=[1525886159], X-Runtime-rack=[0.047734], X-XSS-Protection=[1; mode=block]},url=https://api.github.com/repos/apache/beam,id=50904245]] (sha:fbff3d4) with context:beam_PostCommit_Python_ValidatesContainer_Dataflow Setting commit status on GitHub for https://github.com/apache/beam/commit/fbff3d4350df04345ef08a211560d18dec1e7b35 ERROR: Build step failed with exception java.io.FileNotFoundException: https://api.github.com/repos/apache/beam/statuses/fbff3d4350df04345ef08a211560d18dec1e7b35 at com.squareup.okhttp.internal.huc.HttpURLConnectionImpl.getInputStream(HttpURLConnectionImpl.java:243) at com.squareup.okhttp.internal.huc.DelegatingHttpsURLConnection.getInputStream(DelegatingHttpsURLConnection.java:210) at com.squareup.okhttp.internal.huc.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:25) at org.kohsuke.github.Requester.parse(Requester.java:612) at org.kohsuke.github.Requester.parse(Requester.java:594) at org.kohsuke.github.Requester._to(Requester.java:272) Caused: org.kohsuke.github.GHFileNotFoundException: {"message":"Not Found","documentation_url":"https://developer.github.com/v3/repos/statuses/#create-a-status"} at org.kohsuke.github.Requester.handleApiError(Requester.java:686) at org.kohsuke.github.Requester._to(Requester.java:293) at org.kohsuke.github.Requester.to(Requester.java:234) at org.kohsuke.github.GHRepository.createCommitStatus(GHRepository.java:1075) at org.jenkinsci.plugins.github.status.GitHubCommitStatusSetter.perform(GitHubCommitStatusSetter.java:160) Caused: org.jenkinsci.plugins.github.common.CombineErrorHandler$ErrorHandlingException at org.jenkinsci.plugins.github.common.CombineErrorHandler.handle(CombineErrorHandler.java:74) at org.jenkinsci.plugins.github.status.GitHubCommitStatusSetter.perform(GitHubCommitStatusSetter.java:164) at com.cloudbees.jenkins.GitHubCommitNotifier.perform(GitHubCommitNotifier.java:151) at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690) at hudson.model.Build$BuildExecution.post2(Build.java:186) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635) at hudson.model.Run.execute(Run.java:1749) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) Build step 'Set build status on GitHub commit [deprecated]' marked build as failure Not sending mail to unregistered user sid...@google.com Not sending mail to unregistered user hero...@google.com Not sending mail to unregistered user w...@google.com Not sending mail to unregistered user mari...@mariagh.svl.corp.google.com Not sending mail to unregistered user kirpic...@google.com Not sending mail to unregistered user mair...@google.com Not sending mail to unregistered user pger...@us.ibm.com Not sending mail to unregistered user git...@alasdairhodge.co.uk Not sending mail to unregistered user aljoscha.kret...@gmail.com Not sending mail to unregistered user jasonkus...@google.com Not sending mail to unregistered user axelm...@gmail.com Not sending mail to unregistered user sweg...@google.com Not sending mail to unregistered user apill...@google.com Not sending mail to unregistered user daniel.o.program...@gmail.com Not sending mail to unregistered user ankurgoe...@gmail.com Not sending mail to unregistered user schroed...@google.com
