See <https://builds.apache.org/job/beam_PerformanceTests_Python/1188/display/redirect?page=changes>
Changes: [tgroh] Stop implementing EvaluatorFactory in Registry [aromanenko.dev] [BEAM-4066] Moved anonymous classes into inner ones [sidhom] [BEAM-4149] Set worker id to "" if it is not set in the request header [sidhom] [BEAM-3327] Refactor ControlClientPool to allow client multiplexing [sidhom] [BEAM-3327] Basic Docker environment factory [iemejia] [BEAM-4018] Add a ByteKeyRangeTracker based on RestrictionTracker for ------------------------------------------ [...truncated 13.13 KB...] Downloading https://files.pythonhosted.org/packages/0d/4d/4e5985d075d241d686a1663fa1f88b61d544658d08c1375c7c6aac32afc3/typing-3.6.4-py2-none-any.whl Requirement already satisfied: futures<4.0.0,>=3.1.1 in ./.env/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0) (3.2.0) Collecting google-apitools<=0.5.20,>=0.5.18 (from apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/1d/0c/64f84f91643f775fdb64c6c10f4a4f0d827f8b0d98a2ba2b4bb9dc2f8646/google_apitools-0.5.20-py2-none-any.whl (330kB) Collecting proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 (from apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/2a/1f/4124f15e1132a2eeeaf616d825990bb1d395b4c2c37362654ea5cd89bb42/proto-google-cloud-datastore-v1-0.90.4.tar.gz Collecting googledatastore==7.0.1 (from apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/73/d0/17ce873331aaf529ab238464a15fd7bdc1ba8d2c684789970a7fa8b505a8/googledatastore-7.0.1.tar.gz Collecting google-cloud-pubsub==0.26.0 (from apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/37/92/c74a643126d58505daec9addf872dfaffea3305981b90cc435f4b9213cdd/google_cloud_pubsub-0.26.0-py2.py3-none-any.whl Collecting proto-google-cloud-pubsub-v1==0.15.4 (from apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/c0/a2/2eeffa0069830f00016196dfdd69491cf562372b5353f2e8e378b3c2cb0a/proto-google-cloud-pubsub-v1-0.15.4.tar.gz Collecting google-cloud-bigquery==0.25.0 (from apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/76/67/6165c516ff6ceaa62eb61f11d8451e1b0acc4d3775e181630aba9652babb/google_cloud_bigquery-0.25.0-py2.py3-none-any.whl (41kB) Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154kB) Collecting pyhamcrest<2.0,>=1.9 (from apache-beam==2.5.0.dev0) Using cached https://files.pythonhosted.org/packages/9a/d5/d37fd731b7d0e91afcc84577edeccf4638b4f9b82f5ffe2f8b62e2ddc609/PyHamcrest-1.9.0-py2.py3-none-any.whl Requirement already satisfied: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0) (1.1.6) Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (0.6.2) Requirement already satisfied: requests>=2.7.0 in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (2.18.4) Requirement already satisfied: pbr>=0.11 in /usr/lib/python2.7/dist-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0) (1.8.0) Collecting funcsigs>=1; python_version < "3.3" (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0) Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl Requirement already satisfied: pyasn1>=0.1.7 in /usr/local/lib/python2.7/dist-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0) (0.4.2) Collecting pyasn1-modules>=0.0.5 (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0) Using cached https://files.pythonhosted.org/packages/e9/51/bcd96bf6231d4b2cc5e023c511bee86637ba375c44a6f9d1b4b7ad1ce4b9/pyasn1_modules-0.2.1-py2.py3-none-any.whl Collecting rsa>=3.1.4 (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0) Using cached https://files.pythonhosted.org/packages/e1/ae/baedc9cb175552e95f3395c43055a6a5e125ae4d48a1d7a924baca83e92e/rsa-3.4.2-py2.py3-none-any.whl Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0) (39.0.1) Collecting fasteners>=0.14 (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/14/3a/096c7ad18e102d4f219f5dd15951f9728ca5092a3385d2e8f79a7c1e1017/fasteners-0.14.1-py2.py3-none-any.whl Collecting googleapis-common-protos<2.0dev,>=1.5.2 (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/00/03/d25bed04ec8d930bcfa488ba81a2ecbf7eb36ae3ffd7e8f5be0d036a89c9/googleapis-common-protos-1.5.3.tar.gz Collecting gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/bc/a7/0225bd7a95e037a0afa90b2dd9534d0c79cd62283a5bddb30a3197579cbc/gapic-google-cloud-pubsub-v1-0.15.4.tar.gz Collecting google-cloud-core<0.26dev,>=0.25.0 (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/ef/dd/00e90bd1f6788f06ca5ea83a0ec8dd76350b38303bb8f09d2bf692eb1294/google_cloud_core-0.25.0-py2.py3-none-any.whl (52kB) Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (2018.4.16) Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (3.0.4) Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (2.6) Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (1.22) Collecting monotonic>=0.1 (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/9f/ff/68860dec8b90424028ca54df8b9fc8cd1c47ef58710bd5e591ec8c619243/monotonic-1.4-py2.py3-none-any.whl Collecting google-gax<0.16dev,>=0.15.7 (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/4f/b4/ff312fa42f91535c67567c1d08e972db0e7c548e9a63c6f3bcc5213b32fc/google_gax-0.15.16-py2.py3-none-any.whl (46kB) Collecting grpc-google-iam-v1<0.12dev,>=0.11.1 (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/9b/28/f26f67381cb23e81271b8d66c00a846ad9d25a909ae1ae1df8222fad2744/grpc-google-iam-v1-0.11.4.tar.gz Collecting google-auth-httplib2 (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/33/49/c814d6d438b823441552198f096fcd0377fd6c88714dbed34f1d3c8c4389/google_auth_httplib2-0.0.3-py2.py3-none-any.whl Collecting google-auth<2.0.0dev,>=0.4.0 (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/e0/18/e282ecb28c7eb0ef5ea9a69fb3290658a9ab37bb69647f6ba7f0f78987c4/google_auth-1.4.1-py2.py3-none-any.whl (65kB) Collecting ply==3.8 (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/96/e0/430fcdb6b3ef1ae534d231397bee7e9304be14a47a267e82ebcb3323d0b5/ply-3.8.tar.gz (157kB) Collecting future<0.17dev,>=0.16.0 (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/00/2b/8d082ddfed935f3608cc61140df6dcbf0edea1bc3ab52fb6c29ae3e81e85/future-0.16.0.tar.gz (824kB) Collecting cachetools>=2.0.0 (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Downloading https://files.pythonhosted.org/packages/ac/e8/5492fd5ada0b05a1bc485bcb634b559acdec59383eef5c4203b5e22be296/cachetools-2.0.1-py2.py3-none-any.whl Building wheels for collected packages: avro, dill, hdfs, httplib2, pyvcf, proto-google-cloud-datastore-v1, googledatastore, proto-google-cloud-pubsub-v1, googleapis-common-protos, gapic-google-cloud-pubsub-v1, grpc-google-iam-v1, ply, future Running setup.py bdist_wheel for avro: started Running setup.py bdist_wheel for avro: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/bf/0b/75/1b3517b7d36ddc8ba5d22c0df5eb01e83979f34420066d643e Running setup.py bdist_wheel for dill: started Running setup.py bdist_wheel for dill: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/17/74/0a/250b442a5196d5c0d80f7d4259a0a26a9c9af0e6b0ee98a335 Running setup.py bdist_wheel for hdfs: started Running setup.py bdist_wheel for hdfs: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/8c/89/59/b95e6bf2d5957541862f2cd109a052f26b61dc2fad2f04a1b4 Running setup.py bdist_wheel for httplib2: started Running setup.py bdist_wheel for httplib2: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/36/f2/49/5adbf90fba31e02a7784e1147d7f8b6c4af3718739e568c8cb Running setup.py bdist_wheel for pyvcf: started Running setup.py bdist_wheel for pyvcf: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/81/91/41/3272543c0b9c61da9c525f24ee35bae6fe8f60d4858c66805d Running setup.py bdist_wheel for proto-google-cloud-datastore-v1: started Running setup.py bdist_wheel for proto-google-cloud-datastore-v1: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/bd/ce/33/8b769968db3761c42c7a91d8a0dbbafc50acfa0750866c8abd Running setup.py bdist_wheel for googledatastore: started Running setup.py bdist_wheel for googledatastore: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/93/fa/12/99c490525fff40bcd240504f694bd02848479bc2debc31daae Running setup.py bdist_wheel for proto-google-cloud-pubsub-v1: started Running setup.py bdist_wheel for proto-google-cloud-pubsub-v1: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/d1/0d/9e/95e7192ab2625847ac40b2bc618800bf5b6c984cd572a83314 Running setup.py bdist_wheel for googleapis-common-protos: started Running setup.py bdist_wheel for googleapis-common-protos: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/62/45/af/649bbf07b6595fda010be1bda667cd56d0444d07afc6f8b687 Running setup.py bdist_wheel for gapic-google-cloud-pubsub-v1: started Running setup.py bdist_wheel for gapic-google-cloud-pubsub-v1: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/f4/2b/10/bdcbc9be2ae4e437232e118056f026025cf2cc46d6dcf0d69d Running setup.py bdist_wheel for grpc-google-iam-v1: started Running setup.py bdist_wheel for grpc-google-iam-v1: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/b6/c6/31/c20321a5a3fde456fc375b7c2814135e6e98bc0d74c40239d9 Running setup.py bdist_wheel for ply: started Running setup.py bdist_wheel for ply: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/f2/21/c0/f0056cc96847933daa961a19eb59a2ecd0228fdbe3376e7a68 Running setup.py bdist_wheel for future: started Running setup.py bdist_wheel for future: finished with status 'done' Stored in directory: /home/jenkins/.cache/pip/wheels/bf/c9/a3/c538d90ef17cf7823fa51fc701a7a7a910a80f6a405bf15b1a Successfully built avro dill hdfs httplib2 pyvcf proto-google-cloud-datastore-v1 googledatastore proto-google-cloud-pubsub-v1 googleapis-common-protos gapic-google-cloud-pubsub-v1 grpc-google-iam-v1 ply future gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible. proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible. proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible. googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible. Installing collected packages: avro, dill, protobuf, grpcio, hdfs, httplib2, funcsigs, mock, pyasn1-modules, rsa, oauth2client, pytz, pyvcf, typing, monotonic, fasteners, google-apitools, googleapis-common-protos, proto-google-cloud-datastore-v1, googledatastore, ply, future, cachetools, google-auth, google-gax, proto-google-cloud-pubsub-v1, grpc-google-iam-v1, gapic-google-cloud-pubsub-v1, google-auth-httplib2, google-cloud-core, google-cloud-pubsub, google-cloud-bigquery, nose, pyhamcrest, apache-beam Running setup.py develop for apache-beam Successfully installed apache-beam avro-1.8.2 cachetools-2.0.1 dill-0.2.6 fasteners-0.14.1 funcsigs-1.0.2 future-0.16.0 gapic-google-cloud-pubsub-v1-0.15.4 google-apitools-0.5.20 google-auth-1.4.1 google-auth-httplib2-0.0.3 google-cloud-bigquery-0.25.0 google-cloud-core-0.25.0 google-cloud-pubsub-0.26.0 google-gax-0.15.16 googleapis-common-protos-1.5.3 googledatastore-7.0.1 grpc-google-iam-v1-0.11.4 grpcio-1.11.0 hdfs-2.1.0 httplib2-0.9.2 mock-2.0.0 monotonic-1.4 nose-1.3.7 oauth2client-4.1.2 ply-3.8 proto-google-cloud-datastore-v1-0.90.4 proto-google-cloud-pubsub-v1-0.15.4 protobuf-3.5.2.post1 pyasn1-modules-0.2.1 pyhamcrest-1.9.0 pytz-2018.4 pyvcf-0.6.8 rsa-3.4.2 typing-3.6.4 [beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins5292819246503380425.sh + .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output 2018-04-24 18:01:50,754 2d61a523 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/2d61a523/pkb.log> 2018-04-24 18:01:50,755 2d61a523 MainThread INFO PerfKitBenchmarker version: v1.12.0-511-g5db1fe4 2018-04-24 18:01:50,755 2d61a523 MainThread INFO Flag values: --beam_sdk=python --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --project=apache-beam-testing --bigquery_table=beam_performance.pkb_results --official --dpb_log_level=INFO --benchmarks=beam_integration_benchmark 2018-04-24 18:01:50,992 2d61a523 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo. 2018-04-24 18:01:50,992 2d61a523 MainThread INFO Initializing the edw service decoder 2018-04-24 18:01:51,141 2d61a523 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark 2018-04-24 18:01:51,144 2d61a523 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark 2018-04-24 18:01:51,144 2d61a523 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git 2018-04-24 18:01:56,361 2d61a523 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner 2018-04-24 18:22:48,174 2d61a523 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark 2018-04-24 18:22:48,192 2d61a523 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/2d61a523/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz> 2018-04-24 18:22:48,415 2d61a523 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/2d61a523/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1 STDOUT: STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0' normalized_version, usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...] or: setup.py --help [cmd1 cmd2 ...] or: setup.py --help-commands or: setup.py cmd --help error: invalid command 'nosetests' 2018-04-24 18:22:48,416 2d61a523 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 646, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-04-24 18:22:48,417 2d61a523 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-04-24 18:22:48,418 2d61a523 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 780, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 646, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-04-24 18:22:48,419 2d61a523 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-04-24 18:22:48,436 2d61a523 MainThread INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-04-24 18:22:48,437 2d61a523 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/2d61a523/pkb.log> 2018-04-24 18:22:48,437 2d61a523 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/2d61a523/completion_statuses.json> Build step 'Execute shell' marked build as failure Not sending mail to unregistered user hero...@google.com Not sending mail to unregistered user k...@google.com Not sending mail to unregistered user amyrv...@google.com Not sending mail to unregistered user valen...@google.com Not sending mail to unregistered user da...@getindata.com Not sending mail to unregistered user geet.kuma...@gmail.com Not sending mail to unregistered user pawel.pk.kaczmarc...@gmail.com Not sending mail to unregistered user lukasz.gaj...@polidea.com Not sending mail to unregistered user bat...@batbat-linuxworkstation.sea.corp.google.com Not sending mail to unregistered user holdenka...@google.com Not sending mail to unregistered user samuel.waggo...@healthsparq.com Not sending mail to unregistered user z...@giggles.nyc.corp.google.com Not sending mail to unregistered user mark...@google.com Not sending mail to unregistered user grzegorz.kolakow...@getindata.com Not sending mail to unregistered user w...@google.com Not sending mail to unregistered user daniel.o.program...@gmail.com Not sending mail to unregistered user mari...@google.com Not sending mail to unregistered user sweg...@google.com Not sending mail to unregistered user j...@nanthrax.net Not sending mail to unregistered user xumingmi...@gmail.com Not sending mail to unregistered user arost...@google.com Not sending mail to unregistered user sdus...@google.com Not sending mail to unregistered user ankurgoe...@gmail.com Not sending mail to unregistered user rob...@frantil.com Not sending mail to unregistered user dariusz.aniszew...@polidea.com Not sending mail to unregistered user eh...@google.com Not sending mail to unregistered user owenzhang1...@gmail.com Not sending mail to unregistered user xuming...@users.noreply.github.com Not sending mail to unregistered user aromanenko....@gmail.com Not sending mail to unregistered user ke...@google.com Not sending mail to unregistered user apill...@google.com Not sending mail to unregistered user arnaudfournier...@gmail.com Not sending mail to unregistered user bbassingthwa...@vendasta.com Not sending mail to unregistered user 1147435+chua...@users.noreply.github.com Not sending mail to unregistered user fjetum...@gmail.com Not sending mail to unregistered user jiang...@gmail.com Not sending mail to unregistered user rezaro...@google.com Not sending mail to unregistered user mair...@google.com Not sending mail to unregistered user ni...@google.com Not sending mail to unregistered user axelm...@gmail.com Not sending mail to unregistered user luke_...@brown.edu Not sending mail to unregistered user swegn...@gmail.com Not sending mail to unregistered user joey.bar...@gmail.com Not sending mail to unregistered user mari...@mariagh.svl.corp.google.com Not sending mail to unregistered user zhouha...@meituan.com Not sending mail to unregistered user dcava...@google.com Not sending mail to unregistered user kirpic...@google.com Not sending mail to unregistered user wi...@bounceexchange.com Not sending mail to unregistered user samu...@google.com Not sending mail to unregistered user timrobertson...@gmail.com Not sending mail to unregistered user g...@telligent-data.com Not sending mail to unregistered user djiofack...@gmail.com Not sending mail to unregistered user alan.myrv...@comcast.net Not sending mail to unregistered user ro...@frantil.com Not sending mail to unregistered user c...@google.com Not sending mail to unregistered user re...@relax-macbookpro2.roam.corp.google.com Not sending mail to unregistered user git...@alasdairhodge.co.uk Not sending mail to unregistered user ekirpic...@gmail.com Not sending mail to unregistered user sho...@google.com Not sending mail to unregistered user 7542791+rezaro...@users.noreply.github.com Not sending mail to unregistered user aljoscha.kret...@gmail.com Not sending mail to unregistered user meliss...@google.com Not sending mail to unregistered user sid...@google.com Not sending mail to unregistered user andreas.ehrencr...@velik.it Not sending mail to unregistered user abhyan...@gmail.com Not sending mail to unregistered user aal...@gmail.com Not sending mail to unregistered user ccla...@bluewin.ch Not sending mail to unregistered user 1028332...@qq.com Not sending mail to unregistered user mott...@gmail.com Not sending mail to unregistered user arnaudfournier...@gmail.com Not sending mail to unregistered user szewi...@gmail.com Not sending mail to unregistered user yifan...@yifanzou-linuxworkstation.sea.corp.google.com Not sending mail to unregistered user wtan...@yahoo.com Not sending mail to unregistered user boyu...@google.com