See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/326/display/redirect>
------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 60327674fd738221030bcba0427c5a626c967648 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 60327674fd738221030bcba0427c5a626c967648 Commit message: "Merge pull request #4950 from boyuanzz/microbenchmark" > git rev-list --no-walk 60327674fd738221030bcba0427c5a626c967648 # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_AvroIOIT] $ /bin/bash -xe /tmp/jenkins6667217920494268116.sh + rm -rf PerfKitBenchmarker [beam_PerformanceTests_AvroIOIT] $ /bin/bash -xe /tmp/jenkins2297465805326496390.sh + rm -rf .env [beam_PerformanceTests_AvroIOIT] $ /bin/bash -xe /tmp/jenkins7377557947337472726.sh + virtualenv .env --system-site-packages New python executable in .env/bin/python Installing setuptools, pip...done. [beam_PerformanceTests_AvroIOIT] $ /bin/bash -xe /tmp/jenkins8192001272666212440.sh + .env/bin/pip install --upgrade setuptools pip Downloading/unpacking setuptools from https://pypi.python.org/packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl#md5=ca299c7acd13a72e1171a3697f2b99bc Downloading/unpacking pip from https://pypi.python.org/packages/ac/95/a05b56bb975efa78d3557efa36acaf9cf5d2fd0ee0062060493687432e03/pip-9.0.3-py2.py3-none-any.whl#md5=d512ceb964f38ba31addb8142bc657cb Installing collected packages: setuptools, pip Found existing installation: setuptools 2.2 Uninstalling setuptools: Successfully uninstalled setuptools Found existing installation: pip 1.5.4 Uninstalling pip: Successfully uninstalled pip Successfully installed setuptools pip Cleaning up... [beam_PerformanceTests_AvroIOIT] $ /bin/bash -xe /tmp/jenkins3303719633904183393.sh + git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git Cloning into 'PerfKitBenchmarker'... [beam_PerformanceTests_AvroIOIT] $ /bin/bash -xe /tmp/jenkins8840699243652739281.sh + .env/bin/pip install -r PerfKitBenchmarker/requirements.txt Collecting absl-py (from -r PerfKitBenchmarker/requirements.txt (line 14)) <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings SNIMissingWarning <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecurePlatformWarning Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15)) Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16)) Collecting colorlog[windows]==2.6.0 (from -r PerfKitBenchmarker/requirements.txt (line 17)) Using cached colorlog-2.6.0-py2.py3-none-any.whl Collecting blinker>=1.3 (from -r PerfKitBenchmarker/requirements.txt (line 18)) Collecting futures>=3.0.3 (from -r PerfKitBenchmarker/requirements.txt (line 19)) Using cached futures-3.2.0-py2-none-any.whl Requirement already satisfied: PyYAML==3.12 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 20)) Collecting pint>=0.7 (from -r PerfKitBenchmarker/requirements.txt (line 21)) Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22)) Using cached numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl Requirement already satisfied: functools32 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 23)) Collecting contextlib2>=0.5.1 (from -r PerfKitBenchmarker/requirements.txt (line 24)) Using cached contextlib2-0.5.5-py2.py3-none-any.whl Collecting pywinrm (from -r PerfKitBenchmarker/requirements.txt (line 25)) Using cached pywinrm-0.3.0-py2.py3-none-any.whl Requirement already satisfied: six in /usr/local/lib/python2.7/dist-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14)) Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15)) Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17)) Collecting xmltodict (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Using cached xmltodict-0.11.0-py2.py3-none-any.whl Collecting requests-ntlm>=0.3.0 (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Using cached requests_ntlm-1.1.0-py2.py3-none-any.whl Requirement already satisfied: requests>=2.9.1 in /usr/local/lib/python2.7/dist-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Collecting ntlm-auth>=1.0.2 (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Using cached ntlm_auth-1.1.0-py2.py3-none-any.whl Collecting cryptography>=1.3 (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Using cached cryptography-2.2.2-cp27-cp27mu-manylinux1_x86_64.whl Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Collecting cffi>=1.7; platform_python_implementation != "PyPy" (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Using cached cffi-1.11.5-cp27-cp27mu-manylinux1_x86_64.whl Requirement already satisfied: enum34; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Collecting asn1crypto>=0.21.0 (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Using cached asn1crypto-0.24.0-py2.py3-none-any.whl Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Collecting pycparser (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Installing collected packages: absl-py, colorlog, blinker, futures, pint, numpy, contextlib2, xmltodict, ntlm-auth, pycparser, cffi, asn1crypto, cryptography, requests-ntlm, pywinrm Successfully installed absl-py-0.1.13 asn1crypto-0.24.0 blinker-1.4 cffi-1.11.5 colorlog-2.6.0 contextlib2-0.5.5 cryptography-2.2.2 futures-3.2.0 ntlm-auth-1.1.0 numpy-1.13.3 pint-0.8.1 pycparser-2.18 pywinrm-0.3.0 requests-ntlm-1.1.0 xmltodict-0.11.0 <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecurePlatformWarning [beam_PerformanceTests_AvroIOIT] $ /bin/bash -xe /tmp/jenkins4743501024137937183.sh + .env/bin/pip install -e 'src/sdks/python/[gcp,test]' Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/src/sdks/python> Collecting avro<2.0.0,>=1.8.1 (from apache-beam==2.5.0.dev0) <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings SNIMissingWarning <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecurePlatformWarning Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0) Collecting dill==0.2.6 (from apache-beam==2.5.0.dev0) Collecting grpcio<2,>=1.8 (from apache-beam==2.5.0.dev0) Using cached grpcio-1.10.0-cp27-cp27mu-manylinux1_x86_64.whl Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0) Collecting httplib2<0.10,>=0.8 (from apache-beam==2.5.0.dev0) Collecting mock<3.0.0,>=1.0.1 (from apache-beam==2.5.0.dev0) Using cached mock-2.0.0-py2.py3-none-any.whl Collecting oauth2client<5,>=2.0.1 (from apache-beam==2.5.0.dev0) Using cached oauth2client-4.1.2-py2.py3-none-any.whl Collecting protobuf<4,>=3.5.0.post1 (from apache-beam==2.5.0.dev0) Using cached protobuf-3.5.2.post1-cp27-cp27mu-manylinux1_x86_64.whl Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0) Using cached pytz-2018.3-py2.py3-none-any.whl Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0) Collecting pyvcf<0.7.0,>=0.6.8 (from apache-beam==2.5.0.dev0) Requirement already satisfied: six<1.12,>=1.9 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0) Collecting typing<3.7.0,>=3.6.0 (from apache-beam==2.5.0.dev0) Using cached typing-3.6.4-py2-none-any.whl Requirement already satisfied: futures<4.0.0,>=3.1.1 in ./.env/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0) Collecting google-apitools<=0.5.20,>=0.5.18 (from apache-beam==2.5.0.dev0) Using cached google_apitools-0.5.20-py2-none-any.whl Collecting proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 (from apache-beam==2.5.0.dev0) Collecting googledatastore==7.0.1 (from apache-beam==2.5.0.dev0) Collecting google-cloud-pubsub==0.26.0 (from apache-beam==2.5.0.dev0) Using cached google_cloud_pubsub-0.26.0-py2.py3-none-any.whl Collecting proto-google-cloud-pubsub-v1==0.15.4 (from apache-beam==2.5.0.dev0) Collecting google-cloud-bigquery==0.25.0 (from apache-beam==2.5.0.dev0) Using cached google_cloud_bigquery-0.25.0-py2.py3-none-any.whl Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0) Using cached nose-1.3.7-py2-none-any.whl Collecting pyhamcrest<2.0,>=1.9 (from apache-beam==2.5.0.dev0) Using cached PyHamcrest-1.9.0-py2.py3-none-any.whl Requirement already satisfied: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0) Requirement already satisfied: requests>=2.7.0 in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) Collecting funcsigs>=1; python_version < "3.3" (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0) Using cached funcsigs-1.0.2-py2.py3-none-any.whl Collecting pbr>=0.11 (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0) Using cached pbr-4.0.0-py2.py3-none-any.whl Collecting rsa>=3.1.4 (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0) Using cached rsa-3.4.2-py2.py3-none-any.whl Collecting pyasn1-modules>=0.0.5 (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0) Using cached pyasn1_modules-0.2.1-py2.py3-none-any.whl Requirement already satisfied: pyasn1>=0.1.7 in /usr/local/lib/python2.7/dist-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0) Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0) Collecting fasteners>=0.14 (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0) Using cached fasteners-0.14.1-py2.py3-none-any.whl Collecting googleapis-common-protos<2.0dev,>=1.5.2 (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0) Collecting google-cloud-core<0.26dev,>=0.25.0 (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Using cached google_cloud_core-0.25.0-py2.py3-none-any.whl Collecting gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) Collecting monotonic>=0.1 (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0) Using cached monotonic-1.4-py2.py3-none-any.whl Collecting google-auth<2.0.0dev,>=0.4.0 (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Using cached google_auth-1.4.1-py2.py3-none-any.whl Collecting google-auth-httplib2 (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Using cached google_auth_httplib2-0.0.3-py2.py3-none-any.whl Collecting google-gax<0.16dev,>=0.15.7 (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Using cached google_gax-0.15.16-py2.py3-none-any.whl Collecting grpc-google-iam-v1<0.12dev,>=0.11.1 (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Collecting cachetools>=2.0.0 (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Using cached cachetools-2.0.1-py2.py3-none-any.whl Collecting future<0.17dev,>=0.16.0 (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Collecting ply==3.8 (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) Installing collected packages: avro, dill, protobuf, grpcio, hdfs, httplib2, funcsigs, pbr, mock, rsa, pyasn1-modules, oauth2client, pytz, pyvcf, typing, monotonic, fasteners, google-apitools, googleapis-common-protos, proto-google-cloud-datastore-v1, googledatastore, cachetools, google-auth, google-auth-httplib2, google-cloud-core, future, ply, google-gax, grpc-google-iam-v1, proto-google-cloud-pubsub-v1, gapic-google-cloud-pubsub-v1, google-cloud-pubsub, google-cloud-bigquery, nose, pyhamcrest, apache-beam Running setup.py develop for apache-beam Successfully installed apache-beam avro-1.8.2 cachetools-2.0.1 dill-0.2.6 fasteners-0.14.1 funcsigs-1.0.2 future-0.16.0 gapic-google-cloud-pubsub-v1-0.15.4 google-apitools-0.5.20 google-auth-1.4.1 google-auth-httplib2-0.0.3 google-cloud-bigquery-0.25.0 google-cloud-core-0.25.0 google-cloud-pubsub-0.26.0 google-gax-0.15.16 googleapis-common-protos-1.5.3 googledatastore-7.0.1 grpc-google-iam-v1-0.11.4 grpcio-1.10.0 hdfs-2.1.0 httplib2-0.9.2 mock-2.0.0 monotonic-1.4 nose-1.3.7 oauth2client-4.1.2 pbr-4.0.0 ply-3.8 proto-google-cloud-datastore-v1-0.90.4 proto-google-cloud-pubsub-v1-0.15.4 protobuf-3.5.2.post1 pyasn1-modules-0.2.1 pyhamcrest-1.9.0 pytz-2018.3 pyvcf-0.6.8 rsa-3.4.2 typing-3.6.4 [beam_PerformanceTests_AvroIOIT] $ /bin/bash -xe /tmp/jenkins2491444713161752152.sh + .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.avroioit_pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/> --official=true --benchmarks=beam_integration_benchmark --beam_it_timeout=1200 --beam_it_profile=io-it --beam_prebuilt=true --beam_sdk=java --beam_it_module=sdks/java/io/file-based-io-tests --beam_it_class=org.apache.beam.sdk.io.avro.AvroIOIT '--beam_it_options=[--project=apache-beam-testing,--tempRoot=gs://temp-storage-for-perf-tests,--filenamePrefix=gs://temp-storage-for-perf-tests/beam_PerformanceTests_AvroIOIT/326/,--numberOfRecords=1000000]' '--beam_extra_mvn_properties=[filesystem=gcs]' 2018-04-02 00:00:37,457 9cf7387c MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/runs/9cf7387c/pkb.log> 2018-04-02 00:00:37,457 9cf7387c MainThread INFO PerfKitBenchmarker version: v1.12.0-454-g8b295f3 2018-04-02 00:00:37,458 9cf7387c MainThread INFO Flag values: --beam_extra_mvn_properties=[filesystem=gcs] --beam_it_class=org.apache.beam.sdk.io.avro.AvroIOIT --beam_it_timeout=1200 --beam_sdk=java --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/> --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --beam_it_options=[--project=apache-beam-testing,--tempRoot=gs://temp-storage-for-perf-tests,--filenamePrefix=gs://temp-storage-for-perf-tests/beam_PerformanceTests_AvroIOIT/326/,--numberOfRecords=1000000] --beam_prebuilt --project=apache-beam-testing --bigquery_table=beam_performance.avroioit_pkb_results --official --beam_it_module=sdks/java/io/file-based-io-tests --dpb_log_level=INFO --beam_it_profile=io-it --benchmarks=beam_integration_benchmark 2018-04-02 00:00:37,662 9cf7387c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo. 2018-04-02 00:00:37,663 9cf7387c MainThread INFO Initializing the edw service decoder 2018-04-02 00:00:37,737 9cf7387c MainThread INFO Benchmark run statuses: ---------------------------------------------------------------------------------- Name UID Status Failed Substatus ---------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 SKIPPED ---------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-04-02 00:00:37,738 9cf7387c MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/runs/9cf7387c/pkb.log> 2018-04-02 00:00:37,738 9cf7387c MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/runs/9cf7387c/completion_statuses.json> Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 952, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 868, in RunBenchmarks if FLAGS.run_with_pdb and FLAGS.run_processes == 1: File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/.env/local/lib/python2.7/site-packages/absl/flags/_flagvalues.py",> line 470, in __getattr__ raise AttributeError(name) AttributeError: run_with_pdb Build step 'Execute shell' marked build as failure