See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1465/display/redirect?page=changes>
Changes: [cclauss] [BEAM-1251] Fix basestring for Python 3 - again [ekirpichov] [BEAM-3741] Proto changes for splitting over Fn API [ekirpichov] Address comments ------------------------------------------ [...truncated 90.30 KB...] 'apache-beam-testing:bqjob_r4a3025115714dcd6_000001622474e622_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:21:05,535 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:21:29,826 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:21:31,932 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r34b3e81020a80cee_0000016224754d84_1 ... (0s) Current status: RUNNING Waiting on bqjob_r34b3e81020a80cee_0000016224754d84_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r34b3e81020a80cee_0000016224754d84_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:21:31,932 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:21:57,790 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:22:00,113 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r776fcff9529471a7_000001622475bb4a_1 ... (0s) Current status: RUNNING Waiting on bqjob_r776fcff9529471a7_000001622475bb4a_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r776fcff9529471a7_000001622475bb4a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:22:00,114 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:22:22,130 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:22:24,210 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r59cc2bac7c15c156_00000162247619c4_1 ... (0s) Current status: RUNNING Waiting on bqjob_r59cc2bac7c15c156_00000162247619c4_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r59cc2bac7c15c156_00000162247619c4_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:22:24,211 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:22:49,634 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:22:52,201 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4ee6ecd83e5401c2_00000162247685b1_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4ee6ecd83e5401c2_00000162247685b1_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4ee6ecd83e5401c2_00000162247685b1_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:22:52,201 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:23:09,698 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:23:13,030 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r1305a1db9eb81c1f_000001622476d38f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1305a1db9eb81c1f_000001622476d38f_1 ... (1s) Current status: RUNNING Waiting on bqjob_r1305a1db9eb81c1f_000001622476d38f_1 ... (1s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1305a1db9eb81c1f_000001622476d38f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:23:13,030 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:23:34,826 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:23:37,428 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r12662e60dd7ef510_000001622477375c_1 ... (0s) Current status: RUNNING Waiting on bqjob_r12662e60dd7ef510_000001622477375c_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r12662e60dd7ef510_000001622477375c_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:23:37,429 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:23:53,926 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:23:56,149 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r1599e45f33985be3_0000016224778137_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1599e45f33985be3_0000016224778137_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1599e45f33985be3_0000016224778137_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:23:56,150 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:24:11,246 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:24:14,243 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3bfbd2065265b3d3_000001622477c4fe_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3bfbd2065265b3d3_000001622477c4fe_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3bfbd2065265b3d3_000001622477c4fe_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:24:14,243 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:24:38,379 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:24:40,484 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r202a4352638a6198_0000016224782deb_1 ... (0s) Current status: RUNNING Waiting on bqjob_r202a4352638a6198_0000016224782deb_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r202a4352638a6198_0000016224782deb_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:24:40,485 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:25:05,173 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:25:07,240 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3f2c28385f0d5216_000001622478969d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3f2c28385f0d5216_000001622478969d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3f2c28385f0d5216_000001622478969d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:25:07,240 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:25:30,761 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:25:32,810 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r511237e66cf945d0_000001622478fa9e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r511237e66cf945d0_000001622478fa9e_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r511237e66cf945d0_000001622478fa9e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:25:32,811 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:25:52,121 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:25:54,207 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r11357ce1da119a94_0000016224794dfc_1 ... (0s) Current status: RUNNING Waiting on bqjob_r11357ce1da119a94_0000016224794dfc_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r11357ce1da119a94_0000016224794dfc_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-14 12:25:54,208 187d9b8e MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-14 12:26:17,621 187d9b8e MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json> 2018-03-14 12:26:19,778 187d9b8e MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/187d9b8e/perfkit-bq-pubXtbvYh.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r415229a6983cff98_000001622479b1a9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r415229a6983cff98_000001622479b1a9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r415229a6983cff98_000001622479b1a9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 927, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 854, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
