See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1414/display/redirect?page=changes>
Changes: [mairbek] Update SpannerIO to use Batch API. ------------------------------------------ [...truncated 94.69 KB...] 'apache-beam-testing:bqjob_r42eea8e7d47e50de_00000161e037d893_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:20:13,720 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:20:38,927 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:20:41,170 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.23s, CPU:0.26s, MaxMemory:25364kb STDOUT: Upload complete. Waiting on bqjob_r2e97785feb0e138c_00000161e0384391_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2e97785feb0e138c_00000161e0384391_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2e97785feb0e138c_00000161e0384391_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:20:41,170 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:20:56,684 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:20:59,120 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.42s, CPU:0.26s, MaxMemory:25392kb STDOUT: Upload complete. Waiting on bqjob_r3d473efcfab90ec8_00000161e03888f4_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3d473efcfab90ec8_00000161e03888f4_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3d473efcfab90ec8_00000161e03888f4_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:20:59,120 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:21:16,976 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:21:19,581 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.59s, CPU:0.24s, MaxMemory:25528kb STDOUT: Upload complete. Waiting on bqjob_r277db45981dc1c01_00000161e038d832_1 ... (0s) Current status: RUNNING Waiting on bqjob_r277db45981dc1c01_00000161e038d832_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r277db45981dc1c01_00000161e038d832_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:21:19,581 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:21:37,373 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:21:39,543 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.16s, CPU:0.25s, MaxMemory:25200kb STDOUT: Upload complete. Waiting on bqjob_r56c404f507fdac3f_00000161e03927de_1 ... (0s) Current status: RUNNING Waiting on bqjob_r56c404f507fdac3f_00000161e03927de_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r56c404f507fdac3f_00000161e03927de_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:21:39,543 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:21:55,730 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:21:58,074 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.33s, CPU:0.27s, MaxMemory:25508kb STDOUT: Upload complete. Waiting on bqjob_r2eeaf8b0afd5ab4_00000161e0396f95_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2eeaf8b0afd5ab4_00000161e0396f95_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2eeaf8b0afd5ab4_00000161e0396f95_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:21:58,074 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:22:20,023 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:22:22,236 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.20s, CPU:0.25s, MaxMemory:25336kb STDOUT: Upload complete. Waiting on bqjob_r597f9c584dfb0196_00000161e039ce79_1 ... (0s) Current status: RUNNING Waiting on bqjob_r597f9c584dfb0196_00000161e039ce79_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r597f9c584dfb0196_00000161e039ce79_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:22:22,236 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:22:50,697 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:22:52,784 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.08s, CPU:0.23s, MaxMemory:25392kb STDOUT: Upload complete. Waiting on bqjob_r36be34db61f502d3_00000161e03a4648_1 ... (0s) Current status: RUNNING Waiting on bqjob_r36be34db61f502d3_00000161e03a4648_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r36be34db61f502d3_00000161e03a4648_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:22:52,784 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:23:08,198 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:23:10,353 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.14s, CPU:0.26s, MaxMemory:25344kb STDOUT: Upload complete. Waiting on bqjob_r7fc0fde343c6ef2a_00000161e03a8aa5_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7fc0fde343c6ef2a_00000161e03a8aa5_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7fc0fde343c6ef2a_00000161e03a8aa5_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:23:10,353 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:23:38,724 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:23:41,028 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.29s, CPU:0.24s, MaxMemory:25536kb STDOUT: Upload complete. Waiting on bqjob_r127ce2b394854351_00000161e03b01fa_1 ... (0s) Current status: RUNNING Waiting on bqjob_r127ce2b394854351_00000161e03b01fa_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r127ce2b394854351_00000161e03b01fa_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:23:41,029 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:23:57,491 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:24:04,879 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:07.38s, CPU:0.24s, MaxMemory:25320kb STDOUT: Upload complete. Waiting on bqjob_r1d7b285227683cea_00000161e03b4b3f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1d7b285227683cea_00000161e03b4b3f_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1d7b285227683cea_00000161e03b4b3f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:24:04,879 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:24:24,317 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:24:26,770 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.44s, CPU:0.21s, MaxMemory:25532kb STDOUT: Upload complete. Waiting on bqjob_r6ebc4556b6e94e6f_00000161e03bb400_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6ebc4556b6e94e6f_00000161e03bb400_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6ebc4556b6e94e6f_00000161e03bb400_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:24:26,771 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:24:45,674 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:24:48,238 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.55s, CPU:0.26s, MaxMemory:25456kb STDOUT: Upload complete. Waiting on bqjob_r70d735c15dfb594a_00000161e03c077d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r70d735c15dfb594a_00000161e03c077d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r70d735c15dfb594a_00000161e03c077d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-01 06:24:48,238 ec240a45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-01 06:25:10,852 ec240a45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json> 2018-03-01 06:25:13,078 ec240a45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/ec240a45/perfkit-bq-pubqyrU9d.json}> ReturnCode:1, WallTime:0:02.22s, CPU:0.27s, MaxMemory:25536kb STDOUT: Upload complete. Waiting on bqjob_r73f90913a48afcc3_00000161e03c69d1_1 ... (0s) Current status: RUNNING Waiting on bqjob_r73f90913a48afcc3_00000161e03c69d1_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r73f90913a48afcc3_00000161e03c69d1_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 926, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 853, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
