See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1457/display/redirect?page=changes>
Changes: [kedin] [SQL] Support nested Rows ------------------------------------------ [...truncated 96.31 KB...] 'apache-beam-testing:bqjob_r6b7dfa17436355f9_0000016217943286_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:20:12,870 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:20:30,544 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:20:32,731 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.18s, CPU:0.33s, MaxMemory:25420kb STDOUT: Upload complete. Waiting on bqjob_r4c20448125fc6c11_0000016217948017_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4c20448125fc6c11_0000016217948017_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4c20448125fc6c11_0000016217948017_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:20:32,731 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:20:49,592 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:20:51,795 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.19s, CPU:0.31s, MaxMemory:25272kb STDOUT: Upload complete. Waiting on bqjob_r7025acbff06cfba5_000001621794ca76_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7025acbff06cfba5_000001621794ca76_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7025acbff06cfba5_000001621794ca76_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:20:51,796 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:21:14,757 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:21:16,976 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.21s, CPU:0.31s, MaxMemory:25308kb STDOUT: Upload complete. Waiting on bqjob_r4b56a9fab4354c54_0000016217952ccb_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4b56a9fab4354c54_0000016217952ccb_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4b56a9fab4354c54_0000016217952ccb_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:21:16,977 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:21:41,946 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:21:44,035 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.07s, CPU:0.27s, MaxMemory:25272kb STDOUT: Upload complete. Waiting on bqjob_r45e3bf26b654250d_00000162179596f0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r45e3bf26b654250d_00000162179596f0_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r45e3bf26b654250d_00000162179596f0_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:21:44,035 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:22:08,458 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:22:10,677 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.21s, CPU:0.26s, MaxMemory:25288kb STDOUT: Upload complete. Waiting on bqjob_r72efdb94efad36b0_000001621795fe6c_1 ... (0s) Current status: RUNNING Waiting on bqjob_r72efdb94efad36b0_000001621795fe6c_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r72efdb94efad36b0_000001621795fe6c_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:22:10,678 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:22:27,307 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:22:29,544 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.22s, CPU:0.26s, MaxMemory:25552kb STDOUT: Upload complete. Waiting on bqjob_r3344c76d873f9bc_0000016217964805_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3344c76d873f9bc_0000016217964805_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3344c76d873f9bc_0000016217964805_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:22:29,544 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:22:45,670 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:22:47,870 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.19s, CPU:0.27s, MaxMemory:25232kb STDOUT: Upload complete. Waiting on bqjob_r447abc48f71591a0_0000016217968fcc_1 ... (0s) Current status: RUNNING Waiting on bqjob_r447abc48f71591a0_0000016217968fcc_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r447abc48f71591a0_0000016217968fcc_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:22:47,871 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:23:14,570 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:23:16,682 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.10s, CPU:0.26s, MaxMemory:25228kb STDOUT: Upload complete. Waiting on bqjob_r5ac1d6d199fc05b2_0000016217970096_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5ac1d6d199fc05b2_0000016217970096_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5ac1d6d199fc05b2_0000016217970096_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:23:16,682 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:23:36,733 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:23:38,704 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:01.96s, CPU:0.24s, MaxMemory:25276kb STDOUT: Upload complete. Waiting on bqjob_r2c02b34bced5507f_0000016217975727_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2c02b34bced5507f_0000016217975727_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2c02b34bced5507f_0000016217975727_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:23:38,705 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:24:00,143 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:24:02,457 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.30s, CPU:0.24s, MaxMemory:25352kb STDOUT: Upload complete. Waiting on bqjob_r79ba5c1f54bf58e9_000001621797b297_1 ... (0s) Current status: RUNNING Waiting on bqjob_r79ba5c1f54bf58e9_000001621797b297_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r79ba5c1f54bf58e9_000001621797b297_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:24:02,458 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:24:22,118 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:24:24,231 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.10s, CPU:0.23s, MaxMemory:25500kb STDOUT: Upload complete. Waiting on bqjob_r5afc5773a6a59c96_000001621798088b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5afc5773a6a59c96_000001621798088b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5afc5773a6a59c96_000001621798088b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:24:24,231 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:24:41,062 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:24:43,337 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.26s, CPU:0.24s, MaxMemory:25468kb STDOUT: Upload complete. Waiting on bqjob_r44cef9034bb2eefa_00000162179852ed_1 ... (0s) Current status: RUNNING Waiting on bqjob_r44cef9034bb2eefa_00000162179852ed_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r44cef9034bb2eefa_00000162179852ed_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-12 00:24:43,337 6abfc60c MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-12 00:25:00,746 6abfc60c MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json> 2018-03-12 00:25:02,902 6abfc60c MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6abfc60c/perfkit-bq-pubOFObEd.json}> ReturnCode:1, WallTime:0:02.14s, CPU:0.24s, MaxMemory:25524kb STDOUT: Upload complete. Waiting on bqjob_r3bbe848ba1aa0b3f_0000016217989f53_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3bbe848ba1aa0b3f_0000016217989f53_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3bbe848ba1aa0b3f_0000016217989f53_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 926, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 853, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
