See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1422/display/redirect?page=changes>
Changes: [ehudm] Add support for Pub/Sub messages with attributes. [ehudm] Address review comment from PR #4744. ------------------------------------------ [...truncated 95.97 KB...] 'apache-beam-testing:bqjob_r7a9e97a351df44d8_00000161ea83e270_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:19:29,223 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:19:44,757 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:19:46,884 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:02.12s, CPU:0.27s, MaxMemory:25572kb STDOUT: Upload complete. Waiting on bqjob_r62d9b4f1824e2ce2_00000161ea84280a_1 ... (0s) Current status: RUNNING Waiting on bqjob_r62d9b4f1824e2ce2_00000161ea84280a_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r62d9b4f1824e2ce2_00000161ea84280a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:19:46,885 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:20:03,482 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:20:05,706 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:02.21s, CPU:0.24s, MaxMemory:25336kb STDOUT: Upload complete. Waiting on bqjob_r6ac4c24a6739cdc2_00000161ea84712b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6ac4c24a6739cdc2_00000161ea84712b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6ac4c24a6739cdc2_00000161ea84712b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:20:05,706 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:20:26,000 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:20:33,601 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:07.59s, CPU:0.25s, MaxMemory:25528kb STDOUT: Upload complete. Waiting on bqjob_r7c65e802a601c25c_00000161ea84dca3_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7c65e802a601c25c_00000161ea84dca3_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7c65e802a601c25c_00000161ea84dca3_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:20:33,602 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:20:49,195 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:20:51,727 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:02.52s, CPU:0.24s, MaxMemory:25536kb STDOUT: Upload complete. Waiting on bqjob_r27df34aef0f19ec4_00000161ea8523b8_1 ... (0s) Current status: RUNNING Waiting on bqjob_r27df34aef0f19ec4_00000161ea8523b8_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r27df34aef0f19ec4_00000161ea8523b8_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:20:51,728 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:21:07,198 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:21:14,794 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:07.59s, CPU:0.24s, MaxMemory:25464kb STDOUT: Upload complete. Waiting on bqjob_r514a9c844176db19_00000161ea856a0d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r514a9c844176db19_00000161ea856a0d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r514a9c844176db19_00000161ea856a0d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:21:14,794 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:21:34,842 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:21:37,218 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:02.36s, CPU:0.25s, MaxMemory:25392kb STDOUT: Upload complete. Waiting on bqjob_r70e2adb1c736b057_00000161ea85d602_1 ... (0s) Current status: RUNNING Waiting on bqjob_r70e2adb1c736b057_00000161ea85d602_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r70e2adb1c736b057_00000161ea85d602_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:21:37,219 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:21:52,419 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:21:54,849 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:02.42s, CPU:0.24s, MaxMemory:25292kb STDOUT: Upload complete. Waiting on bqjob_r58db37b25eaf7bfa_00000161ea861aab_1 ... (0s) Current status: RUNNING Waiting on bqjob_r58db37b25eaf7bfa_00000161ea861aab_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r58db37b25eaf7bfa_00000161ea861aab_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:21:54,849 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:22:23,877 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:22:26,100 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:02.21s, CPU:0.24s, MaxMemory:25452kb STDOUT: Upload complete. Waiting on bqjob_r741c22f7b0691c03_00000161ea86958a_1 ... (0s) Current status: RUNNING Waiting on bqjob_r741c22f7b0691c03_00000161ea86958a_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r741c22f7b0691c03_00000161ea86958a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:22:26,101 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:22:48,084 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:22:51,390 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:03.30s, CPU:0.27s, MaxMemory:25508kb STDOUT: Upload complete. Waiting on bqjob_r58808c9cb5a7e054_00000161ea86f7fe_1 ... (0s) Current status: RUNNING Waiting on bqjob_r58808c9cb5a7e054_00000161ea86f7fe_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r58808c9cb5a7e054_00000161ea86f7fe_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:22:51,390 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:23:18,465 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:23:20,997 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:02.52s, CPU:0.24s, MaxMemory:25268kb STDOUT: Upload complete. Waiting on bqjob_r39b3aa1639c651f7_00000161ea876ac6_1 ... (0s) Current status: RUNNING Waiting on bqjob_r39b3aa1639c651f7_00000161ea876ac6_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r39b3aa1639c651f7_00000161ea876ac6_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:23:20,997 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:23:36,944 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:23:39,114 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:02.16s, CPU:0.24s, MaxMemory:25260kb STDOUT: Upload complete. Waiting on bqjob_r5d3853840ddff14b_00000161ea87b2ef_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5d3853840ddff14b_00000161ea87b2ef_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5d3853840ddff14b_00000161ea87b2ef_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:23:39,114 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:24:01,847 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:24:04,119 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:02.26s, CPU:0.23s, MaxMemory:25460kb STDOUT: Upload complete. Waiting on bqjob_r6a9285f2f9a74dbb_00000161ea881440_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6a9285f2f9a74dbb_00000161ea881440_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6a9285f2f9a74dbb_00000161ea881440_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-03 06:24:04,119 f55f603d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-03 06:24:27,094 f55f603d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json> 2018-03-03 06:24:29,647 f55f603d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f55f603d/perfkit-bq-pubdgD2JX.json}> ReturnCode:1, WallTime:0:02.54s, CPU:0.25s, MaxMemory:25388kb STDOUT: Upload complete. Waiting on bqjob_r68d657af315aabb0_00000161ea8876e4_1 ... (0s) Current status: RUNNING Waiting on bqjob_r68d657af315aabb0_00000161ea8876e4_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r68d657af315aabb0_00000161ea8876e4_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 926, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 853, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
