See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1559/display/redirect?page=changes>
Changes: [wcn] Add float support for the SDK. [ccy] [BEAM-4024] Fix AttributeError in BundleBasedDirectRunner [wcn] Add diagnostics for sinks. [wcn] Add hooks to the Go SDK. [lcwik] [BEAM-3250] Add JUnit test reporting to Jenkins. [altay] Migrate JUnit test archiving to Python Gradle build [herohde] Use WorkerBinary override in Go Dataflow ------------------------------------------ [...truncated 88.64 KB...] 'apache-beam-testing:bqjob_r2a0955745cdcd015_000001629d8305fb_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:30:34,527 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:31:01,781 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:31:04,006 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r390a56f0bc64874d_000001629d83799f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r390a56f0bc64874d_000001629d83799f_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r390a56f0bc64874d_000001629d83799f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:31:04,006 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:31:24,869 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:31:27,298 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r683b7ed549481cb6_000001629d83d49c_1 ... (0s) Current status: RUNNING Waiting on bqjob_r683b7ed549481cb6_000001629d83d49c_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r683b7ed549481cb6_000001629d83d49c_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:31:27,299 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:31:53,174 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:31:55,330 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4fb88dfbfce54044_000001629d84424f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4fb88dfbfce54044_000001629d84424f_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4fb88dfbfce54044_000001629d84424f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:31:55,330 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:32:25,177 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:32:27,354 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4ddb17e22aebb514_000001629d84bf56_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4ddb17e22aebb514_000001629d84bf56_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4ddb17e22aebb514_000001629d84bf56_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:32:27,355 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:32:52,053 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:32:54,464 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r78c7a47db1e17b7c_000001629d852852_1 ... (0s) Current status: RUNNING Waiting on bqjob_r78c7a47db1e17b7c_000001629d852852_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r78c7a47db1e17b7c_000001629d852852_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:32:54,465 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:33:10,923 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:33:12,978 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r5e3f69d1714e6c2e_000001629d85720d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5e3f69d1714e6c2e_000001629d85720d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5e3f69d1714e6c2e_000001629d85720d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:33:12,979 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:33:36,421 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:33:38,543 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r32d68d18927a926c_000001629d85d5b5_1 ... (0s) Current status: RUNNING Waiting on bqjob_r32d68d18927a926c_000001629d85d5b5_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r32d68d18927a926c_000001629d85d5b5_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:33:38,544 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:34:06,425 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:34:08,790 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r358dae657a42003a_000001629d864b7a_1 ... (0s) Current status: RUNNING Waiting on bqjob_r358dae657a42003a_000001629d864b7a_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r358dae657a42003a_000001629d864b7a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:34:08,790 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:34:37,577 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:34:39,840 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r68d50c148cb20562_000001629d86c53a_1 ... (0s) Current status: RUNNING Waiting on bqjob_r68d50c148cb20562_000001629d86c53a_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r68d50c148cb20562_000001629d86c53a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:34:39,840 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:35:07,573 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:35:09,653 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r2cf54c50c2b52133_000001629d8739b0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2cf54c50c2b52133_000001629d8739b0_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2cf54c50c2b52133_000001629d8739b0_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:35:09,653 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:35:30,917 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:35:33,250 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4fb99fafd3ccc286_000001629d879567_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4fb99fafd3ccc286_000001629d879567_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4fb99fafd3ccc286_000001629d879567_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:35:33,251 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:35:52,209 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:35:54,609 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3931484b9211e808_000001629d87e8c9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3931484b9211e808_000001629d87e8c9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3931484b9211e808_000001629d87e8c9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-07 00:35:54,610 f1126adb MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-07 00:36:16,301 f1126adb MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json> 2018-04-07 00:36:18,935 f1126adb MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/f1126adb/perfkit-bq-pub4QRdPb.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r6765d1b4e3d29320_000001629d884784_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6765d1b4e3d29320_000001629d884784_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6765d1b4e3d29320_000001629d884784_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 952, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 879, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 927, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
