See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1482/display/redirect?page=changes>
Changes: [lcwik] [BEAM-3249, BEAM-3457] Make Apache Rat a dependency of the Java and [lcwik] [BEAM-3457] Exclude generated and data files part of the Go SDK. ------------------------------------------ [...truncated 91.13 KB...] 'apache-beam-testing:bqjob_r3312ab4414545cb6_000001623a560f00_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:19:03,101 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:19:19,157 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:19:21,268 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r564e800ca4b5e908_000001623a5655ef_1 ... (0s) Current status: RUNNING Waiting on bqjob_r564e800ca4b5e908_000001623a5655ef_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r564e800ca4b5e908_000001623a5655ef_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:19:21,269 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:19:44,754 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:19:46,910 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r599d6e002a40ba8d_000001623a56b9ed_1 ... (0s) Current status: RUNNING Waiting on bqjob_r599d6e002a40ba8d_000001623a56b9ed_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r599d6e002a40ba8d_000001623a56b9ed_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:19:46,911 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:20:11,083 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:20:13,230 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r32ded29806ac6cf0_000001623a5720c8_1 ... (0s) Current status: RUNNING Waiting on bqjob_r32ded29806ac6cf0_000001623a5720c8_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r32ded29806ac6cf0_000001623a5720c8_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:20:13,230 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:20:37,106 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:20:39,147 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r36517bbf32a5868f_000001623a578670_1 ... (0s) Current status: RUNNING Waiting on bqjob_r36517bbf32a5868f_000001623a578670_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r36517bbf32a5868f_000001623a578670_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:20:39,148 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:21:08,855 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:21:11,075 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r6bfbfd26115d6d02_000001623a580289_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6bfbfd26115d6d02_000001623a580289_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6bfbfd26115d6d02_000001623a580289_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:21:11,076 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:21:33,485 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:21:36,228 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r19a41e4cec7028ed_000001623a5862b3_1 ... (0s) Current status: RUNNING Waiting on bqjob_r19a41e4cec7028ed_000001623a5862b3_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r19a41e4cec7028ed_000001623a5862b3_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:21:36,229 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:21:53,722 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:21:55,677 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r5c6e1e05bee20f4c_000001623a58b1c7_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5c6e1e05bee20f4c_000001623a58b1c7_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5c6e1e05bee20f4c_000001623a58b1c7_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:21:55,678 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:22:22,925 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:22:25,263 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r390697af519584bd_000001623a5923fa_1 ... (0s) Current status: RUNNING Waiting on bqjob_r390697af519584bd_000001623a5923fa_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r390697af519584bd_000001623a5923fa_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:22:25,263 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:22:54,058 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:22:56,109 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r6cfda9dd744d61bb_000001623a599d72_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6cfda9dd744d61bb_000001623a599d72_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6cfda9dd744d61bb_000001623a599d72_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:22:56,109 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:23:15,757 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:23:17,826 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3e18a5e336b38529_000001623a59f240_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3e18a5e336b38529_000001623a59f240_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3e18a5e336b38529_000001623a59f240_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:23:17,826 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:23:42,536 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:23:44,505 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r17531fbe5d0d84bf_000001623a5a5ac1_1 ... (0s) Current status: RUNNING Waiting on bqjob_r17531fbe5d0d84bf_000001623a5a5ac1_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r17531fbe5d0d84bf_000001623a5a5ac1_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:23:44,505 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:24:13,662 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:24:15,894 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_rb4ea3fda5d4ac51_000001623a5ad45b_1 ... (0s) Current status: RUNNING Waiting on bqjob_rb4ea3fda5d4ac51_000001623a5ad45b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_rb4ea3fda5d4ac51_000001623a5ad45b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-18 18:24:15,894 c013ea8b MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-18 18:24:31,813 c013ea8b MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json> 2018-03-18 18:24:33,888 c013ea8b MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c013ea8b/perfkit-bq-pubwVoTtH.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7210b453d03067a8_000001623a5b1b3e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7210b453d03067a8_000001623a5b1b3e_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7210b453d03067a8_000001623a5b1b3e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 927, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 854, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure