See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1520/display/redirect?page=changes>
Changes: [herohde] Migrate container instructions and builds to Gradle [rober] Go SDK usercounters [herohde] CR: added comments to container helper function [herohde] CR: make containerImageName take named parameters [ccy] Revert #4781 which broke Python postsubmits ------------------------------------------ [...truncated 93.21 KB...] 'apache-beam-testing:bqjob_r6706ee1c4baded35_000001626b432e6f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:19:49,504 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:20:13,162 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:20:15,503 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4f93846f09d16075_000001626b439359_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4f93846f09d16075_000001626b439359_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4f93846f09d16075_000001626b439359_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:20:15,503 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:20:32,730 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:20:34,982 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r52c45a86f5af7c65_000001626b43dfa1_1 ... (0s) Current status: RUNNING Waiting on bqjob_r52c45a86f5af7c65_000001626b43dfa1_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r52c45a86f5af7c65_000001626b43dfa1_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:20:34,982 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:20:50,346 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:20:52,630 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r19a46750d367944f_000001626b44249c_1 ... (0s) Current status: RUNNING Waiting on bqjob_r19a46750d367944f_000001626b44249c_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r19a46750d367944f_000001626b44249c_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:20:52,631 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:21:18,574 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:21:20,822 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3e772f5b9a568163_000001626b4492ea_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3e772f5b9a568163_000001626b4492ea_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3e772f5b9a568163_000001626b4492ea_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:21:20,823 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:21:48,479 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:21:50,803 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7f9e24570e4587e2_000001626b4507b8_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7f9e24570e4587e2_000001626b4507b8_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7f9e24570e4587e2_000001626b4507b8_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:21:50,804 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:22:10,238 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:22:12,619 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r513219cbeb5f664e_000001626b455cbc_1 ... (0s) Current status: RUNNING Waiting on bqjob_r513219cbeb5f664e_000001626b455cbc_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r513219cbeb5f664e_000001626b455cbc_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:22:12,620 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:22:30,791 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:22:33,927 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r70a90d79d7168d15_000001626b45b0db_1 ... (0s) Current status: RUNNING Waiting on bqjob_r70a90d79d7168d15_000001626b45b0db_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r70a90d79d7168d15_000001626b45b0db_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:22:33,927 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:22:55,254 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:22:57,520 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3cbf97b3f5c391df_000001626b460c8b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3cbf97b3f5c391df_000001626b460c8b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3cbf97b3f5c391df_000001626b460c8b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:22:57,520 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:23:17,547 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:23:19,702 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4f6ff51b48d350f9_000001626b466390_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4f6ff51b48d350f9_000001626b466390_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4f6ff51b48d350f9_000001626b466390_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:23:19,702 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:23:38,190 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:23:40,285 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4f1ddeb995bb6047_000001626b46b433_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4f1ddeb995bb6047_000001626b46b433_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4f1ddeb995bb6047_000001626b46b433_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:23:40,286 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:24:02,606 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:24:04,894 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4c52363843fea1b5_000001626b4713d8_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4c52363843fea1b5_000001626b4713d8_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4c52363843fea1b5_000001626b4713d8_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:24:04,894 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:24:29,938 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:24:32,218 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7ff7f60af7b16fda_000001626b477e6a_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7ff7f60af7b16fda_000001626b477e6a_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7ff7f60af7b16fda_000001626b477e6a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 06:24:32,219 1ce27c21 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 06:24:57,261 1ce27c21 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json> 2018-03-28 06:24:59,385 1ce27c21 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/1ce27c21/perfkit-bq-pubXFjR1G.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r66c1302881fdfa00_000001626b47e8fb_1 ... (0s) Current status: RUNNING Waiting on bqjob_r66c1302881fdfa00_000001626b47e8fb_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r66c1302881fdfa00_000001626b47e8fb_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 952, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 879, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
