See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1552/display/redirect?page=changes>
Changes: [rmannibucau] [BEAM-3409] waitUntilFinish should wait teardown even for the direct [ehudm] Update Python Gradle tasks to run in a venv. [ehudm] Add Gradle based Python precommit. [aaltay] [BEAM-3250] Migrate Apex and Gearpump ValidatesRunner tests to Gradle [robertwb] Secure GRPC channel for SDK worker (#4984) ------------------------------------------ [...truncated 95.26 KB...] 'apache-beam-testing:bqjob_r68c50cdb89187fb4_000001629475d320_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:19:34,283 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:19:59,159 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:20:01,271 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r2f9a87590e4b9b5e_0000016294763c37_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2f9a87590e4b9b5e_0000016294763c37_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2f9a87590e4b9b5e_0000016294763c37_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:20:01,272 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:20:28,236 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:20:30,238 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r61f26089bce9f163_000001629476add2_1 ... (0s) Current status: RUNNING Waiting on bqjob_r61f26089bce9f163_000001629476add2_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r61f26089bce9f163_000001629476add2_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:20:30,238 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:20:52,603 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:20:54,769 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_rd2c66bb87b51091_0000016294770cfc_1 ... (0s) Current status: RUNNING Waiting on bqjob_rd2c66bb87b51091_0000016294770cfc_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_rd2c66bb87b51091_0000016294770cfc_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:20:54,769 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:21:12,985 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:21:15,041 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r49690d255a8b22c1_0000016294775c93_1 ... (0s) Current status: RUNNING Waiting on bqjob_r49690d255a8b22c1_0000016294775c93_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r49690d255a8b22c1_0000016294775c93_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:21:15,041 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:21:32,093 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:21:34,161 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r47dd39bfd65e2e9f_000001629477a744_1 ... (0s) Current status: RUNNING Waiting on bqjob_r47dd39bfd65e2e9f_000001629477a744_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r47dd39bfd65e2e9f_000001629477a744_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:21:34,162 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:22:01,615 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:22:03,654 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r642ec1f1fcbd0227_0000016294781a9b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r642ec1f1fcbd0227_0000016294781a9b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r642ec1f1fcbd0227_0000016294781a9b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:22:03,655 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:22:24,635 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:22:26,763 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r73e57cf3a85220d5_0000016294787489_1 ... (0s) Current status: RUNNING Waiting on bqjob_r73e57cf3a85220d5_0000016294787489_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r73e57cf3a85220d5_0000016294787489_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:22:26,763 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:22:52,536 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:22:54,507 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r71370cf9cd8d4005_000001629478e17e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r71370cf9cd8d4005_000001629478e17e_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r71370cf9cd8d4005_000001629478e17e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:22:54,507 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:23:12,653 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:23:14,648 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r15f67352b9872a22_000001629479302e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r15f67352b9872a22_000001629479302e_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r15f67352b9872a22_000001629479302e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:23:14,649 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:23:33,758 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:23:36,774 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r37110d1baa35baea_000001629479866e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r37110d1baa35baea_000001629479866e_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r37110d1baa35baea_000001629479866e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:23:36,775 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:24:05,642 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:24:07,675 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r42b0b2ce372041e1_000001629479ff0e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r42b0b2ce372041e1_000001629479ff0e_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r42b0b2ce372041e1_000001629479ff0e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:24:07,675 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:24:26,286 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:24:28,303 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r2318e8fe8742ffab_00000162947a4fb9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2318e8fe8742ffab_00000162947a4fb9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2318e8fe8742ffab_00000162947a4fb9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-05 06:24:28,304 57196319 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-05 06:24:43,690 57196319 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json> 2018-04-05 06:24:45,801 57196319 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/57196319/perfkit-bq-pubfWPe5i.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r2f06cf53fc0ad155_00000162947a93ae_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2f06cf53fc0ad155_00000162947a93ae_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2f06cf53fc0ad155_00000162947a93ae_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 952, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 879, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
