See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1407/display/redirect?page=changes>
Changes: [xumingmingv] @Parameter annotation does not work for UDFs in Beam SQL [xumingmingv] fix type error ------------------------------------------ [...truncated 88.62 KB...] 'apache-beam-testing:bqjob_r677381b259c0359c_00000161d733a67b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:19:04,044 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:19:20,513 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:19:23,479 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:02.96s, CPU:0.25s, MaxMemory:25576kb STDOUT: Upload complete. Waiting on bqjob_r5e2cf29b85de003_00000161d733f05a_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5e2cf29b85de003_00000161d733f05a_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5e2cf29b85de003_00000161d733f05a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:19:23,479 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:19:50,164 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:19:53,470 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:03.30s, CPU:0.24s, MaxMemory:25260kb STDOUT: Upload complete. Waiting on bqjob_r4b998bdd0c9c9bbb_00000161d7346807_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4b998bdd0c9c9bbb_00000161d7346807_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4b998bdd0c9c9bbb_00000161d7346807_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:19:53,471 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:20:15,920 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:20:18,038 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:02.11s, CPU:0.24s, MaxMemory:25552kb STDOUT: Upload complete. Waiting on bqjob_r56162598c0723c0e_00000161d734c8b8_1 ... (0s) Current status: RUNNING Waiting on bqjob_r56162598c0723c0e_00000161d734c8b8_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r56162598c0723c0e_00000161d734c8b8_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:20:18,038 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:20:42,871 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:20:45,009 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:02.13s, CPU:0.24s, MaxMemory:25448kb STDOUT: Upload complete. Waiting on bqjob_r7ebcbe971bc06f46_00000161d73531f9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7ebcbe971bc06f46_00000161d73531f9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7ebcbe971bc06f46_00000161d73531f9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:20:45,009 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:21:03,042 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:21:05,163 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:02.11s, CPU:0.26s, MaxMemory:25340kb STDOUT: Upload complete. Waiting on bqjob_r156eb7b5921871ef_00000161d73580d1_1 ... (0s) Current status: RUNNING Waiting on bqjob_r156eb7b5921871ef_00000161d73580d1_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r156eb7b5921871ef_00000161d73580d1_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:21:05,163 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:21:33,497 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:21:35,860 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:02.35s, CPU:0.24s, MaxMemory:25256kb STDOUT: Upload complete. Waiting on bqjob_r7d677cab4501135f_00000161d735f7bf_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7d677cab4501135f_00000161d735f7bf_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7d677cab4501135f_00000161d735f7bf_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:21:35,861 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:22:04,399 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:22:07,257 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:02.85s, CPU:0.27s, MaxMemory:25320kb STDOUT: Upload complete. Waiting on bqjob_r1abac3ac47f7a0c_00000161d7367070_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1abac3ac47f7a0c_00000161d7367070_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1abac3ac47f7a0c_00000161d7367070_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:22:07,258 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:22:34,597 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:22:36,730 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:02.12s, CPU:0.24s, MaxMemory:25532kb STDOUT: Upload complete. Waiting on bqjob_r737bbf0ad39cd3da_00000161d736e679_1 ... (0s) Current status: RUNNING Waiting on bqjob_r737bbf0ad39cd3da_00000161d736e679_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r737bbf0ad39cd3da_00000161d736e679_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:22:36,730 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:23:03,232 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:23:05,482 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:02.24s, CPU:0.26s, MaxMemory:25572kb STDOUT: Upload complete. Waiting on bqjob_r386b03c632fb8138_00000161d7375653_1 ... (0s) Current status: RUNNING Waiting on bqjob_r386b03c632fb8138_00000161d7375653_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r386b03c632fb8138_00000161d7375653_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:23:05,483 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:23:31,484 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:23:33,713 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:02.22s, CPU:0.25s, MaxMemory:25260kb STDOUT: Upload complete. Waiting on bqjob_r4f59d5611537cbbc_00000161d737c4a9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4f59d5611537cbbc_00000161d737c4a9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4f59d5611537cbbc_00000161d737c4a9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:23:33,713 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:23:51,342 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:23:54,111 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:02.76s, CPU:0.26s, MaxMemory:25320kb STDOUT: Upload complete. Waiting on bqjob_rc24d3693a9196bd_00000161d738123a_1 ... (0s) Current status: RUNNING Waiting on bqjob_rc24d3693a9196bd_00000161d738123a_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_rc24d3693a9196bd_00000161d738123a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:23:54,111 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:24:20,210 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:24:27,329 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:07.11s, CPU:0.25s, MaxMemory:25336kb STDOUT: Upload complete. Waiting on bqjob_r2ee3db264d9e8a87_00000161d7389687_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2ee3db264d9e8a87_00000161d7389687_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2ee3db264d9e8a87_00000161d7389687_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-27 12:24:27,330 c47966a4 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-27 12:24:52,891 c47966a4 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json> 2018-02-27 12:24:55,013 c47966a4 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c47966a4/perfkit-bq-pubJmfibY.json}> ReturnCode:1, WallTime:0:02.11s, CPU:0.26s, MaxMemory:25196kb STDOUT: Upload complete. Waiting on bqjob_r3543250b21b3f4db_00000161d73902a9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3543250b21b3f4db_00000161d73902a9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3543250b21b3f4db_00000161d73902a9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 926, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 853, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure