See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1487/display/redirect?page=changes>
Changes: [sidhom] Add ExecutableStagePayload to make aid runner stage reconstruction [sidhom] Fix typo [tgroh] Use InstructionRequestHandler in RemoteEnvironment [axelmagn] Add a generic interface for the state service. [ccy] Add support for PaneInfo in WindowedValues [axelmagn] Write unit tests for GrpcStateService. [XuMingmin] Bump calcite and avatica versions (#4887) ------------------------------------------ [...truncated 90.23 KB...] 'apache-beam-testing:bqjob_r54bd684cc60676f_0000016240c750b9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:20:29,013 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:20:58,370 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:21:00,723 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r62db7538f2e02ca1_0000016240c7cc81_1 ... (0s) Current status: RUNNING Waiting on bqjob_r62db7538f2e02ca1_0000016240c7cc81_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r62db7538f2e02ca1_0000016240c7cc81_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:21:00,723 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:21:29,473 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:21:31,958 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4e55419ec741cd3b_0000016240c84682_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4e55419ec741cd3b_0000016240c84682_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4e55419ec741cd3b_0000016240c84682_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:21:31,958 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:21:56,436 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:21:58,913 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r174a49105eb00f64_0000016240c8af5d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r174a49105eb00f64_0000016240c8af5d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r174a49105eb00f64_0000016240c8af5d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:21:58,913 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:22:21,815 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:22:24,193 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r30ba29f8dd833195_0000016240c91294_1 ... (0s) Current status: RUNNING Waiting on bqjob_r30ba29f8dd833195_0000016240c91294_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r30ba29f8dd833195_0000016240c91294_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:22:24,194 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:22:52,698 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:22:54,860 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r5e66391f86a52cb6_0000016240c98b2c_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5e66391f86a52cb6_0000016240c98b2c_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5e66391f86a52cb6_0000016240c98b2c_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:22:54,861 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:23:18,137 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:23:26,437 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3e9cfbbd9675dc50_0000016240c9f277_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3e9cfbbd9675dc50_0000016240c9f277_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3e9cfbbd9675dc50_0000016240c9f277_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:23:26,437 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:23:49,808 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:23:52,030 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r13bc12be0d50a194_0000016240ca6a4d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r13bc12be0d50a194_0000016240ca6a4d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r13bc12be0d50a194_0000016240ca6a4d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:23:52,030 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:24:09,072 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:24:11,564 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r379e119c6313f085_0000016240cab5a1_1 ... (0s) Current status: RUNNING Waiting on bqjob_r379e119c6313f085_0000016240cab5a1_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r379e119c6313f085_0000016240cab5a1_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:24:11,565 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:24:34,222 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:24:36,351 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r76f8688e082c3e72_0000016240cb17de_1 ... (0s) Current status: RUNNING Waiting on bqjob_r76f8688e082c3e72_0000016240cb17de_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r76f8688e082c3e72_0000016240cb17de_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:24:36,352 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:24:58,165 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:25:00,638 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r51772f68ebcddc24_0000016240cb7540_1 ... (0s) Current status: RUNNING Waiting on bqjob_r51772f68ebcddc24_0000016240cb7540_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r51772f68ebcddc24_0000016240cb7540_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:25:00,638 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:25:24,496 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:25:26,637 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r357d1982cd2fc8c4_0000016240cbdc42_1 ... (0s) Current status: RUNNING Waiting on bqjob_r357d1982cd2fc8c4_0000016240cbdc42_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r357d1982cd2fc8c4_0000016240cbdc42_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:25:26,637 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:25:54,430 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:25:56,549 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4d6c9da0d648c021_0000016240cc5109_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4d6c9da0d648c021_0000016240cc5109_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4d6c9da0d648c021_0000016240cc5109_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-20 00:25:56,550 7b3b9770 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-20 00:26:24,915 7b3b9770 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json> 2018-03-20 00:26:27,383 7b3b9770 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7b3b9770/perfkit-bq-pubYK7uL_.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r12347ea1a0d83f84_0000016240ccc846_1 ... (0s) Current status: RUNNING Waiting on bqjob_r12347ea1a0d83f84_0000016240ccc846_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r12347ea1a0d83f84_0000016240ccc846_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 927, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 854, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
