See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4910/display/redirect>
Changes:
------------------------------------------
[...truncated 1.63 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:pubsub_write:v2:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:combine_globally:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:combine_grouped_values:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:combine_per_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:create_view:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:flatten:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:group_by_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:group_into_batches:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:group_into_batches_with_sharded_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:impulse:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:reshuffle:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:sdf_process_keyed_elements:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:teststream:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:window_into:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:write_files:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dec 07,
2023 6:02:21 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dec 07,
2023 6:02:22 AM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dec 07,
2023 6:02:22 AM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dec 07,
2023 6:02:24 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT
COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dec 07,
2023 6:02:24 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dec 07,
2023 6:02:24 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to
"apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function pack_combiners at 0x7fe61a2cc700>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function lift_combiners at 0x7fe61a2cc790>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function sort_stages at 0x7fe61a2ccee0>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function
annotate_downstream_side_inputs at 0x7fdcaf6341f0> ====================
INFO root:portable_runner.py:543 ==================== <function
fix_side_input_pcoll_coders at 0x7fdcaf634310> ====================
INFO root:portable_runner.py:543 ==================== <function
pack_combiners at 0x7fdcaf634820> ====================
INFO root:portable_runner.py:543 ==================== <function
lift_combiners at 0x7fdcaf6348b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf
at 0x7fdcaf634a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk
at 0x7fdcaf634af0> ====================
INFO root:portable_runner.py:543 ==================== <function
sink_flattens at 0x7fdcaf634c10> ====================
INFO root:portable_runner.py:543 ==================== <function
greedily_fuse at 0x7fdcaf634ca0> ====================
INFO root:portable_runner.py:543 ==================== <function
read_to_impulse at 0x7fdcaf634d30> ====================
INFO root:portable_runner.py:543 ==================== <function
impulse_to_input at 0x7fdcaf634dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages
at 0x7fdcaf635040> ====================
INFO root:portable_runner.py:543 ==================== <function
add_impulse_to_dangling_transforms at 0x7fdcaf635160> ====================
INFO root:portable_runner.py:543 ==================== <function
setup_timer_mapping at 0x7fdcaf634f70> ====================
INFO root:portable_runner.py:543 ==================== <function
populate_data_channel_coders at 0x7fdcaf6350d0> ====================
INFO root:portable_runner.py:543 starting control server on port 34447
INFO root:portable_runner.py:543 starting data server on port 35217
INFO root:portable_runner.py:543 starting state server on port 43007
INFO root:portable_runner.py:543 starting logging server on port 43093
INFO root:portable_runner.py:543 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7fdce7705670> for environment
ref_Environment_default_environment_2 (beam:env:docker:v1,
b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image
apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image
apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:543 Docker container is running. container_id
= b'ece747896a732b39429c0ce249f2c276efb6c58ca6ee62b8800ea3b6e55e5006',
worker_id = worker_83
INFO root:portable_runner.py:543 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler
object at 0x7fdce7726e50> for environment external_8beam:env:anyof:v1
(beam:env:external:v1, b'\n\x11\n\x0flocalhost:34707')
INFO root:portable_runner.py:543 Requesting worker at localhost:34707
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dec 07,
2023 6:02:35 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Starting worker worker_84 pointing at
apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:34447.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm
will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This
is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap
and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
"cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do
not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is
just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The
implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all
circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use
a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load
jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dec 07,
2023 6:02:44 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dec 07,
2023 6:02:44 AM org.apache.beam.fn.harness.ExternalWorkerService
lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Successfully started worker worker_84.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 297, in _run_job
self.result = self._invoke_runner()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 466, in run_stages
bundle_results = self._execute_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 794, in _execute_bundle
self._run_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 301, in __iter__
return itertools.chain(*self.partition(1))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 287, in partition
for wkvs in windowed_key_values(key, windowed_values):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 297, in _run_job
self.result = self._invoke_runner()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 466, in run_stages
bundle_results = self._execute_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 794, in _execute_bundle
self._run_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 301, in __iter__
return itertools.chain(*self.partition(1))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 287, in partition
for wkvs in windowed_key_values(key, windowed_values):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to FAILED
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
- RuntimeError: Pipeline job-a8753194-d3a5-4ef8-bbcb-01b060795f63 failed in
state FAILED: Error running pipeline.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 297, in _run_job
self.result = self._invoke_runner()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 466, in run_stages
bundle_results = self._execute_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 794, in _execute_bundle
self._run_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 301, in __iter__
return itertools.chain(*self.partition(1))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 287, in partition
for wkvs in windowed_key_values(key, windowed_values):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 18 skipped, 7216 deselected in 279.14s (0:04:39) =====
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1360930
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1361454.
Stopping expansion service pid: 1361455.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'>
line: 235
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
For more on this, please refer to
https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings
in the Gradle documentation.
BUILD FAILED in 30m 36s
261 actionable tasks: 177 executed, 74 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/2yuo3q7kk2qck
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
