ahmedabu98 commented on issue #34797:
URL: https://github.com/apache/beam/issues/34797#issuecomment-2845054050
Actually, we're getting the following error:
```
INFO 2025-04-30T21:24:09.216460779Z E0430 21:24:09.193300 15
managed_transforms_worker_main.cc:213] Failed to upgrade using the expansion
service manager: INTERNAL: Expansion request failed:
java.lang.IllegalArgumentException: Config schema provided with the expansion
request Fields:
INFO 2025-04-30T21:24:09.216465204Z Field{name=config, description=YAML
string config used to build the underlying SchemaTransform., type=STRING,
options={{}}}
INFO 2025-04-30T21:24:09.216469481Z Field{name=config_url, description=URL
path to the YAML config file used to build the underlying SchemaTransform.,
type=STRING, options={{}}}
INFO 2025-04-30T21:24:09.216473492Z Field{name=transform_identifier,
description=Identifier of the underlying SchemaTransform to discover and
instantiate., type=STRING NOT NULL, options={{}}}
INFO 2025-04-30T21:24:09.216477191Z Encoding positions:
INFO 2025-04-30T21:24:09.216480899Z {transform_identifier=2, config_url=1,
config=0}
INFO 2025-04-30T21:24:09.216502941Z Options:{{}}UUID:
0443ce49-dd99-478c-861a-8393df4294c2 is not compatible with the config of the
Schema transform Fields:
INFO 2025-04-30T21:24:09.216507398Z Field{name=config, description=YAML
string config used to build the underlying SchemaTransform., type=STRING,
options={{}}}
INFO 2025-04-30T21:24:09.216513612Z Field{name=config_url, description=URL
path to the YAML config file used to build the underlying SchemaTransform.,
type=STRING, options={{}}}
INFO 2025-04-30T21:24:09.216518985Z Field{name=skip_config_validation,
description=Skips configuration validation. If unset, the pipeline will fail at
construction time if the configuration includes unknown fields or missing
required fields., type=BOOLEAN, options={{}}}
INFO 2025-04-30T21:24:09.216522859Z Field{name=transform_identifier,
description=Identifier of the underlying SchemaTransform to discover and
instantiate., type=STRING NOT NULL, options={{}}}
INFO 2025-04-30T21:24:09.216527841Z Encoding positions:
INFO 2025-04-30T21:24:09.216533340Z {skip_config_validation=2,
transform_identifier=3, config_url=1, config=0}
```
which is coming from here:
https://github.com/apache/beam/blob/9e8e3c32d322ce12db3db7dc5745a5085bc6f585/sdks/java/expansion-service/src/main/java/org/apache/beam/sdk/expansion/service/ExpansionServiceSchemaTransformProvider.java#L121-L127
This method, `assignableTo()`, fails if the two Schemas have different
number of fields. #34525 adds a new parameter to this configuration, which
creates an imbalance between Beam HEAD and Dataflow service because the service
hasn't caught up yet (i.e. with imports)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
