SEZ9 commented on issue #11655: URL: https://github.com/apache/seatunnel/issues/11655#issuecomment-5203022229
Thanks for the detailed report and for splitting this out of #11648. Root cause is clear: hadoop-aws classes reference the original com.fasterxml.jackson package while the seatunnel-hadoop3-3.1.4-uber jar relocates Jackson, so any code path through org.apache.hadoop.util.JsonSerialization (e.g. RoleModel for fs.s3a.assumed.role.*) fails at runtime. Possible fixes to evaluate: (a) include hadoop-aws in the same shading/relocation pass so its Jackson references are rewritten consistently, or (b) stop relocating Jackson in the uber jar if classpath isolation makes it unnecessary. Option (a) seems safer given other consumers of the uber jar. A regression test that exercises the assumed-role code path (e.g. via a unit test invoking RoleModel/JsonSerialization against the shaded artifact, or a localstack-based e2e case) would help prevent this from silently reoccurring after future Hadoop upgrades. <!-- streview-comment:59 --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
