[ https://issues.apache.org/jira/browse/SPARK-44124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749264#comment-17749264 ]
Steve Loughran commented on SPARK-44124: ---------------------------------------- we are soon to move hadoop trunk up to SDK v2, stabilise it with a goal to backport ASAP: HADOOP-18818 any help with testing this would be wonderful. for spark * usual classpath issues (bundle.jar + aws-crt.jar) * spark-kinesis will need to move to the sdk or spark continues to ship v1 with that module (i.e. they can coexist) * any testing people can do apart from classpath pain, unless people are actually extending bits of the s3a client by plugging in classes (credentials, signing, delegation,...) the move seems painless > Upgrade AWS SDK to v2 > --------------------- > > Key: SPARK-44124 > URL: https://issues.apache.org/jira/browse/SPARK-44124 > Project: Spark > Issue Type: Sub-task > Components: Build > Affects Versions: 4.0.0 > Reporter: Dongjoon Hyun > Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org