[GitHub] [spark] dongjoon-hyun edited a comment on pull request #32518: [SPARK-35383][CORE] Improve s3a magic committer support by inferring missing configs

dongjoon-hyun edited a comment on pull request #32518: URL: https://github.com/apache/spark/pull/32518#issuecomment-839841587 > LGTM. Should we eventually do this in Hadoop, cc @steveloughran and @dongjoon-hyun ? Thank you for review, @dbtsai . The following two are Spark configurati

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #32518: [SPARK-35383][CORE] Improve s3a magic committer support by inferring missing configs

dongjoon-hyun edited a comment on pull request #32518: URL: https://github.com/apache/spark/pull/32518#issuecomment-839992094 Here are my thoughts. > Be aware that https://issues.apache.org/jira/browse/HADOOP-17483 turns the magic committer on everywhere Of course, we've been