Documentation deviation: S3A staging committer uses algorithm version 1

2019-12-03 Thread Fabian A.J. Thiele
Hi, The documentation for the S3A committer [1] states that the Staging Committer sets the `mapreduce.fileoutputcommitter.algorithm.version` to "2" for that part of its work. In `org.apache.hadoop.fs.s3a.commit.staging.StagingCommitter. initFileOutputCommitterOptions` [2] however we see

hadoop java compatability

2019-12-03 Thread Augustine Calvino
I want to know what java versions are compatible with the latest hadoop. The most that the documentation says is to check the wiki