Github user steveloughran commented on the issue:

    https://github.com/apache/spark/pull/19487
  
    LGTM. I'm going stick out today a slight roll of my PathOutputCommitter 
class which is one layer above FileOutputCommitter : lets people write 
committers without output & work paths, yet avoid going near complexity that is 
FileOutputFormat. See 
[PathOutputCommitter](https://github.com/hortonworks-spark/cloud-integration/blob/master/spark-cloud-integration/src/main/scala/com/hortonworks/spark/cloud/commit/PathOutputCommitProtocol.scala);
 if I get my changes into Hadoop 3 then this committer will work for all 
versions of Hadoop 3.x, even though the S3A stuff is targeting Hadoop 3.1


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to