Github user cloud-fan commented on the issue:

    https://github.com/apache/spark/pull/20386
  
    `FileCommitProtocol.onTaskCommit` is called in `FileFormatWriter.write`, so 
this PR is required to migrate file-based data sources.
    
    By a quick look, it seems `FileCommitProtocol.onTaskCommit` doesn't have an 
implementation yet, but I don't want to change the existing API and I assume 
this API is necessary. BTW it sounds reasonable to provide a callback for task 
commit.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to