steveloughran opened a new pull request #2971: URL: https://github.com/apache/hadoop/pull/2971
File output committer which uses a manifest file to pass the lists of directories to create and files to rename from task attempts to job committer; job commit does dir creation and file rename across a pool of threads. Based on lessons/code from the S3A committer, Status: * file formats done. * implementation architecture "stages you can chain" done Testing: todo. Will take the S3A commit protocol test as a baseline and make an abstract contract test from it; have one for the local FS and add one to Azure too. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
