steveloughran commented on PR #5993:
URL: https://github.com/apache/hadoop/pull/5993#issuecomment-1748524668

   @ahmarsuhail 
   
   - caller provides a remote iterator, such as the ones we do for listing or 
another source/transformation (see RemoteIterators)
   - build() call returns some result
   - implementation kicks off a worker thread to process the iterator, reading 
its values in until there's enough to kick off a DELETE request (page or maybe 
a parallel set in a thread pool)
   - after each page/set of deletes, invokes the supplied callback of results
   - then continues, unless told to stop
   - finish only on: iterator has nothing, iterator raises an exception
   - or maybe on reaching some limit on failures
   - including maybe those considered unrecoverable
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to