johnyangk opened a new pull request #67: [NEMO-54] Handle remote data fetch 
failures due to executor removal
URL: https://github.com/apache/incubator-nemo/pull/67
 
 
   JIRA: [NEMO-54: Handle remote data fetch failures due to executor 
removal](https://issues.apache.org/jira/projects/NEMO/issues/NEMO-54)
   
   **Major changes:**
   - Catch all Throwables in ParentTaskDataFetcher, wrap it with an 
IOException, and throw the IOException over to TaskExecutor
   - Handle CompleteableFuture failures by passing the throwable to 
TaskExecutor via iteratorQueue
   
   **Minor changes to note:**
   - Introduce ClosableBlockingQueue#closeExceptionally, with the hope to 
propagate errors all the way up to ParentTaskDataFetcher
   
   **Tests for the changes:**
   - ParentTaskDataFetcherTest
   
   **Other comments:**
   - I'll add fault-injected integration tests after 
https://issues.apache.org/jira/browse/NEMO-55
   
   resolves 
[NEMO-54](https://issues.apache.org/jira/projects/NEMO/issues/NEMO-54)
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to