[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737818#comment-14737818 ] Zhe Zhang commented on HDFS-8383: - While we explore the ideas of refactoring {{DFSOutputStream}} and

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737962#comment-14737962 ] Tsz Wo Nicholas Sze commented on HDFS-8383: --- > I think the mission here is to handle all

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738209#comment-14738209 ] Zhe Zhang commented on HDFS-8383: - [~szetszwo] Thanks for sharing the thought. {code} Streamer_1 fails =>

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-06 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14732318#comment-14732318 ] Walter Su commented on HDFS-8383: - *1. What's the difference between datanodeError and externalError?*

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-06 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14732332#comment-14732332 ] Walter Su commented on HDFS-8383: - bq. When only one streamer fails, do we need to do anything? I think we

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-06 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14732320#comment-14732320 ] Li Bo commented on HDFS-8383: - Thanks [~walter.k.su] for the work! I have just read the code and find some

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731630#comment-14731630 ] Jing Zhao commented on HDFS-8383: - Thanks for working on this, Walter! So could you please elaborate more

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14730042#comment-14730042 ] Zhe Zhang commented on HDFS-8383: - Continuing the review on the patch itself: # Reading the current

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-03 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728959#comment-14728959 ] Walter Su commented on HDFS-8383: - There is debate long ago about parallel write and pipeline write.

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728246#comment-14728246 ] Zhe Zhang commented on HDFS-8383: - Thanks Walter for creating the patch. Below is a list of comments, some

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726648#comment-14726648 ] Tsz Wo Nicholas Sze commented on HDFS-8383: --- Sound good. Thanks a lot for working on this! >

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725115#comment-14725115 ] Tsz Wo Nicholas Sze commented on HDFS-8383: --- Hi Walter, are you working on this? Any progress?

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-01 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725545#comment-14725545 ] Walter Su commented on HDFS-8383: - I'm still working on this. Will upload a patch soon, one or two days

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-07-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628830#comment-14628830 ] Zhe Zhang commented on HDFS-8383: - [~szetszwo] Should we move this to HDFS-8031? Thanks.

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-07-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628843#comment-14628843 ] Tsz Wo Nicholas Sze commented on HDFS-8383: --- Let's keep it in HDFS-7285. I am

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-07-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628844#comment-14628844 ] Zhe Zhang commented on HDFS-8383: - Sure! Thanks for the work. Tolerate multiple failures