[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2015-03-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14342488#comment-14342488 ] Hadoop QA commented on HDFS-1783: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-07-02 Thread zhiyuan.dai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404937#comment-13404937 ] zhiyuan.dai commented on HDFS-1783: --- @Lars Hofhansl Is this patch available in your vers

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-24 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400196#comment-13400196 ] Lars Hofhansl commented on HDFS-1783: - One more point to consider: For us (Salesforce)

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-21 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398785#comment-13398785 ] Lars Hofhansl commented on HDFS-1783: - Yes, that would be a good optimization. I would

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398778#comment-13398778 ] Daryn Sharp commented on HDFS-1783: --- One small twist to consider is to maybe continue pip

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-21 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398767#comment-13398767 ] Lars Hofhansl commented on HDFS-1783: - Yep. That is exactly the point. HDFS does pipeli

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398655#comment-13398655 ] Daryn Sharp commented on HDFS-1783: --- I've only quickly looked at the discussion and the p

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-21 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398256#comment-13398256 ] Lars Hofhansl commented on HDFS-1783: - Thanks Ted. Yes, I got that wrong in the first v

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-20 Thread Zhihong Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397930#comment-13397930 ] Zhihong Ted Yu commented on HDFS-1783: -- I was looking at an old version of the patch.

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-20 Thread Zhihong Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397927#comment-13397927 ] Zhihong Ted Yu commented on HDFS-1783: -- {code} +for (curNode = 0; curNode < le

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-14 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294951#comment-13294951 ] Lars Hofhansl commented on HDFS-1783: - @Ted: The first method is overridden in Distribu

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-12 Thread Zhihong Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294094#comment-13294094 ] Zhihong Ted Yu commented on HDFS-1783: -- {code} public FSDataOutputStream create(Path

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292434#comment-13292434 ] Hadoop QA commented on HDFS-1783: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-08 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291861#comment-13291861 ] Todd Lipcon commented on HDFS-1783: --- {code} As for the complexity, I find it manageable..

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-08 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291647#comment-13291647 ] Lars Hofhansl commented on HDFS-1783: - One more test: I introduced an artificial 1ms sl

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-08 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291641#comment-13291641 ] Lars Hofhansl commented on HDFS-1783: - I did a simple local micro benchmark: Started a

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-08 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291612#comment-13291612 ] Lars Hofhansl commented on HDFS-1783: - Thanks Todd. I see your point. I'm still oversee

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291114#comment-13291114 ] Todd Lipcon commented on HDFS-1783: --- In theory I'm interested in it, but I haven't quite

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-07 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290920#comment-13290920 ] Lars Hofhansl commented on HDFS-1783: - Is there general interest in this?

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289532#comment-13289532 ] Hadoop QA commented on HDFS-1783: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289160#comment-13289160 ] stack commented on HDFS-1783: - Do you want to zero out the socket in the array after you call c

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-02 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13287914#comment-13287914 ] Lars Hofhansl commented on HDFS-1783: - I also tested this patch with HBase and it start

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13287773#comment-13287773 ] Hadoop QA commented on HDFS-1783: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-05-31 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13286956#comment-13286956 ] Lars Hofhansl commented on HDFS-1783: - This looks pretty good. I'll add more specific t

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-05-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13286944#comment-13286944 ] Hadoop QA commented on HDFS-1783: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-05-30 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285490#comment-13285490 ] Lars Hofhansl commented on HDFS-1783: - I'd be interested in real world performance resu

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-05-29 Thread Kang Xiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285343#comment-13285343 ] Kang Xiao commented on HDFS-1783: - Hi Dhrubas, is there any latency test on this patch or h

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-05-29 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284655#comment-13284655 ] Lars Hofhansl commented on HDFS-1783: - Will wait for HDFS-744 to be committed, since th

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-05-28 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284351#comment-13284351 ] Lars Hofhansl commented on HDFS-1783: - Please have a quick look to gauge overall direct

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-05-28 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284340#comment-13284340 ] Lars Hofhansl commented on HDFS-1783: - Trunk is quite a bit different. I have a patch a

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-05-27 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284131#comment-13284131 ] Lars Hofhansl commented on HDFS-1783: - Any thoughts about this should be exposed to the

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-05-25 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13283185#comment-13283185 ] Lars Hofhansl commented on HDFS-1783: - I see. That is a nice and simple change. Let's m

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-05-24 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13283170#comment-13283170 ] dhruba borthakur commented on HDFS-1783: Hi Lars, the code is in https://github.co

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-05-24 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13283154#comment-13283154 ] Lars Hofhansl commented on HDFS-1783: - So the proposal here is to have the client paral

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2011-07-19 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067545#comment-13067545 ] dhruba borthakur commented on HDFS-1783: Thanks for the ping, Sanjay. This patch is

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2011-07-18 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067383#comment-13067383 ] Sanjay Radia commented on HDFS-1783: Dhruba, I understand that you have patch for this.

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2011-03-24 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13010955#comment-13010955 ] dhruba borthakur commented on HDFS-1783: I have a HBase workload that has the hot d