[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14590374#comment-14590374 ] Hudson commented on HDFS-6581: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2159 (See [https://

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14590344#comment-14590344 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2177 (See [htt

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14590238#comment-14590238 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #229 (See

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14590028#comment-14590028 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #220 (See [htt

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589838#comment-14589838 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #231 (See [htt

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589824#comment-14589824 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-Yarn-trunk #961 (See [https://b

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589228#comment-14589228 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-trunk-Commit #8032 (See [https:

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183404#comment-14183404 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-trunk-Commit #6338 (See [https:

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180007#comment-14180007 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1934 (See [htt

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179915#comment-14179915 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1909 (See [https://

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179827#comment-14179827 ] Hudson commented on HDFS-6581: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #720 (See [https://b

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179035#comment-14179035 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-trunk-Commit #6305 (See [https:

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179025#comment-14179025 ] Jitendra Nath Pandey commented on HDFS-6581: Updated CHANGES.txt in trunk. > W

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178939#comment-14178939 ] Andrew Wang commented on HDFS-6581: --- Hey Jitendra, could you update the trunk CHANGES.txt

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178741#comment-14178741 ] Jitendra Nath Pandey commented on HDFS-6581: I have merged this to branch-2 and

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174407#comment-14174407 ] Jitendra Nath Pandey commented on HDFS-6581: I am planning to merge this to bra

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156513#comment-14156513 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1914 (See [htt

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156397#comment-14156397 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1889 (See [https://

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156319#comment-14156319 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-Yarn-trunk #698 (See [https://b

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14155013#comment-14155013 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-trunk-Commit #6163 (See [https:

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14154992#comment-14154992 ] Arpit Agarwal commented on HDFS-6581: - The findbugs warning and test failures are unrel

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14154585#comment-14154585 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14154259#comment-14154259 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153238#comment-14153238 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151327#comment-14151327 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147618#comment-14147618 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147455#comment-14147455 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147432#comment-14147432 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146774#comment-14146774 ] Suresh Srinivas commented on HDFS-6581: --- bq. I'd be satisfied regarding the merge if

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146704#comment-14146704 ] Arpit Agarwal commented on HDFS-6581: - I have not looked at the DataTransferProtocol we

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146647#comment-14146647 ] Andrew Wang commented on HDFS-6581: --- Thanks for running these numbers Arpit. To convert i

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14145599#comment-14145599 ] Arpit Agarwal commented on HDFS-6581: - Preliminary numbers for write throughput. The t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144432#comment-14144432 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143872#comment-14143872 ] Arpit Agarwal commented on HDFS-6581: - Suresh, good suggestions. Let me file a task for

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143865#comment-14143865 ] Suresh Srinivas commented on HDFS-6581: --- bq. I think system-level testing will be nee

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143773#comment-14143773 ] Arpit Agarwal commented on HDFS-6581: - bq. My fear here is that we will try to implemen

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143698#comment-14143698 ] Colin Patrick McCabe commented on HDFS-6581: bq. Rebase is no silver bullet. Co

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143029#comment-14143029 ] Arpit Agarwal commented on HDFS-6581: - Micro-benchmark to verify that SCR performance d

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142338#comment-14142338 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142276#comment-14142276 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142209#comment-14142209 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141567#comment-14141567 ] Suresh Srinivas commented on HDFS-6581: --- I caught up with [~arpitagarwal] about the c

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141558#comment-14141558 ] Arpit Agarwal commented on HDFS-6581: - Rebase is no silver bullet. Conflicts still need

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141496#comment-14141496 ] Colin Patrick McCabe commented on HDFS-6581: Yeah, it would be nice to have a p

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141483#comment-14141483 ] Andrew Wang commented on HDFS-6581: --- bq. HDFS-4953 is not a subtask of HDFS-4949, and you

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141474#comment-14141474 ] Colin Patrick McCabe commented on HDFS-6581: bq. HDFS-4953 is not a subtask of

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141328#comment-14141328 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14140965#comment-14140965 ] Arpit Agarwal commented on HDFS-6581: - bq. Arpit Agarwal, is the eviction strategy plug

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14140926#comment-14140926 ] Suresh Srinivas commented on HDFS-6581: --- bq. I also think we absolutely need a better

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14140914#comment-14140914 ] Arpit Agarwal commented on HDFS-6581: - bq. There are a bunch of performance numbers on

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14140845#comment-14140845 ] Colin Patrick McCabe commented on HDFS-6581: [~andrew.wang]: I agree that it wo

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14140238#comment-14140238 ] Andrew Wang commented on HDFS-6581: --- I'd like to also echo Colin's desire to see some pos

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14140107#comment-14140107 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139885#comment-14139885 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139352#comment-14139352 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138383#comment-14138383 ] Colin Patrick McCabe commented on HDFS-6581: bq. I don't recall any performance

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138365#comment-14138365 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138335#comment-14138335 ] Arpit Agarwal commented on HDFS-6581: - bq. Before we merged HDFS-4949 we did substantia

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138252#comment-14138252 ] Colin Patrick McCabe commented on HDFS-6581: bq. Benchmark the impact of CRC co

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138223#comment-14138223 ] Arpit Agarwal commented on HDFS-6581: - Thanks for the note. We have been busy getting t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138165#comment-14138165 ] Colin Patrick McCabe commented on HDFS-6581: It's exciting to see this making p

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138059#comment-14138059 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14137614#comment-14137614 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14133484#comment-14133484 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106593#comment-14106593 ] Arpit Agarwal commented on HDFS-6581: - bq. Memory pressure is worse with mmaped files b

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106575#comment-14106575 ] Arpit Agarwal commented on HDFS-6581: - bq. So I would say, tmpfs is always worse for us

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106386#comment-14106386 ] Gopal V commented on HDFS-6581: --- Fair enough, the choice of backing layer should not be enfor

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106349#comment-14106349 ] Colin Patrick McCabe commented on HDFS-6581: bq. If ramfs ate 90% of memory, wo

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106308#comment-14106308 ] Gopal V commented on HDFS-6581: --- bq. ramfs: causes applications to be aborted with OOM errors

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106302#comment-14106302 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106267#comment-14106267 ] Colin Patrick McCabe commented on HDFS-6581: The key difference between tmpfs a

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106245#comment-14106245 ] Andrew Wang commented on HDFS-6581: --- I also took a look at the doc, seems pretty reasonab

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106232#comment-14106232 ] Arpit Agarwal commented on HDFS-6581: - Thank you for taking the time to look at the doc

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106203#comment-14106203 ] Gopal V commented on HDFS-6581: --- Swap in modern kernels are checksummed with crc32c. Re: RAM

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106135#comment-14106135 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106069#comment-14106069 ] Colin Patrick McCabe commented on HDFS-6581: bq. If you truncate() a file while

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106042#comment-14106042 ] Todd Lipcon commented on HDFS-6581: --- If you truncate() a file while a reader has it mmapp

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106025#comment-14106025 ] Colin Patrick McCabe commented on HDFS-6581: Looks good overall. It's good to

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105954#comment-14105954 ] Arpit Agarwal commented on HDFS-6581: - Moved the patch to sub-task HDFS-6910. > Write

[jira] [Commented] (HDFS-6581) Write to single replica in memory

[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105490#comment-14105490 ] Arpit Agarwal commented on HDFS-6581: - Created a development branch HDFS-6581 per r1619