[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022528#comment-13022528 ] Hudson commented on HDFS-1070: -- Integrated in Hadoop-Hdfs-trunk #643 (See [https://builds.apa

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13021880#comment-13021880 ] Todd Lipcon commented on HDFS-1070: --- I'm curious, why did we bump the version number from

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13020069#comment-13020069 ] Hudson commented on HDFS-1070: -- Integrated in Hadoop-Hdfs-trunk-Commit #595 (See [https://hud

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13020060#comment-13020060 ] Matt Foley commented on HDFS-1070: -- +1 These failures seem unrelated to this patch, and

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13020051#comment-13020051 ] Hadoop QA commented on HDFS-1070: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019868#comment-13019868 ] Matt Foley commented on HDFS-1070: -- Brilliant! :-) Thanks for the explanation. > Speedup

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019680#comment-13019680 ] Hairong Kuang commented on HDFS-1070: - Patch 9 fixed the tests failed in build 347. The

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019629#comment-13019629 ] Matt Foley commented on HDFS-1070: -- Agreed the failed tests don't seem to have anything to

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019624#comment-13019624 ] Tsz Wo (Nicholas), SZE commented on HDFS-1070: -- > The failed tests seem not be

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019617#comment-13019617 ] Hairong Kuang commented on HDFS-1070: - The failed tests seem not be caused by this patc

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019606#comment-13019606 ] Hadoop QA commented on HDFS-1070: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13018675#comment-13018675 ] Hadoop QA commented on HDFS-1070: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13018588#comment-13018588 ] Matt Foley commented on HDFS-1070: -- +1. Code review looks good to me! > Speedup NameNode

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13017786#comment-13017786 ] Hadoop QA commented on HDFS-1070: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13017143#comment-13017143 ] Matt Foley commented on HDFS-1070: -- At Hairong's request, I did some perf testing on the p

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13017129#comment-13017129 ] Matt Foley commented on HDFS-1070: -- I reviewed the new patch. I focused on the difference

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016225#comment-13016225 ] Tsz Wo (Nicholas), SZE commented on HDFS-1070: -- BTW, I am not saying that we s

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015995#comment-13015995 ] Tsz Wo (Nicholas), SZE commented on HDFS-1070: -- Since the mappings are already

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015749#comment-13015749 ] dhruba borthakur commented on HDFS-1070: Completely agree with you Nicholas that th

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015735#comment-13015735 ] Tsz Wo (Nicholas), SZE commented on HDFS-1070: -- Hi Dhruba, I am not yet a comp

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015716#comment-13015716 ] dhruba borthakur commented on HDFS-1070: hi nicholas, when we use "compression" to

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015701#comment-13015701 ] Tsz Wo (Nicholas), SZE commented on HDFS-1070: -- Here is an orthogonal idea for

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014893#comment-13014893 ] Matt Foley commented on HDFS-1070: -- Thanks, Hairong. I'm sorry the request comes in so lo

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014862#comment-13014862 ] Hairong Kuang commented on HDFS-1070: - I agree that the old design has the potential ro

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014772#comment-13014772 ] Sanjay Radia commented on HDFS-1070: > With the old "full names" format, an arbitrary c

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014348#comment-13014348 ] Matt Foley commented on HDFS-1070: -- I was talking with Sanjay and he would like us to cons

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014145#comment-13014145 ] Matt Foley commented on HDFS-1070: -- Hi Hairong, nice clean patch, thanks for this improvem

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014134#comment-13014134 ] Hadoop QA commented on HDFS-1070: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13013835#comment-13013835 ] Matt Foley commented on HDFS-1070: -- Hi Hairong, the speedups you measured with this patch

[jira] Commented: (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12966385#action_12966385 ] Todd Lipcon commented on HDFS-1070: --- Looks pretty good, very nice results! Few things: -

[jira] Commented: (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12965917#action_12965917 ] Hairong Kuang commented on HDFS-1070: - I did some experiments with one of our internal i

[jira] Commented: (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1291#action_1291 ] Hairong Kuang commented on HDFS-1070: - Sanjay, the idea is simple. Changes are 1. full n

[jira] Commented: (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933217#action_12933217 ] Sanjay Radia commented on HDFS-1070: You have probably done some break down of where the

[jira] Commented: (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933205#action_12933205 ] Sanjay Radia commented on HDFS-1070: Hairong, could add a short design doc (say 1 page).