[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2010-01-12 Thread Wang Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12799222#action_12799222 ] Wang Xu commented on HDFS-842: -- I guess It might introduce some overhead. Most edit logs are

[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2010-01-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12799308#action_12799308 ] Konstantin Shvachko commented on HDFS-842: -- Yes. What is the overhead? Larger edits

[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2010-01-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12799309#action_12799309 ] Todd Lipcon commented on HDFS-842: -- Right, I don't think there's much doubt that this will

[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2010-01-12 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12799311#action_12799311 ] Eli Collins commented on HDFS-842: -- Since Avro can use compression I'm not sure it's going

[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2010-01-12 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12799315#action_12799315 ] Eli Collins commented on HDFS-842: -- That's what I thought (cpu bound on object

[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2010-01-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12799321#action_12799321 ] Todd Lipcon commented on HDFS-842: -- Eli: in HDFS-855 Dhruba quoted 7 minutes to read a 6G

[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2010-01-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12799323#action_12799323 ] Konstantin Shvachko commented on HDFS-842: -- 25% loss in performance during startups

[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2010-01-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12799326#action_12799326 ] Todd Lipcon commented on HDFS-842: -- OK, I just picked those numbers from nowhere. 10% sounds

[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2010-01-12 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12799334#action_12799334 ] dhruba borthakur commented on HDFS-842: --- 50% increase in writing is simply

[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2010-01-04 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12796408#action_12796408 ] Jeff Hammerbacher commented on HDFS-842: Could possibly be useful for repairing

[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2009-12-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12792387#action_12792387 ] Eli Collins commented on HDFS-842: -- +1 great idea Serialize NN edits log as avro records