[jira] Commented: (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

2010-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866496#action_12866496 ] Todd Lipcon commented on HDFS-941: -- I ran some benchmarks again tonight using YCSB. I

[jira] Created: (HDFS-1148) Convert FSDataset to ReadWriteLock

2010-05-12 Thread Todd Lipcon (JIRA)
Convert FSDataset to ReadWriteLock -- Key: HDFS-1148 URL: https://issues.apache.org/jira/browse/HDFS-1148 Project: Hadoop HDFS Issue Type: Improvement Components: data-node Reporter:

[jira] Commented: (HDFS-1148) Convert FSDataset to ReadWriteLock

2010-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866515#action_12866515 ] Todd Lipcon commented on HDFS-1148: --- YCSB output (same test setup as described in

[jira] Commented: (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

2010-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866519#action_12866519 ] Todd Lipcon commented on HDFS-941: -- I'd like to hold off on this just a bit longer yet - I'm

[jira] Commented: (HDFS-1130) Pass Administrator acl to HTTPServer for common servlet access.

2010-05-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866544#action_12866544 ] Suresh Srinivas commented on HDFS-1130: --- +1 for the patch. Documentation needs to be

[jira] Commented: (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

2010-05-12 Thread sam rash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1284#action_1284 ] sam rash commented on HDFS-941: --- todd: wow, those benchmarks do look impressive! do we have

[jira] Commented: (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

2010-05-12 Thread sam rash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866680#action_12866680 ] sam rash commented on HDFS-941: --- two other comments: 1. the number of sockets per address is

[jira] Commented: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

2010-05-12 Thread sam rash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866691#action_12866691 ] sam rash commented on HDFS-1142: Hey Todd, one question: why does

[jira] Commented: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

2010-05-12 Thread sam rash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866692#action_12866692 ] sam rash commented on HDFS-1142: oh, I should add, looks good though :) (just curious on

[jira] Commented: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

2010-05-12 Thread sam rash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866701#action_12866701 ] sam rash commented on HDFS-1142: oh right, I see that didn't change. +1 on this diff then.

[jira] Commented: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

2010-05-12 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866711#action_12866711 ] dhruba borthakur commented on HDFS-1142: I guess it would be good to save the lease

[jira] Commented: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

2010-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866713#action_12866713 ] Todd Lipcon commented on HDFS-1142: --- I opened HDFS-1149 to persist lease reassignment to

[jira] Created: (HDFS-1149) Lease reassignment is not persisted to edit log

2010-05-12 Thread Todd Lipcon (JIRA)
Lease reassignment is not persisted to edit log --- Key: HDFS-1149 URL: https://issues.apache.org/jira/browse/HDFS-1149 Project: Hadoop HDFS Issue Type: Bug Components: name-node

[jira] Commented: (HDFS-1148) Convert FSDataset to ReadWriteLock

2010-05-12 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866715#action_12866715 ] dhruba borthakur commented on HDFS-1148: sounds like a good idea to me. how

[jira] Commented: (HDFS-1148) Convert FSDataset to ReadWriteLock

2010-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866716#action_12866716 ] Todd Lipcon commented on HDFS-1148: --- pretty small in 0.20, but FSDataset is substantially

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

2010-05-12 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866734#action_12866734 ] Hairong Kuang commented on HDFS-599: Major comments: 1. Balancer is a service in HDFS. 2.

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

2010-05-12 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866751#action_12866751 ] Eli Collins commented on HDFS-599: -- @Dmytro That makes sense, it takes over ten minutes for

[jira] Created: (HDFS-1150) Verify datanodes' identities to clients in secure clusters

2010-05-12 Thread Jakob Homan (JIRA)
Verify datanodes' identities to clients in secure clusters -- Key: HDFS-1150 URL: https://issues.apache.org/jira/browse/HDFS-1150 Project: Hadoop HDFS Issue Type: New Feature

[jira] Commented: (HDFS-1150) Verify datanodes' identities to clients in secure clusters

2010-05-12 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866762#action_12866762 ] Jakob Homan commented on HDFS-1150: --- The issue occurs when a client reads or writes blocks

[jira] Updated: (HDFS-1150) Verify datanodes' identities to clients in secure clusters

2010-05-12 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1150: -- Attachment: HDFS-1150-Y20S-Rough.txt First, very rough patch against Y20S branch for secure datanode

[jira] Updated: (HDFS-1150) Verify datanodes' identities to clients in secure clusters

2010-05-12 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1150: -- Attachment: HDFS-1150-Y20S-Rough-2.patch Updated patch with correcty ivy lib... Verify datanodes'

[jira] Commented: (HDFS-142) In 0.20, move blocks being written into a blocksBeingWritten directory

2010-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866940#action_12866940 ] Todd Lipcon commented on HDFS-142: -- Had a test failure of TestFileAppend2 today with:

[jira] Updated: (HDFS-142) In 0.20, move blocks being written into a blocksBeingWritten directory

2010-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-142: - Attachment: validateBlockMetaData-synchronized.txt In 0.20, move blocks being written into a