[jira] Updated: (HDFS-914) Refactor DFSOutputStream and DFSInputStream out of DFSClient

2010-02-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-914: - Status: Patch Available (was: Open) > Refactor DFSOutputStream and DFSInputStream out of DFSClient > -

[jira] Updated: (HDFS-914) Refactor DFSOutputStream and DFSInputStream out of DFSClient

2010-02-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-914: - Status: Open (was: Patch Available) Patch got out of date by HDFS-927 being committed. > Refactor DFSOutp

[jira] Updated: (HDFS-914) Refactor DFSOutputStream and DFSInputStream out of DFSClient

2010-02-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-914: - Attachment: hdfs-914.txt New patch that incorporates HDFS-927's fixes in the refactored classes. > Refacto

[jira] Commented: (HDFS-945) Make NameNode resilient to DoS attacks (malicious or otherwise)

2010-02-03 Thread Sharad Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829443#action_12829443 ] Sharad Agarwal commented on HDFS-945: - Some of the things like rate limiting is applicabl

[jira] Commented: (HDFS-950) Add concat to FsShell

2010-02-03 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829425#action_12829425 ] Owen O'Malley commented on HDFS-950: I'm not a fan of this idea. The vencat operation is

[jira] Created: (HDFS-950) Add concat to FsShell

2010-02-03 Thread Eli Collins (JIRA)
Add concat to FsShell - Key: HDFS-950 URL: https://issues.apache.org/jira/browse/HDFS-950 Project: Hadoop HDFS Issue Type: New Feature Components: tools Reporter: Eli Collins Would be nice if conca

[jira] Updated: (HDFS-935) Real user in delegation token.

2010-02-03 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-935: -- Attachment: HDFS-935.3.patch > Real user in delegation token. > -

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

2010-02-03 Thread ryan rawson (JIRA)
Issue Type: Improvement > Components: data-node >Reporter: Jay Booth > Fix For: 0.22.0 > > Attachments: hdfs-918-20100201.patch, hdfs-918-20100203.patch, > hdfs-multiplex.patch > > > Currently, on read requests, the DataXCei

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

2010-02-03 Thread dhruba borthakur (JIRA)
Project: Hadoop HDFS > Issue Type: Improvement > Components: data-node >Reporter: Jay Booth > Fix For: 0.22.0 > > Attachments: hdfs-918-20100201.patch, hdfs-918-20100203.patch, > hdfs-multiplex.patch > > > Cu

[jira] Updated: (HDFS-245) Create symbolic links in HDFS

2010-02-03 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-245: - Attachment: design-doc-v4.txt Attached the latest design doc that captures the final path resolution and AP

[jira] Updated: (HDFS-245) Create symbolic links in HDFS

2010-02-03 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-245: - Attachment: symlink37-hdfs.patch Hey Sanjay, Thanks for posting, these are all addressed in patches 34-36,

[jira] Updated: (HDFS-528) Add ability for safemode to wait for a minimum number of live datanodes

2010-02-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-528: - Status: Open (was: Patch Available) > Add ability for safemode to wait for a minimum number of live datano

[jira] Updated: (HDFS-528) Add ability for safemode to wait for a minimum number of live datanodes

2010-02-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-528: - Status: Patch Available (was: Open) somehow hudson missed this in the patch queue... retriggering. > Add

[jira] Created: (HDFS-949) Move Delegation token into Common so that we can use it for MapReduce also

2010-02-03 Thread Owen O'Malley (JIRA)
Move Delegation token into Common so that we can use it for MapReduce also -- Key: HDFS-949 URL: https://issues.apache.org/jira/browse/HDFS-949 Project: Hadoop HDFS Issu

[jira] Updated: (HDFS-949) Move Delegation token into Common so that we can use it for MapReduce also

2010-02-03 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HDFS-949: --- Component/s: security > Move Delegation token into Common so that we can use it for MapReduce also > --

[jira] Created: (HDFS-948) Allow setting permissions on links

2010-02-03 Thread Eli Collins (JIRA)
Allow setting permissions on links -- Key: HDFS-948 URL: https://issues.apache.org/jira/browse/HDFS-948 Project: Hadoop HDFS Issue Type: New Feature Components: hdfs client, name-node Rep

[jira] Updated: (HDFS-947) The namenode should redirect a hftp request to read a file to the datanode that has the maximum number of local replicas

2010-02-03 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-947: -- Attachment: hftpRedirection.patch This is a patch fro hadoop 0.20. The namenode redirects a hftp

[jira] Created: (HDFS-947) The namenode should redirect a hftp request to read a file to the datanode that has the maximum number of local replicas

2010-02-03 Thread dhruba borthakur (JIRA)
The namenode should redirect a hftp request to read a file to the datanode that has the maximum number of local replicas Key: HDFS-947 URL: ht

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

2010-02-03 Thread ryan rawson (JIRA)
Hadoop HDFS > Issue Type: Improvement > Components: data-node >Reporter: Jay Booth > Fix For: 0.22.0 > > Attachments: hdfs-918-20100201.patch, hdfs-918-20100203.patch, > hdfs-multiplex.patch > > > Currently, on read requests, the

[jira] Commented: (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2010-02-03 Thread Michael Feiman (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829289#action_12829289 ] Michael Feiman commented on HDFS-347: - It would be nice to have fast local read implement

[jira] Updated: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

2010-02-03 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-938: Attachment: HDFS-938-BP20-1.patch HDFS-938-BP20-1.patch: for previous version, not to commit > Repla

[jira] Commented: (HDFS-946) NameNode should not return full path name when lisitng a diretory or getting the status of a file

2010-02-03 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829269#action_12829269 ] Hairong Kuang commented on HDFS-946: For this jira, the client will still return fully-qu

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

2010-02-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829262#action_12829262 ] Todd Lipcon commented on HDFS-909: -- Hi Konstantin. Thanks for the in depth exploration of th

[jira] Commented: (HDFS-946) NameNode should not return full path name when lisitng a diretory or getting the status of a file

2010-02-03 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829250#action_12829250 ] Doug Cutting commented on HDFS-946: --- This sounds reasonable. But the client would still re

[jira] Created: (HDFS-946) NameNode should not return full path name when lisitng a diretory or getting the status of a file

2010-02-03 Thread Hairong Kuang (JIRA)
NameNode should not return full path name when lisitng a diretory or getting the status of a file - Key: HDFS-946 URL: https://issues.apache.org/jira/browse/HDFS-946

[jira] Commented: (HDFS-877) Client-driven block verification not functioning

2010-02-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829233#action_12829233 ] stack commented on HDFS-877: I'm +1 on commit though non-critical. It has comprehensive test and

[jira] Commented: (HDFS-945) Make NameNode resilient to DoS attacks (malicious or otherwise)

2010-02-03 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829219#action_12829219 ] Eli Collins commented on HDFS-945: -- Let's keep this jira to mechanism, can discuss policy (e

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

2010-02-03 Thread stack (JIRA)
18 > URL: https://issues.apache.org/jira/browse/HDFS-918 > Project: Hadoop HDFS > Issue Type: Improvement > Components: data-node >Reporter: Jay Booth > Fix For: 0.22.0 > > Attachments: hdfs-918-

[jira] Commented: (HDFS-945) Make NameNode resilient to DoS attacks (malicious or otherwise)

2010-02-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829211#action_12829211 ] Todd Lipcon commented on HDFS-945: -- bq. apps within trusted network that does not need to be

[jira] Commented: (HDFS-945) Make NameNode resilient to DoS attacks (malicious or otherwise)

2010-02-03 Thread Kay Kay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829209#action_12829209 ] Kay Kay commented on HDFS-945: -- Echoing Zlatin's comment - this should be an optional feature ,

[jira] Updated: (HDFS-717) Proposal for exceptions thrown by FileContext and Abstract File System

2010-02-03 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-717: - Attachment: hdfs-717.1.patch > Proposal for exceptions thrown by FileContext and Abstract File Syst

[jira] Commented: (HDFS-945) Make NameNode resilient to DoS attacks (malicious or otherwise)

2010-02-03 Thread Zlatin Balevsky (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829190#action_12829190 ] Zlatin Balevsky commented on HDFS-945: -- Any type of rate-limiting should be either optio

[jira] Commented: (HDFS-945) Make NameNode resilient to DoS attacks (malicious or otherwise)

2010-02-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829189#action_12829189 ] Todd Lipcon commented on HDFS-945: -- What's the scope of this? It seems there are a number of

[jira] Commented: (HDFS-945) Make NameNode resilient to DoS attacks (malicious or otherwise)

2010-02-03 Thread Philip Zeyliger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829185#action_12829185 ] Philip Zeyliger commented on HDFS-945: -- A solution is rate limiting (by client IP or use

[jira] Created: (HDFS-945) Make NameNode resilient to DoS attacks (malicious or otherwise)

2010-02-03 Thread Arun C Murthy (JIRA)
Make NameNode resilient to DoS attacks (malicious or otherwise) --- Key: HDFS-945 URL: https://issues.apache.org/jira/browse/HDFS-945 Project: Hadoop HDFS Issue Type: Improvement

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2010-02-03 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829152#action_12829152 ] Sanjay Radia commented on HDFS-245: --- Feedback on patch 31: TestFcHdfsSymlink * dfsClient i