[jira] Commented: (HDFS-826) Allow a mechanism for an application to detect that datanode(s) have died in the write pipeline

[ https://issues.apache.org/jira/browse/HDFS-826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844119#action_12844119 ] stack commented on HDFS-826: Just to say that I'm +1 on committing Replicable4.txt (I've already

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844160#action_12844160 ] dhruba borthakur commented on HDFS-918: --- Thsi patch uses nio to multiplex IO over

[jira] Created: (HDFS-1034) Enhance datanode to read data and checksum file in parallel

Enhance datanode to read data and checksum file in parallel --- Key: HDFS-1034 URL: https://issues.apache.org/jira/browse/HDFS-1034 Project: Hadoop HDFS Issue Type: Improvement

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844174#action_12844174 ] Jay Booth commented on HDFS-918: Yeah, it only uses nonblocking pread ops on the block and

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844185#action_12844185 ] dhruba borthakur commented on HDFS-918: --- Thanks for the description Jay. What is ur

[jira] Commented: (HDFS-1034) Enhance datanode to read data and checksum file in parallel

[ https://issues.apache.org/jira/browse/HDFS-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844186#action_12844186 ] Jay Booth commented on HDFS-1034: - Wouldn't this preclude the use of transferTo for transfer

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844191#action_12844191 ] Jay Booth commented on HDFS-918: I'll enthusiastically cheerlead? :) More seriously, I'm

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844195#action_12844195 ] ryan rawson commented on HDFS-918: -- this sounds great guys. For HBase, there is more need

[jira] Created: (HDFS-1035) Generate Eclipse's .classpath file from Ivy config

Generate Eclipse's .classpath file from Ivy config -- Key: HDFS-1035 URL: https://issues.apache.org/jira/browse/HDFS-1035 Project: Hadoop HDFS Issue Type: Improvement Components:

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844208#action_12844208 ] Todd Lipcon commented on HDFS-918: -- +1 on ignoring write for now. This mainly benefits high

[jira] Commented: (HDFS-1033) In secure clusters, NN and SNN should verify that the remote principal during image and edits transfer

[ https://issues.apache.org/jira/browse/HDFS-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844225#action_12844225 ] Devaraj Das commented on HDFS-1033: --- Looks good In secure clusters, NN and SNN should

[jira] Commented: (HDFS-1034) Enhance datanode to read data and checksum file in parallel

[ https://issues.apache.org/jira/browse/HDFS-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844232#action_12844232 ] Todd Lipcon commented on HDFS-1034: --- A bit of manual readahead on the checksum file could

[jira] Updated: (HDFS-985) HDFS should issue multiple RPCs for listing a large directory

[ https://issues.apache.org/jira/browse/HDFS-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-985: --- Attachment: iterativeLS_trunk.patch This patch is for trunk and fixed a web UI bug when display a

[jira] Commented: (HDFS-1034) Enhance datanode to read data and checksum file in parallel

[ https://issues.apache.org/jira/browse/HDFS-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844269#action_12844269 ] Zlatin Balevsky commented on HDFS-1034: --- How complicated would it be to store the

[jira] Commented: (HDFS-1034) Enhance datanode to read data and checksum file in parallel

[ https://issues.apache.org/jira/browse/HDFS-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844270#action_12844270 ] Todd Lipcon commented on HDFS-1034: --- Only scary thing about moving checksums to a

[jira] Commented: (HDFS-1034) Enhance datanode to read data and checksum file in parallel

[ https://issues.apache.org/jira/browse/HDFS-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844272#action_12844272 ] Zlatin Balevsky commented on HDFS-1034: --- The only possible bottleneck is the extra

[jira] Commented: (HDFS-1024) SecondaryNamenode fails to checkpoint because namenode fails with CancelledKeyException

[ https://issues.apache.org/jira/browse/HDFS-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844274#action_12844274 ] Todd Lipcon commented on HDFS-1024: --- Hi Dmytro, A few comments: - in the test, rather

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844278#action_12844278 ] Raghu Angadi commented on HDFS-918: --- Thanks Jay. This is a well known limitation on

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844280#action_12844280 ] Todd Lipcon commented on HDFS-918: -- bq. I think it is better to use something like Netty

[jira] Commented: (HDFS-1034) Enhance datanode to read data and checksum file in parallel

[ https://issues.apache.org/jira/browse/HDFS-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844285#action_12844285 ] Todd Lipcon commented on HDFS-1034: --- In practice I don't imagine the extra disk seek for

[jira] Updated: (HDFS-985) HDFS should issue multiple RPCs for listing a large directory

[ https://issues.apache.org/jira/browse/HDFS-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-985: --- Attachment: (was: iterativeLS_trunk.patch) HDFS should issue multiple RPCs for listing a large

[jira] Updated: (HDFS-985) HDFS should issue multiple RPCs for listing a large directory

[ https://issues.apache.org/jira/browse/HDFS-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-985: --- Attachment: iterativeLS_trunk1.patch HDFS should issue multiple RPCs for listing a large directory

[jira] Updated: (HDFS-985) HDFS should issue multiple RPCs for listing a large directory

[ https://issues.apache.org/jira/browse/HDFS-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-985: --- Attachment: directoryBrowse_0.20yahoo.patch This patch fixes the UI bug when browse directory from web

[jira] Updated: (HDFS-1036) in DelegationTokenFetch dfs.getURI returns no port

[ https://issues.apache.org/jira/browse/HDFS-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1036: -- +1 in DelegationTokenFetch dfs.getURI returns no port --

[jira] Created: (HDFS-1038) In nn_browsedfscontent.jsp fetch delegation token only if security is enabled.

In nn_browsedfscontent.jsp fetch delegation token only if security is enabled. -- Key: HDFS-1038 URL: https://issues.apache.org/jira/browse/HDFS-1038 Project: Hadoop HDFS

[jira] Updated: (HDFS-1024) SecondaryNamenode fails to checkpoint because namenode fails with CancelledKeyException

[ https://issues.apache.org/jira/browse/HDFS-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov updated HDFS-1024: Fix Version/s: 0.22.0 Affects Version/s: (was: 0.20.2) 0.22.0

[jira] Updated: (HDFS-985) HDFS should issue multiple RPCs for listing a large directory

[ https://issues.apache.org/jira/browse/HDFS-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-985: --- Attachment: iterativeLS_trunk2.patch iterativeLS_trunk2.patch fixed a bug in TestFileStatus.java.

[jira] Updated: (HDFS-1038) In nn_browsedfscontent.jsp fetch delegation token only if security is enabled.

[ https://issues.apache.org/jira/browse/HDFS-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1038: --- Attachment: HDFS-1038-y20.1.patch Patch hadoop-20. In nn_browsedfscontent.jsp

[jira] Commented: (HDFS-1024) SecondaryNamenode fails to checkpoint because namenode fails with CancelledKeyException

[ https://issues.apache.org/jira/browse/HDFS-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844355#action_12844355 ] Hadoop QA commented on HDFS-1024: - -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-1024) SecondaryNamenode fails to checkpoint because namenode fails with CancelledKeyException

[ https://issues.apache.org/jira/browse/HDFS-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844356#action_12844356 ] Dmytro Molkov commented on HDFS-1024: - It seems like the failure is Failed to download

[jira] Updated: (HDFS-854) Datanode should scan devices in parallel to generate block report

[ https://issues.apache.org/jira/browse/HDFS-854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov updated HDFS-854: --- Fix Version/s: 0.22.0 Affects Version/s: 0.22.0 Status: Patch Available (was:

[jira] Updated: (HDFS-1036) in DelegationTokenFetch dfs.getURI returns no port

[ https://issues.apache.org/jira/browse/HDFS-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1036: - Attachment: HDFS-1036-BP20-Fix.patch fix for the patch. In case of Test configuration may be

[jira] Updated: (HDFS-1036) in DelegationTokenFetch dfs.getURI returns no port

[ https://issues.apache.org/jira/browse/HDFS-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1036: - Attachment: HDFS-1036-BP20-1.patch addressed comment from Jakob, removing unneeded mock line..