[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209360#comment-13209360 ] Hudson commented on HADOOP-6502: Integrated in Hadoop-Mapreduce-trunk #992 (See [https:/

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209342#comment-13209342 ] Hudson commented on HADOOP-6502: Integrated in Hadoop-Mapreduce-0.23-Build #198 (See [ht

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209321#comment-13209321 ] Hudson commented on HADOOP-6502: Integrated in Hadoop-Hdfs-trunk #957 (See [https://buil

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209315#comment-13209315 ] Hudson commented on HADOOP-6502: Integrated in Hadoop-Hdfs-0.23-Build #170 (See [https:/

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208678#comment-13208678 ] Hudson commented on HADOOP-6502: Integrated in Hadoop-Mapreduce-0.23-Commit #557 (See [h

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208642#comment-13208642 ] Hudson commented on HADOOP-6502: Integrated in Hadoop-Mapreduce-trunk-Commit #1741 (See

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208638#comment-13208638 ] Hudson commented on HADOOP-6502: Integrated in Hadoop-Common-trunk-Commit #1729 (See [ht

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208635#comment-13208635 ] Hudson commented on HADOOP-6502: Integrated in Hadoop-Hdfs-0.23-Commit #540 (See [https:

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208631#comment-13208631 ] Hudson commented on HADOOP-6502: Integrated in Hadoop-Common-0.23-Commit #553 (See [http

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208629#comment-13208629 ] Hudson commented on HADOOP-6502: Integrated in Hadoop-Hdfs-trunk-Commit #1803 (See [http

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208203#comment-13208203 ] Aaron T. Myers commented on HADOOP-6502: Tiny nit: In "} else {//check already pe

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207545#comment-13207545 ] Todd Lipcon commented on HADOOP-6502: - bq. -1 tests included. The patch doesn't appea

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207544#comment-13207544 ] Hadoop QA commented on HADOOP-6502: --- -1 overall. Here are the results of testing the l

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207442#comment-13207442 ] Todd Lipcon commented on HADOOP-6502: - I believe this is still an issue in trunk, sin

[jira] [Commented] (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195818#comment-13195818 ] Suresh Srinivas commented on HADOOP-6502: - This is no longer an issue for trunk,

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829705#action_12829705 ] Tom White commented on HADOOP-6502: --- Looks good to me (but I would suggest that you test

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829457#action_12829457 ] Sharad Agarwal commented on HADOOP-6502: Can anyone please review the attached pat

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829456#action_12829456 ] Sanjay Radia commented on HADOOP-6502: -- +1 on caching negatives. > DistributedFileSy

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805405#action_12805405 ] Sharad Agarwal commented on HADOOP-6502: Seems most folks are ok with caching nega

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804678#action_12804678 ] Hairong Kuang commented on HADOOP-6502: --- > but I'm not sure we need to anything here

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804052#action_12804052 ] Steve Loughran commented on HADOOP-6502: you could always just cache the special c

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804034#action_12804034 ] Arun C Murthy commented on HADOOP-6502: --- I don't see much of a problem with caching

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804020#action_12804020 ] Doug Cutting commented on HADOOP-6502: -- Arun, do you see a problem with caching negat

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804000#action_12804000 ] Arun C Murthy commented on HADOOP-6502: --- I had a discussion with Hairong about this

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803983#action_12803983 ] Tom White commented on HADOOP-6502: --- > Looking at the code in more detail, the things a

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803862#action_12803862 ] Steve Loughran commented on HADOOP-6502: _Disclaimer_ I have long advocated having

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803853#action_12803853 ] Todd Lipcon commented on HADOOP-6502: - bq. I don't think dynamically adding classes t

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803852#action_12803852 ] Doug Cutting commented on HADOOP-6502: -- > If we make the assumption that classloaders

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803834#action_12803834 ] Todd Lipcon commented on HADOOP-6502: - Actually, after thinking some more, even that w

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803826#action_12803826 ] Tsz Wo (Nicholas), SZE commented on HADOOP-6502: Since JobConf extends Con

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803823#action_12803823 ] Todd Lipcon commented on HADOOP-6502: - Nicholas: the problem is that ReflectionUtils.g

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803814#action_12803814 ] Tsz Wo (Nicholas), SZE commented on HADOOP-6502: _DistributedFileSystem#li

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803759#action_12803759 ] Doug Cutting commented on HADOOP-6502: -- I don't think it's appropriate to cache JVM s

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803738#action_12803738 ] Todd Lipcon commented on HADOOP-6502: - Is this dangerous? Will we ever have a case wh

[jira] Commented: (HADOOP-6502) DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300

[ https://issues.apache.org/jira/browse/HADOOP-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803636#action_12803636 ] Sharad Agarwal commented on HADOOP-6502: We can do something like: {code} +if