[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881885#comment-13881885 ] Hudson commented on HDFS-5788: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1653 (See [https://

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881867#comment-13881867 ] Hudson commented on HDFS-5788: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1678 (See [htt

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881840#comment-13881840 ] Hudson commented on HDFS-5788: -- FAILURE: Integrated in Hadoop-Yarn-trunk #461 (See [https://b

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881679#comment-13881679 ] Hudson commented on HDFS-5788: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5036 (See [https:

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880068#comment-13880068 ] Kihwal Lee commented on HDFS-5788: -- The location counting can be off if blocks are under-r

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880062#comment-13880062 ] Daryn Sharp commented on HDFS-5788: --- For a bit more context, we had about ~6-7k tasks (er

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879225#comment-13879225 ] Hadoop QA commented on HDFS-5788: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13874107#comment-13874107 ] Nathan Roberts commented on HDFS-5788: -- A simple solution is: Restrict the size to dfs

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13874082#comment-13874082 ] Suresh Srinivas commented on HDFS-5788: --- bq. Then due to lack of flow control in the

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873839#comment-13873839 ] Jason Lowe commented on HDFS-5788: -- They are usually short-lived but a bit longer-lived wh

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873720#comment-13873720 ] Suresh Srinivas commented on HDFS-5788: --- bq. a listLocatedStatus response is over 1MB