[jira] [Commented] (MAPREDUCE-5895) FileAlreadyExistsException was thrown : Temporary Index File can not be cleaned up because OutputStream doesn't close properly

2014-05-28 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012130#comment-14012130 ] Devaraj K commented on MAPREDUCE-5895: -- +1, latest patch looks good to me. > Fil

[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)

2014-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012021#comment-14012021 ] Hadoop QA commented on MAPREDUCE-5898: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)

2014-05-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated MAPREDUCE-5898: -- Attachment: MAPREDUCE-5898.1.patch Uma, the new patch includes update for your comments. Thanks. >

[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)

2014-05-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012003#comment-14012003 ] Yi Liu commented on MAPREDUCE-5898: --- Thanks Uma for your detailed review. {quote} f

[jira] [Commented] (MAPREDUCE-5902) JobHistoryServer (HistoryFileManager) needs more debug logs, fails to pick up jobs with % characters in the name.

2014-05-28 Thread jay vyas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011953#comment-14011953 ] jay vyas commented on MAPREDUCE-5902: - I've confirmed that, this is a FileSystem i

[jira] [Commented] (MAPREDUCE-5848) MapReduce counts forcibly preempted containers as FAILED

2014-05-28 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011858#comment-14011858 ] Carlo Curino commented on MAPREDUCE-5848: - Mayank, I think you are right the b

[jira] [Commented] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2014-05-28 Thread Sumit Kumar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011752#comment-14011752 ] Sumit Kumar commented on MAPREDUCE-5907: this failed to compile because of a d

[jira] [Assigned] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2014-05-28 Thread Sumit Kumar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Kumar reassigned MAPREDUCE-5907: -- Assignee: Sumit Kumar > Improve getSplits() performance for fs implementations that

[jira] [Updated] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2014-05-28 Thread Sumit Kumar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Kumar updated MAPREDUCE-5907: --- Component/s: client > Improve getSplits() performance for fs implementations that can uti

[jira] [Commented] (MAPREDUCE-5875) Make Counter limits consistent conf across JobClient, MRAppMaster, and YarnChild

2014-05-28 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011709#comment-14011709 ] Karthik Kambatla commented on MAPREDUCE-5875: - Patch mostly looks good to

[jira] [Commented] (MAPREDUCE-5900) Container preemption interpreted as task failures and eventually job failures

2014-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011685#comment-14011685 ] Hadoop QA commented on MAPREDUCE-5900: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5777) Support utf-8 text with BOM (byte order marker)

2014-05-28 Thread bc Wong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011683#comment-14011683 ] bc Wong commented on MAPREDUCE-5777: Thanks for the patch, Zhihai. {noformat}

[jira] [Updated] (MAPREDUCE-5900) Container preemption interpreted as task failures and eventually job failures

2014-05-28 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated MAPREDUCE-5900: - Status: Patch Available (was: Open) > Container preemption interpreted as task failu

[jira] [Updated] (MAPREDUCE-5900) Container preemption interpreted as task failures and eventually job failures

2014-05-28 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated MAPREDUCE-5900: - Attachment: MAPREDUCE-5900-trunk-2.patch Attaching trunk patch Thanks, Mayank > Con

[jira] [Commented] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2014-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011521#comment-14011521 ] Hadoop QA commented on MAPREDUCE-5907: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-5862) Line records longer than 2x split size aren't handled correctly

2014-05-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011505#comment-14011505 ] Sandy Ryza commented on MAPREDUCE-5862: --- Thanks Jason! > Line records longer th

[jira] [Updated] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2014-05-28 Thread Sumit Kumar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Kumar updated MAPREDUCE-5907: --- Release Note: Please review the attached patch. Status: Patch Available (was: O

[jira] [Commented] (MAPREDUCE-5862) Line records longer than 2x split size aren't handled correctly

2014-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011503#comment-14011503 ] Hudson commented on MAPREDUCE-5862: --- SUCCESS: Integrated in Hadoop-trunk-Commit #561

[jira] [Updated] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2014-05-28 Thread Sumit Kumar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Kumar updated MAPREDUCE-5907: --- Attachment: MAPREDUCE-5907.patch > Improve getSplits() performance for fs implementations

[jira] [Updated] (MAPREDUCE-5862) Line records longer than 2x split size aren't handled correctly

2014-05-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5862: -- Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Hadoop Flags: Re

[jira] [Created] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2014-05-28 Thread Sumit Kumar (JIRA)
Sumit Kumar created MAPREDUCE-5907: -- Summary: Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing Key: MAPREDUCE-5907 URL: https://issues.apache.org/ji

[jira] [Commented] (MAPREDUCE-5862) Line records longer than 2x split size aren't handled correctly

2014-05-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011490#comment-14011490 ] Jason Lowe commented on MAPREDUCE-5862: --- +1 lgtm, committing this. > Line recor

[jira] [Reopened] (MAPREDUCE-5830) HostUtil.getTaskLogUrl is not backwards binary compatible with 2.3

2014-05-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened MAPREDUCE-5830: --- Reopening this, as we should address older Hive versions. > HostUtil.getTaskLogUrl is not ba

[jira] [Commented] (MAPREDUCE-5896) Allow InputSplits to indicate which locations have the block cached in memory

2014-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011441#comment-14011441 ] Hadoop QA commented on MAPREDUCE-5896: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5896) Allow InputSplits to indicate which locations have the block cached in memory

2014-05-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011391#comment-14011391 ] Sandy Ryza commented on MAPREDUCE-5896: --- Updated patch sets all the new APIs to

[jira] [Updated] (MAPREDUCE-5896) Allow InputSplits to indicate which locations have the block cached in memory

2014-05-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5896: -- Attachment: MAPREDUCE-5896-1.patch > Allow InputSplits to indicate which locations have the

[jira] [Updated] (MAPREDUCE-5900) Container preemption interpreted as task failures and eventually job failures

2014-05-28 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated MAPREDUCE-5900: - Status: Open (was: Patch Available) > Container preemption interpreted as task failu

[jira] [Updated] (MAPREDUCE-5900) Container preemption interpreted as task failures and eventually job failures

2014-05-28 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated MAPREDUCE-5900: - Attachment: MAPREDUCE-5900-branch-241-2.patch Copied the testcase from MAPREDUCE-5848

[jira] [Commented] (MAPREDUCE-5844) Reducer Preemption is too aggressive

2014-05-28 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011249#comment-14011249 ] Maysam Yabandeh commented on MAPREDUCE-5844: Thanks [~wangda]. I guess the

[jira] [Commented] (MAPREDUCE-5902) JobHistoryServer (HistoryFileManager) needs more debug logs, fails to pick up jobs with % characters in the name.

2014-05-28 Thread jay vyas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011240#comment-14011240 ] jay vyas commented on MAPREDUCE-5902: - Sure I can try those. In general what is

[jira] [Updated] (MAPREDUCE-5844) Reducer Preemption is too aggressive

2014-05-28 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maysam Yabandeh updated MAPREDUCE-5844: --- Attachment: (was: namenode-gc.2014-05-26-23-29.log.0) > Reducer Preemption is

[jira] [Commented] (MAPREDUCE-5902) JobHistoryServer (HistoryFileManager) needs more debug logs, fails to pick up jobs with % characters in the name.

2014-05-28 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011203#comment-14011203 ] Ravi Prakash commented on MAPREDUCE-5902: - Hi Jay! Is % the only special chara

[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)

2014-05-28 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011172#comment-14011172 ] Uma Maheswara Rao G commented on MAPREDUCE-5898: Thanks a lot Yi for t