[jira] [Commented] (MAPREDUCE-5518) Fix typo "can't read paritions file"

2013-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794938#comment-13794938 ] Hudson commented on MAPREDUCE-5518: --- SUCCESS: Integrated in Hadoop-trunk-Commit #460

[jira] [Commented] (MAPREDUCE-5518) Fix typo "can't read paritions file"

2013-10-14 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794935#comment-13794935 ] Devaraj K commented on MAPREDUCE-5518: -- Thanks Tsuyoshi OZAWA for review. > Fix

[jira] [Updated] (MAPREDUCE-5518) Fix typo "can't read paritions file"

2013-10-14 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated MAPREDUCE-5518: - Resolution: Fixed Fix Version/s: 2.2.1 Status: Resolved (was: Patch Availab

[jira] [Commented] (MAPREDUCE-5541) Improved algorithm for whether need speculative task

2013-10-14 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794920#comment-13794920 ] zhaoyunjiong commented on MAPREDUCE-5541: - I have run some "Random sleep job"

[jira] [Updated] (MAPREDUCE-5541) Improved algorithm for whether need speculative task

2013-10-14 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated MAPREDUCE-5541: Attachment: MAPREDUCE-5541-branch-1.2.patch Update patch to allow user even set mapred.

[jira] [Commented] (MAPREDUCE-5518) Fix typo "can't read paritions file"

2013-10-14 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794906#comment-13794906 ] Devaraj K commented on MAPREDUCE-5518: -- +1, trivial fix, looks good to me. > Fix

[jira] [Commented] (MAPREDUCE-5577) Allow querying the JobHistoryServer by job arrival time

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794830#comment-13794830 ] Hadoop QA commented on MAPREDUCE-5577: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-5577) Allow querying the JobHistoryServer by job arrival time

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5577: -- Attachment: MAPREDUCE-5577.patch > Allow querying the JobHistoryServer by job arrival time

[jira] [Updated] (MAPREDUCE-5577) Allow querying the JobHistoryServer by job arrival time

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5577: -- Status: Patch Available (was: Open) > Allow querying the JobHistoryServer by job arrival t

[jira] [Updated] (MAPREDUCE-5577) Allow querying the JobHistoryServer by job arrival time

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5577: -- Description: The JobHistoryServer REST APIs currently allow querying by job submit time and

[jira] [Commented] (MAPREDUCE-5457) Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794815#comment-13794815 ] Hadoop QA commented on MAPREDUCE-5457: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5457) Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794810#comment-13794810 ] Sandy Ryza commented on MAPREDUCE-5457: --- Updated patch sets NullWritable as the

[jira] [Commented] (MAPREDUCE-5583) Ability to limit running map and reduce tasks

2013-10-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794782#comment-13794782 ] Arun C Murthy commented on MAPREDUCE-5583: -- [~jlowe] We can already accomplis

[jira] [Commented] (MAPREDUCE-5387) Implement Signal.TERM on Windows

2013-10-14 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794770#comment-13794770 ] Andrey Klochkov commented on MAPREDUCE-5387: I uploaded the patch which im

[jira] [Updated] (MAPREDUCE-5457) Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5457: -- Attachment: MAPREDUCE-5457-3.patch > Add a KeyOnlyTextOutputReader to enable streaming to w

[jira] [Commented] (MAPREDUCE-5576) MR AM unregistration should not be failed due to UnknownHostException on getting history url

2013-10-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794735#comment-13794735 ] Zhijie Shen commented on MAPREDUCE-5576: Ah... I forgot *not* in the title, wh

[jira] [Updated] (MAPREDUCE-5576) MR AM unregistration should not be failed due to UnknownHostException on getting history url

2013-10-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5576: --- Summary: MR AM unregistration should not be failed due to UnknownHostException on getting

[jira] [Commented] (MAPREDUCE-5576) MR AM unregistration should be failed due to UnknownHostException on getting history url

2013-10-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794730#comment-13794730 ] Karthik Kambatla commented on MAPREDUCE-5576: - Thanks [~zjshen] for the cl

[jira] [Commented] (MAPREDUCE-5457) Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794648#comment-13794648 ] Hadoop QA commented on MAPREDUCE-5457: -- {color:red}-1 overall{color}. Here are t

How does dfs.block.size get passed into CombineFileInputFormat

2013-10-14 Thread Mike Liddell
Background: I'm trying to track the details of how Hive creates multi-file splits. I'm under the impression that MapReduce's CombineFileInputFormat does the main work of combining files and specifically that, if no overrides are set, then the target split filesize will be set to dfs.block.size.

[jira] [Updated] (MAPREDUCE-5457) Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5457: -- Attachment: MAPREDUCE-5457-branch-1-1.patch > Add a KeyOnlyTextOutputReader to enable strea

[jira] [Commented] (MAPREDUCE-5457) Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794506#comment-13794506 ] Hadoop QA commented on MAPREDUCE-5457: -- {color:green}+1 overall{color}. Here are

[jira] [Created] (MAPREDUCE-5583) Ability to limit running map and reduce tasks

2013-10-14 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5583: - Summary: Ability to limit running map and reduce tasks Key: MAPREDUCE-5583 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5583 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-5457) Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5457: -- Attachment: MAPREDUCE-5457-2.patch > Add a KeyOnlyTextOutputReader to enable streaming to w

[jira] [Commented] (MAPREDUCE-5457) Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794480#comment-13794480 ] Sandy Ryza commented on MAPREDUCE-5457: --- Was wrong about the "output reader inde

[jira] [Commented] (MAPREDUCE-5457) Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794475#comment-13794475 ] Hadoop QA commented on MAPREDUCE-5457: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5457) Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794455#comment-13794455 ] Sandy Ryza commented on MAPREDUCE-5457: --- Uploading a patch with a more comprehen

[jira] [Updated] (MAPREDUCE-5457) Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5457: -- Attachment: MAPREDUCE-5457-1.patch > Add a KeyOnlyTextOutputReader to enable streaming to w

[jira] [Commented] (MAPREDUCE-5546) mapred.cmd on Windows set HADOOP_OPTS incorrectly

2013-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794361#comment-13794361 ] Hudson commented on MAPREDUCE-5546: --- SUCCESS: Integrated in Hadoop-trunk-Commit #460

[jira] [Resolved] (MAPREDUCE-5546) mapred.cmd on Windows set HADOOP_OPTS incorrectly

2013-10-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5546. -- Resolution: Fixed Fix Version/s: 2.2.1 3.0.0 I've committ

[jira] [Updated] (MAPREDUCE-5546) mapred.cmd on Windows set HADOOP_OPTS incorrectly

2013-10-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated MAPREDUCE-5546: - Target Version/s: 3.0.0, 2.2.1 Affects Version/s: 2.2.0 3.

[jira] [Assigned] (MAPREDUCE-3310) Custom grouping comparator cannot be set for Combiners

2013-10-14 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur reassigned MAPREDUCE-3310: - Assignee: Alejandro Abdelnur > Custom grouping comparator cannot be s

[jira] [Commented] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794137#comment-13794137 ] Hudson commented on MAPREDUCE-5463: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #

[jira] [Commented] (MAPREDUCE-5329) APPLICATION_INIT is never sent to AuxServices other than the builtin ShuffleHandler

2013-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794136#comment-13794136 ] Hudson commented on MAPREDUCE-5329: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #

[jira] [Resolved] (MAPREDUCE-5581) killing jobs which have failed causes log missing

2013-10-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5581. --- Resolution: Duplicate This is a duplicate of MAPREDUCE-5502. > killing jobs which have f

[jira] [Commented] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794104#comment-13794104 ] Hudson commented on MAPREDUCE-5463: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #1552

[jira] [Commented] (MAPREDUCE-5329) APPLICATION_INIT is never sent to AuxServices other than the builtin ShuffleHandler

2013-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794103#comment-13794103 ] Hudson commented on MAPREDUCE-5329: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #1552

[jira] [Commented] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794042#comment-13794042 ] Hudson commented on MAPREDUCE-5463: --- FAILURE: Integrated in Hadoop-Yarn-trunk #362 (

[jira] [Commented] (MAPREDUCE-5329) APPLICATION_INIT is never sent to AuxServices other than the builtin ShuffleHandler

2013-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794041#comment-13794041 ] Hudson commented on MAPREDUCE-5329: --- FAILURE: Integrated in Hadoop-Yarn-trunk #362 (

[jira] [Commented] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794006#comment-13794006 ] Hudson commented on MAPREDUCE-5463: --- SUCCESS: Integrated in Hadoop-trunk-Commit #459

[jira] [Updated] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5463: -- Resolution: Fixed Fix Version/s: 2.2.1 Status: Resolved (was: Patch Avail

[jira] [Updated] (MAPREDUCE-5541) Improved algorithm for whether need speculative task

2013-10-14 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated MAPREDUCE-5541: Attachment: (was: MAPREDUCE-5541-branch-1.2.patch) > Improved algorithm for whether

[jira] [Updated] (MAPREDUCE-5541) Improved algorithm for whether need speculative task

2013-10-14 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated MAPREDUCE-5541: Attachment: (was: MAPREDUCE-5541-branch-1.2.configurable.patch) > Improved algorith

[jira] [Updated] (MAPREDUCE-5541) Improved algorithm for whether need speculative task

2013-10-14 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated MAPREDUCE-5541: Attachment: MAPREDUCE-5541-branch-1.2.patch > Improved algorithm for whether need specu

[jira] [Updated] (MAPREDUCE-5541) Improved algorithm for whether need speculative task

2013-10-14 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated MAPREDUCE-5541: Attachment: MAPREDUCE-5541-branch-1.2.configurable.patch This patch can use mapred.job.

[jira] [Updated] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-10-14 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-5463: -- Hadoop Flags: Reviewed > Deprecate SLOTS_MILLIS counters >

[jira] [Commented] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-10-14 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13793978#comment-13793978 ] Tsuyoshi OZAWA commented on MAPREDUCE-5463: --- Thanks for your review, Sandy!