[jira] [Commented] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2018-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595970#comment-16595970 ] Junping Du commented on MAPREDUCE-6654: --- [~sunilg], I don't have bandwidth in s

[jira] [Updated] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2018-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6654: -- Target Version/s: (was: 3.2.0) > Possible NPE in JobHistoryEventHandler#handleEvent > ---

[jira] [Commented] (MAPREDUCE-7012) 3.0 deployment cannot work with old version MR tar ball which break rolling upgrade

2017-11-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261476#comment-16261476 ] Junping Du commented on MAPREDUCE-7012: --- CC [~andrew.wang], [~vinodkv], [~jlowe]

[jira] [Created] (MAPREDUCE-7012) 3.0 deployment cannot work with old version MR tar ball which break rolling upgrade

2017-11-21 Thread Junping Du (JIRA)
Junping Du created MAPREDUCE-7012: - Summary: 3.0 deployment cannot work with old version MR tar ball which break rolling upgrade Key: MAPREDUCE-7012 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7012

[jira] [Updated] (MAPREDUCE-5889) Deprecate FileInputFormat.setInputPaths(Job, String) and FileInputFormat.addInputPaths(Job, String)

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5889: -- Target Version/s: 2.8.3 (was: 2.8.1) > Deprecate FileInputFormat.setInputPaths(Job, String)

[jira] [Updated] (MAPREDUCE-5392) "mapred job -history all" command throws IndexOutOfBoundsException

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5392: -- Target Version/s: 2.8.3 (was: 2.8.1) > "mapred job -history all" command throws IndexOutOfB

[jira] [Updated] (MAPREDUCE-6498) ClientServiceDelegate should not retry upon AccessControlException

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6498: -- Target Version/s: 2.8.3 (was: 2.8.1) > ClientServiceDelegate should not retry upon AccessCo

[jira] [Updated] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6491: -- Target Version/s: 2.8.3 (was: 2.8.1) > Environment variable handling assumes values should

[jira] [Updated] (MAPREDUCE-6864) Hadoop streaming creates 2 mappers when the input has only one block

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6864: -- Target Version/s: 2.8.3 (was: 2.8.1) > Hadoop streaming creates 2 mappers when the input ha

[jira] [Updated] (MAPREDUCE-6096) SummarizedJob class NPEs with some jhist files

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6096: -- Target Version/s: 2.8.3 (was: 2.8.1) > SummarizedJob class NPEs with some jhist files > ---

[jira] [Updated] (MAPREDUCE-6117) Hadoop ignores yarn.nodemanager.hostname for RPC listeners

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6117: -- Target Version/s: 2.8.3 (was: 2.8.1) > Hadoop ignores yarn.nodemanager.hostname for RPC lis

[jira] [Updated] (MAPREDUCE-6101) on job submission, if input or output directories are encrypted, shuffle data should be encrypted at rest

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6101: -- Target Version/s: 2.8.3 (was: 2.8.1) > on job submission, if input or output directories ar

[jira] [Commented] (MAPREDUCE-6941) The default setting doesn't work for MapReduce job

2017-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154675#comment-16154675 ] Junping Du commented on MAPREDUCE-6941: --- Sorry missing comments on this JIRA. I

[jira] [Commented] (MAPREDUCE-6931) Remove TestDFSIO "Total Throughput" calculation

2017-09-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16151042#comment-16151042 ] Junping Du commented on MAPREDUCE-6931: --- This JIRA is marked as trivial, but we

[jira] [Commented] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149746#comment-16149746 ] Junping Du commented on MAPREDUCE-6937: --- Sounds like we forget to commit to bran

[jira] [Commented] (MAPREDUCE-6931) Remove TestDFSIO "Total Throughput" calculation

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149704#comment-16149704 ] Junping Du commented on MAPREDUCE-6931: --- 2.8.2 is in RC stage. Move to 2.8.3 giv

[jira] [Updated] (MAPREDUCE-6931) Remove TestDFSIO "Total Throughput" calculation

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6931: -- Fix Version/s: (was: 2.8.2) 2.8.3 > Remove TestDFSIO "Total Throughpu

[jira] [Created] (MAPREDUCE-6941) The default setting doesn't work for MapReduce job

2017-08-16 Thread Junping Du (JIRA)
Junping Du created MAPREDUCE-6941: - Summary: The default setting doesn't work for MapReduce job Key: MAPREDUCE-6941 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6941 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-6925) CLONE - Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6925: -- Fix Version/s: (was: 3.0.0-alpha1) (was: 2.9.0) > CLONE - Make Co

[jira] [Updated] (MAPREDUCE-6925) CLONE - Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6925: -- Target Version/s: 2.9.0, 3.0.0-beta1 (was: 2.7.0) > CLONE - Make Counter limits consistent

[jira] [Updated] (MAPREDUCE-6925) CLONE - Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6925: -- Hadoop Flags: (was: Reviewed) > CLONE - Make Counter limits consistent across JobClient, M

[jira] [Commented] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16108080#comment-16108080 ] Junping Du commented on MAPREDUCE-5875: --- bq. At a minimum, -beta1 will need to i

[jira] [Comment Edited] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16108052#comment-16108052 ] Junping Du edited comment on MAPREDUCE-5875 at 7/31/17 10:05 PM: ---

[jira] [Commented] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16108052#comment-16108052 ] Junping Du commented on MAPREDUCE-5875: --- Drop 2.9.0 as the patch get reverted fr

[jira] [Updated] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5875: -- Fix Version/s: (was: 2.9.0) > Make Counter limits consistent across JobClient, MRAppMast

[jira] [Created] (MAPREDUCE-6925) CLONE - Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2017-07-31 Thread Junping Du (JIRA)
Junping Du created MAPREDUCE-6925: - Summary: CLONE - Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild Key: MAPREDUCE-6925 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6925

[jira] [Updated] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6199: -- Fix Version/s: (was: 3.0.0-alpha1) (was: 2.8.0) > AbstractCounter

[jira] [Reopened] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened MAPREDUCE-6199: --- > AbstractCounters are not reset completely on deserialization > -

[jira] [Resolved] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-6199. --- Resolution: Won't Fix > AbstractCounters are not reset completely on deserialization > ---

[jira] [Commented] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16107992#comment-16107992 ] Junping Du commented on MAPREDUCE-6199: --- MAPREDUCE-5875 is revert, so patch here

[jira] [Updated] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6286: -- Fix Version/s: (was: 3.0.0-alpha1) (was: 2.9.0) > A typo in Histo

[jira] [Resolved] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-6286. --- Resolution: Won't Fix MAPREDUCE-5875 is revert, so patch here is not needed. reopen and re

[jira] [Reopened] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened MAPREDUCE-6286: --- > A typo in HistoryViewer makes some code useless, which causes counter limits > are not rese

[jira] [Commented] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16107986#comment-16107986 ] Junping Du commented on MAPREDUCE-5875: --- As discussed in MAPREDUCE-6288, I have

[jira] [Assigned] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-5875: - Assignee: Gera Shegalov (was: Junping Du) > Make Counter limits consistent across Jo

[jira] [Assigned] (MAPREDUCE-5875) Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-5875: - Assignee: Junping Du (was: Gera Shegalov) > Make Counter limits consistent across Jo

[jira] [Resolved] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-6288. --- Resolution: Done I have revert MAPREDUCE-6286, MAPREDUCE-6199 and MAPREDUCE-5875 from trun

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

2017-07-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16104470#comment-16104470 ] Junping Du commented on MAPREDUCE-6288: --- Yep. We keep reverting it from 2.7.x re

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

2017-07-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16104162#comment-16104162 ] Junping Du commented on MAPREDUCE-6288: --- Thus, I would suggest we reopen MAPREDU

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

2017-07-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16104157#comment-16104157 ] Junping Du commented on MAPREDUCE-6288: --- [~rkanter], I think all people here agr

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

2017-07-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16103827#comment-16103827 ] Junping Du commented on MAPREDUCE-6288: --- This has pending for a while. Sounds li

[jira] [Created] (MAPREDUCE-6915) On branch-2 ResourceManager failed to start

2017-07-17 Thread Junping Du (JIRA)
Junping Du created MAPREDUCE-6915: - Summary: On branch-2 ResourceManager failed to start Key: MAPREDUCE-6915 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6915 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-6288) mapred job -status fails with AccessControlException

2017-07-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16090497#comment-16090497 ] Junping Du commented on MAPREDUCE-6288: --- bq. If nobody steps up to address this

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

2017-07-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2 Status:

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

2017-07-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Attachment: MAPREDUCE-5621-branch-2.02.patch Fix the warning issue in 02 patch. > mr-jobhis

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

2017-07-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Affects Version/s: (was: 3.0.0-alpha1) Status: Patch Available (was: Reop

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

2017-07-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Attachment: MAPREDUCE-5621-branch-2.patch Rename the patch for branch-2. The latest patch LG

[jira] [Reopened] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

2017-07-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened MAPREDUCE-5621: --- Reopen this ticket as the issue still exists on branch-2. > mr-jobhistory-daemon.sh doesn't h

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

2017-07-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Affects Version/s: 2.8.0 > mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown a

[jira] [Updated] (MAPREDUCE-5621) mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time

2017-07-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5621: -- Target Version/s: 2.9 > mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all

[jira] [Updated] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

2017-07-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6246: -- Fix Version/s: 3.0.0-beta1 > DBOutputFormat.java appending extra semicolon to query which is

[jira] [Updated] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

2017-07-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6246: -- Resolution: Fixed Assignee: Gergely Novák (was: ramtin) Hadoop Flags: Revie

[jira] [Updated] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

2017-06-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6246: -- Labels: (was: BB2015-05-RFC) Status: Patch Available (was: Open) Thanks [~GergelyNova

[jira] [Updated] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

2017-06-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6246: -- Status: Open (was: Patch Available) > DBOutputFormat.java appending extra semicolon to quer

[jira] [Commented] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

2017-06-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16067268#comment-16067268 ] Junping Du commented on MAPREDUCE-6246: --- Looks like the patch doesn't apply to t

[jira] [Commented] (MAPREDUCE-6246) DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2

2017-06-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16067141#comment-16067141 ] Junping Du commented on MAPREDUCE-6246: --- Thanks [~ramtinb] for the patch contrib

[jira] [Commented] (MAPREDUCE-6897) Add Unit Test to make sure Job end notification get sent even appMaster stop get YarnRuntimeException

2017-06-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052416#comment-16052416 ] Junping Du commented on MAPREDUCE-6897: --- Thanks [~GergelyNovak] for contributing

[jira] [Updated] (MAPREDUCE-6895) Job end notification not send due to YarnRuntimeException

2017-06-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6895: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4

[jira] [Commented] (MAPREDUCE-6895) Job end notification not send due to YarnRuntimeException

2017-06-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048705#comment-16048705 ] Junping Du commented on MAPREDUCE-6895: --- Just filed MAPREDUCE-6897 and commit th

[jira] [Created] (MAPREDUCE-6897) Add Unit Test to make sure Job end notification get sent even appMaster stop get YarnRuntimeException

2017-06-13 Thread Junping Du (JIRA)
Junping Du created MAPREDUCE-6897: - Summary: Add Unit Test to make sure Job end notification get sent even appMaster stop get YarnRuntimeException Key: MAPREDUCE-6897 URL: https://issues.apache.org/jira/browse/MAP

[jira] [Commented] (MAPREDUCE-6895) Job end notification not send due to YarnRuntimeException

2017-06-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047201#comment-16047201 ] Junping Du commented on MAPREDUCE-6895: --- Adding a UT is also a nice idea. Given

[jira] [Commented] (MAPREDUCE-6895) Job end notification not send due to YarnRuntimeException

2017-06-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043574#comment-16043574 ] Junping Du commented on MAPREDUCE-6895: --- The patch LGTM as well. The only minor

[jira] [Updated] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

2017-05-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6654: -- Target Version/s: 2.9.0 (was: 2.8.1) > Possible NPE in JobHistoryEventHandler#handleEvent >

[jira] [Updated] (MAPREDUCE-5889) Deprecate FileInputFormat.setInputPaths(Job, String) and FileInputFormat.addInputPaths(Job, String)

2017-04-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5889: -- Labels: (was: BB2015-05-TBR newbie) > Deprecate FileInputFormat.setInputPaths(Job, String)

[jira] [Updated] (MAPREDUCE-6868) License check for jdiff output files should be ignored

2017-03-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6868: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (MAPREDUCE-6868) License check for jdiff output files should be ignored

2017-03-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15942692#comment-15942692 ] Junping Du commented on MAPREDUCE-6868: --- Thanks [~ajisakaa] for reporting the is

[jira] [Updated] (MAPREDUCE-6864) Hadoop streaming creates 2 mappers when the input has only one block

2017-03-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6864: -- Target Version/s: 2.8.1 > Hadoop streaming creates 2 mappers when the input has only one blo

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

2017-03-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Fix Version/s: 3.0.0-alpha3 > Job#updateStatus() failed with NPE due to race condition > ---

[jira] [Commented] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

2017-03-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892827#comment-15892827 ] Junping Du commented on MAPREDUCE-6852: --- Thanks Jian for review and commit! > J

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

2017-02-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Status: Patch Available (was: Open) > Job#updateStatus() failed with NPE due to race condit

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

2017-02-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Attachment: MAPREDUCE-6852-v2.patch Sounds reasonable. v2 patch incorporate comments here.

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

2017-02-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Status: Open (was: Patch Available) > Job#updateStatus() failed with NPE due to race condit

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

2017-02-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Attachment: MAPREDUCE-6852.patch Upload a quick patch to fix this issue. Not include any uni

[jira] [Updated] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

2017-02-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6852: -- Status: Patch Available (was: Open) > Job#updateStatus() failed with NPE due to race condit

[jira] [Created] (MAPREDUCE-6852) Job#updateStatus() failed with NPE due to race condition

2017-02-28 Thread Junping Du (JIRA)
Junping Du created MAPREDUCE-6852: - Summary: Job#updateStatus() failed with NPE due to race condition Key: MAPREDUCE-6852 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6852 Project: Hadoop Map/R

[jira] [Updated] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

2017-02-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6404: -- Release Note: Add a new configuration - "yarn.app.mapreduce.am.webapp.port-range" to specify

[jira] [Updated] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

2017-02-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6404: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

2017-02-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15855394#comment-15855394 ] Junping Du commented on MAPREDUCE-6404: --- Thanks [~varun_saxena] for updating the

[jira] [Commented] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

2017-02-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853674#comment-15853674 ] Junping Du commented on MAPREDUCE-6404: --- Patch looks good - just some checkstyle

[jira] [Updated] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

2017-02-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6404: -- Status: Patch Available (was: In Progress) > Allow AM to specify a port range for starting

[jira] [Assigned] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

2017-02-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-6404: - Assignee: Junping Du (was: Varun Saxena) > Allow AM to specify a port range for star

[jira] [Assigned] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

2017-02-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-6404: - Assignee: Varun Saxena (was: Junping Du) > Allow AM to specify a port range for star

[jira] [Commented] (MAPREDUCE-6404) Allow AM to specify a port range for starting its webapp

2017-02-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853487#comment-15853487 ] Junping Du commented on MAPREDUCE-6404: --- HADOOP-12097 already get commit in. Sub

[jira] [Updated] (MAPREDUCE-6338) MR AppMaster does not honor ephemeral port range

2017-02-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6338: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (MAPREDUCE-6825) YARNRunner#createApplicationSubmissionContext method is longer than 150 lines

2017-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850821#comment-15850821 ] Junping Du commented on MAPREDUCE-6825: --- Thanks [~ctrezzo] for review! Patch LGT

[jira] [Updated] (MAPREDUCE-6338) MR AppMaster does not honor ephemeral port range

2017-01-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6338: -- Status: Patch Available (was: Open) > MR AppMaster does not honor ephemeral port range > --

[jira] [Commented] (MAPREDUCE-6338) MR AppMaster does not honor ephemeral port range

2017-01-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834489#comment-15834489 ] Junping Du commented on MAPREDUCE-6338: --- Forget my comments above, I double chec

[jira] [Updated] (MAPREDUCE-6711) JobImpl fails to handle preemption events on state COMMITTING

2017-01-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6711: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (MAPREDUCE-6670) TestJobListCache#testEviction sometimes fails on Windows with timeout

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6670: -- Fix Version/s: (was: 2.9.0) > TestJobListCache#testEviction sometimes fails on Windows w

[jira] [Updated] (MAPREDUCE-6801) Fix flaky TestKill.testKillJob()

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6801: -- Fix Version/s: (was: 2.9.0) > Fix flaky TestKill.testKillJob() > ---

[jira] [Updated] (MAPREDUCE-6541) Exclude scheduled reducer memory when calculating available mapper slots from headroom to avoid deadlock

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6541: -- Fix Version/s: (was: 2.9.0) > Exclude scheduled reducer memory when calculating availabl

[jira] [Updated] (MAPREDUCE-2631) Potential resource leaks in BinaryProtocol$TeeOutputStream.java

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-2631: -- Fix Version/s: (was: 2.9.0) > Potential resource leaks in BinaryProtocol$TeeOutputStream

[jira] [Updated] (MAPREDUCE-6622) Add capability to set JHS job cache to a task-based limit

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6622: -- Fix Version/s: (was: 2.9.0) > Add capability to set JHS job cache to a task-based limit

[jira] [Updated] (MAPREDUCE-6577) MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6577: -- Fix Version/s: (was: 2.9.0) > MR AM unable to load native library without MR_AM_ADMIN_US

[jira] [Updated] (MAPREDUCE-5883) "Total megabyte-seconds" in job counters is slightly misleading

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5883: -- Fix Version/s: 2.8.0 > "Total megabyte-seconds" in job counters is slightly misleading > ---

[jira] [Updated] (MAPREDUCE-6387) Serialize the recently added Task#encryptedSpillKey field at the end

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6387: -- Fix Version/s: 2.8.0 > Serialize the recently added Task#encryptedSpillKey field at the end

[jira] [Updated] (MAPREDUCE-6451) DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6451: -- Fix Version/s: 2.8.0 > DistCp has incorrect chunkFilePath for multiple jobs when strategy is

[jira] [Updated] (MAPREDUCE-6518) Set SO_KEEPALIVE on shuffle connections

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6518: -- Fix Version/s: 2.8.0 > Set SO_KEEPALIVE on shuffle connections > ---

[jira] [Updated] (MAPREDUCE-6497) Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6497: -- Fix Version/s: 2.8.0 > Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler > ---

[jira] [Updated] (MAPREDUCE-6474) ShuffleHandler can possibly exhaust nodemanager file descriptors

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6474: -- Fix Version/s: 2.8.0 > ShuffleHandler can possibly exhaust nodemanager file descriptors > --

  1   2   3   4   5   6   7   >