[jira] [Updated] (MAPREDUCE-7370) Parallelize MultipleOutputs#close call

2023-06-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-7370: --- Fix Version/s: 3.4.0 > Parallelize MultipleOutputs#close call > -

[jira] [Updated] (MAPREDUCE-7303) Fix TestJobResourceUploader failures after HADOOP-16878

2021-06-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-7303: --- Fix Version/s: (was: 3.3.1) > Fix TestJobResourceUploader failures after HADO

[jira] [Reopened] (MAPREDUCE-7303) Fix TestJobResourceUploader failures after HADOOP-16878

2021-06-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened MAPREDUCE-7303: We're reverting HADOOP-16878 so this should be reverted as well. > Fix TestJobReso

[jira] [Updated] (MAPREDUCE-7298) Distcp doesn't close the job after the job is completed

2021-05-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-7298: --- Target Version/s: 3.3.2 > Distcp doesn't close the job after the job is completed

[jira] [Updated] (MAPREDUCE-7348) TestFrameworkUploader#testNativeIO fails

2021-05-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-7348: --- Fix Version/s: 3.3.1 > TestFrameworkUploader#testNativeIO fails > ---

[jira] [Commented] (MAPREDUCE-7348) TestFrameworkUploader#testNativeIO fails

2021-05-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17351575#comment-17351575 ] Wei-Chiu Chuang commented on MAPREDUCE-7348: Ok thank you. I had to rev

[jira] [Commented] (MAPREDUCE-7324) ClientHSSecurityInfo class is in wrong META-INF file

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345850#comment-17345850 ] Wei-Chiu Chuang commented on MAPREDUCE-7324: For future reference, the gi

[jira] [Updated] (MAPREDUCE-7287) Distcp will delete exists file , If we use "-delete and -update" options and distcp file.

2021-05-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-7287: --- Fix Version/s: (was: 3.3.1) > Distcp will delete exists file , If we use "-d

[jira] [Updated] (MAPREDUCE-7290) ShuffleHeader should be compatible between client&server when rolling update

2021-05-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-7290: --- Target Version/s: 3.3.2 (was: 3.3.1) > ShuffleHeader should be compatible betwee

[jira] [Updated] (MAPREDUCE-7290) ShuffleHeader should be compatible between client&server when rolling update

2021-04-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-7290: --- ===Bulk update=== I am planning to cut the branch for Hadoop 3.3.1 release, and this

[jira] [Updated] (MAPREDUCE-7290) ShuffleHeader should be compatible between client&server when rolling update

2021-04-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-7290: --- Target Version/s: 3.3.1 (was: 3.3.0) > ShuffleHeader should be compatible betwee

[jira] [Updated] (MAPREDUCE-6879) TestDFSIO#sequentialTest throws java.lang.NullPointerException due to uninitialized IOStream

2019-08-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-6879: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) The PR was

[jira] [Assigned] (MAPREDUCE-7082) Fix FileInputFormat throw java.lang.ArrayIndexOutOfBoundsException(0)

2019-08-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned MAPREDUCE-7082: -- Assignee: tartarus > Fix FileInputFormat throw java.lang.ArrayIndexOutOfBo

[jira] [Commented] (MAPREDUCE-7082) Fix FileInputFormat throw java.lang.ArrayIndexOutOfBoundsException(0)

2019-08-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908573#comment-16908573 ] Wei-Chiu Chuang commented on MAPREDUCE-7082: -1 sorry this change breaks

[jira] [Assigned] (MAPREDUCE-7168) Add option to not kill already-done map tasks when node becomes unusable

2019-08-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned MAPREDUCE-7168: -- Assignee: Mikayla Konst > Add option to not kill already-done map tasks wh

[jira] [Assigned] (MAPREDUCE-7171) Add additional cleanup hook to the app master

2019-08-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned MAPREDUCE-7171: -- Assignee: Mikayla Konst > Add additional cleanup hook to the app master >

[jira] [Assigned] (MAPREDUCE-7173) Add ability to shuffle intermediate map task output to a distributed filesystem

2019-08-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned MAPREDUCE-7173: -- Assignee: Mikayla Konst > Add ability to shuffle intermediate map task out

[jira] [Assigned] (MAPREDUCE-7187) RMContainerAllocator.ScheduledRequests#getContainerReqToReplace may not find a task when the priority of container is PRIORITY_MAP

2019-08-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned MAPREDUCE-7187: -- Assignee: Zhizhen Hou > RMContainerAllocator.ScheduledRequests#getContaine

[jira] [Assigned] (MAPREDUCE-7186) JobSubmitter#checkSpecs doesn not handle the situation when reduceNums is set less than zero.

2019-08-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned MAPREDUCE-7186: -- Assignee: Hongyuan Li > JobSubmitter#checkSpecs doesn not handle the situa

[jira] [Assigned] (MAPREDUCE-7183) Make app master recover history from latest history file that exists

2019-08-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned MAPREDUCE-7183: -- Assignee: Mikayla Konst > Make app master recover history from latest hist

[jira] [Commented] (MAPREDUCE-7187) RMContainerAllocator.ScheduledRequests#getContainerReqToReplace may not find a task when the priority of container is PRIORITY_MAP

2019-08-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898372#comment-16898372 ] Wei-Chiu Chuang commented on MAPREDUCE-7187: [~jiwq] can you help review

[jira] [Assigned] (MAPREDUCE-7202) file offset is not ignored by default in hadoop streaming using CombineTextInputformat

2019-08-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned MAPREDUCE-7202: -- Assignee: sandflee > file offset is not ignored by default in hadoop strea

[jira] [Commented] (MAPREDUCE-7223) Quicksort GetInt performance Issue in Terasort

2019-08-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898208#comment-16898208 ] Wei-Chiu Chuang commented on MAPREDUCE-7223: [~eepayne] [~jlowe] is this

[jira] [Assigned] (MAPREDUCE-7223) Quicksort GetInt performance Issue in Terasort

2019-08-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned MAPREDUCE-7223: -- Assignee: WuZeyi > Quicksort GetInt performance Issue in Terasort > --

[jira] [Assigned] (MAPREDUCE-7227) Fix job staging directory residual problem in a big yarn cluster composed of multiple independent hdfs clusters

2019-08-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned MAPREDUCE-7227: -- Assignee: Yuan LUO > Fix job staging directory residual problem in a big y

[jira] [Updated] (MAPREDUCE-7076) TestNNBench#testNNBenchCreateReadAndDelete failing in our internal build

2019-07-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-7076: --- Status: Patch Available (was: Open) > TestNNBench#testNNBenchCreateReadAndDelete

[jira] [Updated] (MAPREDUCE-7190) Add SleepJob additional parameter to make parallel runs distinguishable

2019-04-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-7190: --- Fix Version/s: 3.1.3 3.2.1 > Add SleepJob additional parameter

[jira] [Updated] (MAPREDUCE-7190) Add SleepJob additional parameter to make parallel runs distinguishable

2019-04-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-7190: --- Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: P

[jira] [Commented] (MAPREDUCE-7190) Add SleepJob additional parameter to make parallel runs distinguishable

2019-04-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16807010#comment-16807010 ] Wei-Chiu Chuang commented on MAPREDUCE-7190: Pushed to trunk. Thanks [~ad

[jira] [Commented] (MAPREDUCE-7190) Add SleepJob additional parameter to make parallel runs distinguishable

2019-04-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806992#comment-16806992 ] Wei-Chiu Chuang commented on MAPREDUCE-7190: +1 will commit shortly. > A

[jira] [Commented] (MAPREDUCE-6764) Teragen LOG initialization bug

2016-08-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437222#comment-15437222 ] Wei-Chiu Chuang commented on MAPREDUCE-6764: Committed this patch to trunk

[jira] [Commented] (MAPREDUCE-6764) Teragen LOG initialization bug

2016-08-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433093#comment-15433093 ] Wei-Chiu Chuang commented on MAPREDUCE-6764: +1 > Teragen LOG initializat

[jira] [Commented] (MAPREDUCE-6655) Fix a typo (STRICT_IE6) in Encrypted Shuffle

2016-03-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214149#comment-15214149 ] Wei-Chiu Chuang commented on MAPREDUCE-6655: Thanks [~djp] for reviewing a

[jira] [Commented] (MAPREDUCE-6655) Fix a typo (STRICT_IE6) in Encrypted Shuffle

2016-03-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204202#comment-15204202 ] Wei-Chiu Chuang commented on MAPREDUCE-6655: The asf licensing warning an

[jira] [Updated] (MAPREDUCE-6655) Fix a typo (STRICT_IE6) in Encrypted Shuffle

2016-03-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-6655: --- Attachment: MAPREDUCE-6655.001.patch Posted a trivial patch to fix the typo. > Fi

[jira] [Updated] (MAPREDUCE-6655) Fix a typo (STRICT_IE6) in Encrypted Shuffle

2016-03-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-6655: --- Issue Type: Bug (was: New Feature) > Fix a typo (STRICT_IE6) in Encrypted Shuffle

[jira] [Created] (MAPREDUCE-6655) Fix a typo (STRICT_IE6) in Encrypted Shuffle

2016-03-19 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created MAPREDUCE-6655: -- Summary: Fix a typo (STRICT_IE6) in Encrypted Shuffle Key: MAPREDUCE-6655 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6655 Project: Hadoop Map/Red

[jira] [Updated] (MAPREDUCE-6655) Fix a typo (STRICT_IE6) in Encrypted Shuffle

2016-03-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated MAPREDUCE-6655: --- Status: Patch Available (was: Open) > Fix a typo (STRICT_IE6) in Encrypted Shuffl