[jira] [Commented] (MAPREDUCE-6597) Distcp should move the path to trash when delete missing path from source

[ https://issues.apache.org/jira/browse/MAPREDUCE-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082546#comment-15082546 ] Tsz Wo Nicholas Sze commented on MAPREDUCE-6597: > ... We should add t

[jira] [Commented] (MAPREDUCE-6564) distcp creates missing perent directories which is inconsistent with fs -cp

[ https://issues.apache.org/jira/browse/MAPREDUCE-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045533#comment-15045533 ] Tsz Wo Nicholas Sze commented on MAPREDUCE-6564: Sure, let's discuss h

[jira] [Updated] (MAPREDUCE-6564) distcp creates missing perent directories which is inconsistent with fs -cp

[ https://issues.apache.org/jira/browse/MAPREDUCE-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-6564: --- Description: fs -cp will fail if the destination parent directory does not

[jira] [Created] (MAPREDUCE-6564) distcp creates missing perent directories which is inconsistent with fs -cp

Tsz Wo Nicholas Sze created MAPREDUCE-6564: -- Summary: distcp creates missing perent directories which is inconsistent with fs -cp Key: MAPREDUCE-6564 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6

[jira] [Assigned] (MAPREDUCE-5010) use multithreading to speed up mergeParts and try MapPartitionsCompleteEvent to schedule fetch in reduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-5010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned MAPREDUCE-5010: -- Assignee: (was: Tsz Wo Nicholas Sze) > use multithreading to sp

[jira] [Updated] (MAPREDUCE-6123) TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-6123: --- Hadoop Flags: Reviewed +1 patch looks good. > TestCombineFileInputFormat

[jira] [Updated] (MAPREDUCE-6122) TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-6122: --- Hadoop Flags: Reviewed +1 patch looks good. > TestLineRecordReader may fa

[jira] [Updated] (MAPREDUCE-5899) Support incremental data copy in DistCp

[ https://issues.apache.org/jira/browse/MAPREDUCE-5899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-5899: --- +1 the new patch looks good. > Support incremental data copy in DistCp > ---

[jira] [Updated] (MAPREDUCE-5899) Support incremental data copy in DistCp

[ https://issues.apache.org/jira/browse/MAPREDUCE-5899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-5899: --- Component/s: distcp Traditionally, distcp is a MapReduce component. Movi

[jira] [Moved] (MAPREDUCE-5899) Support incremental data copy in DistCp

[ https://issues.apache.org/jira/browse/MAPREDUCE-5899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze moved HADOOP-10608 to MAPREDUCE-5899: - Key: MAPREDUCE-5899 (was: HADOOP-10608)

[jira] [Updated] (MAPREDUCE-5809) Enhance distcp to support preserving HDFS ACLs.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-5809: --- Hadoop Flags: Reviewed +1 patch looks good. > Enhance distcp to support

[jira] [Commented] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996487#comment-13996487 ] Tsz Wo Nicholas Sze commented on MAPREDUCE-5081: By hdfs2, do you mean

[jira] [Commented] (MAPREDUCE-5809) Enhance distcp to support preserving HDFS ACLs.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992522#comment-13992522 ] Tsz Wo Nicholas Sze commented on MAPREDUCE-5809: Thanks for the update

[jira] [Commented] (MAPREDUCE-5809) Enhance distcp to support preserving HDFS ACLs.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13991301#comment-13991301 ] Tsz Wo Nicholas Sze commented on MAPREDUCE-5809: If we cannot change F

[jira] [Updated] (MAPREDUCE-5402) DynamicInputFormat should allow overriding of MAX_CHUNKS_TOLERABLE

[ https://issues.apache.org/jira/browse/MAPREDUCE-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-5402: --- Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved

[jira] [Updated] (MAPREDUCE-5402) DynamicInputFormat should allow overriding of MAX_CHUNKS_TOLERABLE

[ https://issues.apache.org/jira/browse/MAPREDUCE-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-5402: --- Hadoop Flags: Reviewed +1 the new patch looks good. > DynamicInputFormat

[jira] [Commented] (MAPREDUCE-5809) Enhance distcp to support preserving HDFS ACLs.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13990222#comment-13990222 ] Tsz Wo Nicholas Sze commented on MAPREDUCE-5809: > If we do that, then

[jira] [Commented] (MAPREDUCE-5402) DynamicInputFormat should allow overriding of MAX_CHUNKS_TOLERABLE

[ https://issues.apache.org/jira/browse/MAPREDUCE-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13989242#comment-13989242 ] Tsz Wo Nicholas Sze commented on MAPREDUCE-5402: {code} + public stat

[jira] [Commented] (MAPREDUCE-5809) Enhance distcp to support preserving HDFS ACLs.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13989235#comment-13989235 ] Tsz Wo Nicholas Sze commented on MAPREDUCE-5809: - CopyCommitter shoul

[jira] [Commented] (MAPREDUCE-5402) DynamicInputFormat should allow overriding of MAX_CHUNKS_TOLERABLE

[ https://issues.apache.org/jira/browse/MAPREDUCE-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984168#comment-13984168 ] Tsz Wo Nicholas Sze commented on MAPREDUCE-5402: - In createSplits(..)

[jira] [Commented] (MAPREDUCE-5402) DynamicInputFormat should allow overriding of MAX_CHUNKS_TOLERABLE

[ https://issues.apache.org/jira/browse/MAPREDUCE-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983862#comment-13983862 ] Tsz Wo Nicholas Sze commented on MAPREDUCE-5402: Sure, I should be abl

[jira] [Commented] (MAPREDUCE-5830) HostUtil.getTaskLogUrl is not backwards binary compatible with 2.3

[ https://issues.apache.org/jira/browse/MAPREDUCE-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13967571#comment-13967571 ] Tsz Wo Nicholas Sze commented on MAPREDUCE-5830: Should we fix it in H

[jira] [Resolved] (MAPREDUCE-4976) Use the new StringUtils methods added by HADOOP-9252

[ https://issues.apache.org/jira/browse/MAPREDUCE-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved MAPREDUCE-4976. Resolution: Not A Problem This is actually not a problem. > Use the ne

[jira] [Updated] (MAPREDUCE-5794) SliveMapper always uses default FileSystem.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-5794: --- Attachment: m5794_20140311.patch m5794_20140311.patch: gets path from bas

[jira] [Updated] (MAPREDUCE-5794) SliveMapper always uses default FileSystem.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-5794: --- Status: Patch Available (was: Open) > SliveMapper always uses default Fi

[jira] [Created] (MAPREDUCE-5794) SliveMapper always uses default FileSystem.

Tsz Wo Nicholas Sze created MAPREDUCE-5794: -- Summary: SliveMapper always uses default FileSystem. Key: MAPREDUCE-5794 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5794 Project: Hadoop

[jira] [Updated] (MAPREDUCE-5780) SliveTest always uses default FileSystem

[ https://issues.apache.org/jira/browse/MAPREDUCE-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-5780: --- Resolution: Fixed Fix Version/s: 2.4.0 Hadoop Flags: Reviewed

[jira] [Updated] (MAPREDUCE-5780) SliveTest always uses default FileSystem

[ https://issues.apache.org/jira/browse/MAPREDUCE-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-5780: --- Attachment: m5780_20140305.patch m5780_20140305.patch: uses Path.getFileS

[jira] [Updated] (MAPREDUCE-5780) SliveTest always uses default FileSystem

[ https://issues.apache.org/jira/browse/MAPREDUCE-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated MAPREDUCE-5780: --- Status: Patch Available (was: Open) > SliveTest always uses default File

[jira] [Created] (MAPREDUCE-5780) SliveTest always uses default FileSystem

Tsz Wo (Nicholas), SZE created MAPREDUCE-5780: - Summary: SliveTest always uses default FileSystem Key: MAPREDUCE-5780 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5780 Project: Hado

[jira] [Commented] (MAPREDUCE-5715) ProcfsBasedProcessTree#constructProcessInfo() can still throw NumberFormatException

[ https://issues.apache.org/jira/browse/MAPREDUCE-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13867535#comment-13867535 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5715: --- It looks like t

[jira] [Updated] (MAPREDUCE-5604) TestMRAMWithNonNormalizedCapabilities fails on Windows due to exceeding max path length

[ https://issues.apache.org/jira/browse/MAPREDUCE-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5604: -- Component/s: (was: client) Hadoop Flags: Reviewed +1 patch

[jira] [Commented] (MAPREDUCE-5131) Provide better handling of job status related apis during JT restart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13623800#comment-13623800 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5131: --- +1 the new patc

[jira] [Commented] (MAPREDUCE-5131) Provide better handling of job status related apis during JT restart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13623783#comment-13623783 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5131: --- The defaultPoli

[jira] [Resolved] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved MAPREDUCE-5081. --- Resolution: Fixed Fix Version/s: 1.2.0 Hadoop Flags: R

[jira] [Updated] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5081: -- Attachment: m5081_20130328b.patch Oops, I accidentally added a new

[jira] [Updated] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5081: -- Attachment: m5081_20130328.patch m5081_20130328.patch: - keeps dist

[jira] [Commented] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615978#comment-13615978 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5081: --- {quote} > 1. ss

[jira] [Updated] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5081: -- Attachment: DistCp.java.diff DistCp.java.diff: diff between branch-

[jira] [Commented] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615961#comment-13615961 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5081: --- > 1. sslConfig.

[jira] [Commented] (MAPREDUCE-5014) Extending DistCp through a custom CopyListing is not possible

[ https://issues.apache.org/jira/browse/MAPREDUCE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611705#comment-13611705 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5014: --- I have combine

[jira] [Commented] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611553#comment-13611553 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5081: --- For m5981_20130

[jira] [Updated] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5081: -- Attachment: m5981_20130323.patch m5981_20130323.patch: includes MAP

[jira] [Updated] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5081: -- Description: Here is a list of DistCpV2 JIRAs: - MAPREDUCE-2765: Di

[jira] [Commented] (MAPREDUCE-5014) Extending DistCp through a custom CopyListing is not possible

[ https://issues.apache.org/jira/browse/MAPREDUCE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13610328#comment-13610328 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5014: --- Hi Amareshwari,

[jira] [Updated] (MAPREDUCE-5014) Extending DistCp through a custom CopyListing is not possible

[ https://issues.apache.org/jira/browse/MAPREDUCE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5014: -- Attachment: m5014_20130322b.patch m5014_20130322b.patch: add timeou

[jira] [Updated] (MAPREDUCE-5014) Extending DistCp through a custom CopyListing is not possible

[ https://issues.apache.org/jira/browse/MAPREDUCE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5014: -- Attachment: m5014_20130322b_b-1.patch > Extending DistCp throug

[jira] [Commented] (MAPREDUCE-5014) Extending DistCp through a custom CopyListing is not possible

[ https://issues.apache.org/jira/browse/MAPREDUCE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13609900#comment-13609900 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5014: --- > -1 one of tes

[jira] [Updated] (MAPREDUCE-5014) Extending DistCp through a custom CopyListing is not possible

[ https://issues.apache.org/jira/browse/MAPREDUCE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5014: -- Attachment: m5014_20130322_b-1.patch m5014_20130322_b-1.patch: for

[jira] [Updated] (MAPREDUCE-5014) Extending DistCp through a custom CopyListing is not possible

[ https://issues.apache.org/jira/browse/MAPREDUCE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5014: -- Attachment: m5014_20130322.patch Since it is trivial to add timeout

[jira] [Commented] (MAPREDUCE-5014) Extending DistCp through a custom CopyListing is not possible

[ https://issues.apache.org/jira/browse/MAPREDUCE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13609835#comment-13609835 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5014: --- Patch looks goo

[jira] [Commented] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13609238#comment-13609238 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5081: --- All tests passe

[jira] [Commented] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13608846#comment-13608846 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5081: --- {noformat}

[jira] [Updated] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5081: -- Attachment: m5981_20130321b.patch Two of the findbugs warnings are

[jira] [Commented] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13608805#comment-13608805 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-5081: --- {noformat}

[jira] [Updated] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5081: -- Attachment: m5981_20130321.patch m5981_20130321.patch: backports al

[jira] [Updated] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5081: -- Description: Here is a list of DistCpV2 JIRAs: - MAPREDUCE-2765: Di

[jira] [Updated] (MAPREDUCE-5075) DistCp leaks input file handles

[ https://issues.apache.org/jira/browse/MAPREDUCE-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5075: -- Resolution: Fixed Fix Version/s: 2.0.5-beta Status

[jira] [Updated] (MAPREDUCE-5075) DistCp leaks input file handles

[ https://issues.apache.org/jira/browse/MAPREDUCE-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-5075: -- Hadoop Flags: Reviewed +1 patch looks good. > Dist

[jira] [Created] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

Tsz Wo (Nicholas), SZE created MAPREDUCE-5081: - Summary: Backport DistCpV2 and the related JIRAs to branch-1 Key: MAPREDUCE-5081 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5081 Pr

[jira] [Commented] (MAPREDUCE-4502) Multi-level aggregation with combining the result of maps per node/rack

[ https://issues.apache.org/jira/browse/MAPREDUCE-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584591#comment-13584591 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4502: --- In the [consol

[jira] [Updated] (MAPREDUCE-4976) Use the new StringUtils methods added by HADOOP-9252

[ https://issues.apache.org/jira/browse/MAPREDUCE-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-4976: -- Description: HADOOP-9252 slightly changed the format of some StringU

[jira] [Updated] (MAPREDUCE-4976) Fix test failure for HADOOP-9252

[ https://issues.apache.org/jira/browse/MAPREDUCE-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-4976: -- Description: HADOOP-9252 slightly changes the format of some String

[jira] [Created] (MAPREDUCE-4976) Fix test failure for HADOOP-9252

Tsz Wo (Nicholas), SZE created MAPREDUCE-4976: - Summary: Fix test failure for HADOOP-9252 Key: MAPREDUCE-4976 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4976 Project: Hadoop Map/R

[jira] [Commented] (MAPREDUCE-4651) Benchmarking random reads with DFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-4651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465601#comment-13465601 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4651: --- Oops, I forgot

[jira] [Commented] (MAPREDUCE-4651) Benchmarking random reads with DFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-4651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464794#comment-13464794 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4651: --- Hi Konstantin,

[jira] [Commented] (MAPREDUCE-4603) Allow JobClient to retry job-submission when JT is in safemode

[ https://issues.apache.org/jira/browse/MAPREDUCE-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462854#comment-13462854 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4603: --- +1 patch looks

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418031#comment-13418031 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4309: --- Abstract Factor

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13409267#comment-13409267 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4309: --- - Since JobCoun

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13407705#comment-13407705 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4309: --- Quick comments:

[jira] [Commented] (MAPREDUCE-4310) 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN)

[ https://issues.apache.org/jira/browse/MAPREDUCE-4310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406814#comment-13406814 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4310: --- I think we shou

[jira] [Commented] (MAPREDUCE-4323) NM leaks sockets

[ https://issues.apache.org/jira/browse/MAPREDUCE-4323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291175#comment-13291175 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4323: --- This looks like

[jira] [Commented] (MAPREDUCE-4266) remove Ant remnants from MR

[ https://issues.apache.org/jira/browse/MAPREDUCE-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278222#comment-13278222 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4266: --- As you mentione

[jira] [Commented] (MAPREDUCE-4266) remove Ant remnants from MR

[ https://issues.apache.org/jira/browse/MAPREDUCE-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278144#comment-13278144 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4266: --- Are these filed

[jira] [Updated] (MAPREDUCE-4231) Update RAID to not to use FSInodeInfo

[ https://issues.apache.org/jira/browse/MAPREDUCE-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-4231: -- Resolution: Fixed Fix Version/s: 2.0.0 Hadoop Flags: Rev

[jira] [Updated] (MAPREDUCE-4231) Update RAID to not to use FSInodeInfo

[ https://issues.apache.org/jira/browse/MAPREDUCE-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-4231: -- Attachment: m4231_20120507.patch m4231_20120507.patch: use BlockCol

[jira] [Updated] (MAPREDUCE-4231) Update RAID to not to use FSInodeInfo

[ https://issues.apache.org/jira/browse/MAPREDUCE-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-4231: -- Assignee: Tsz Wo (Nicholas), SZE Status: Patch Available (was

[jira] [Moved] (MAPREDUCE-4231) Update RAID to not to use FSInodeInfo

[ https://issues.apache.org/jira/browse/MAPREDUCE-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE moved HDFS-3380 to MAPREDUCE-4231: - Component/s: (was: contrib/raid)

[jira] [Commented] (MAPREDUCE-4172) Clean up java warnings in the hadoop-mapreduce-project sub projects

[ https://issues.apache.org/jira/browse/MAPREDUCE-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265598#comment-13265598 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4172: --- In general, I a

[jira] [Commented] (MAPREDUCE-4183) Clean up yarn-common

[ https://issues.apache.org/jira/browse/MAPREDUCE-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265595#comment-13265595 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4183: --- Please do not a

[jira] [Commented] (MAPREDUCE-4182) Clean up yarn-applications-distributedshell

[ https://issues.apache.org/jira/browse/MAPREDUCE-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265592#comment-13265592 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4182: --- Typo: "used" sh

[jira] [Commented] (MAPREDUCE-4181) Clean up yarn-api

[ https://issues.apache.org/jira/browse/MAPREDUCE-4181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265591#comment-13265591 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4181: --- Could you revis

[jira] [Commented] (MAPREDUCE-4182) Clean up yarn-applications-distributedshell

[ https://issues.apache.org/jira/browse/MAPREDUCE-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265589#comment-13265589 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4182: --- Since only an u

[jira] [Commented] (MAPREDUCE-4174) Clean up hadoop-mapreduce-client-common

[ https://issues.apache.org/jira/browse/MAPREDUCE-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265587#comment-13265587 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4174: --- {code} +@Suppre

[jira] [Commented] (MAPREDUCE-4176) Clean up hadoop-mapreduce-client-hs

[ https://issues.apache.org/jira/browse/MAPREDUCE-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265588#comment-13265588 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4176: --- Please do not a

[jira] [Commented] (MAPREDUCE-4172) Clean up java warnings in the hadoop-mapreduce-project sub projects

[ https://issues.apache.org/jira/browse/MAPREDUCE-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265583#comment-13265583 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4172: --- Hi Harsh, pleas

[jira] [Updated] (MAPREDUCE-4074) Client continuously retries to RM When RM goes down before launching Application Master

[ https://issues.apache.org/jira/browse/MAPREDUCE-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-4074: -- Assignee: xieguiming > Client continuously retries to RM When R

[jira] [Updated] (MAPREDUCE-4066) To get "yarn.app.mapreduce.am.staging-dir" value, should set the default value

[ https://issues.apache.org/jira/browse/MAPREDUCE-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-4066: -- Assignee: xieguiming > To get "yarn.app.mapreduce.am.staging-di

[jira] [Moved] (MAPREDUCE-4192) the TaskMemoryManager thread is not interrupt when the TaskTracker is oedered to reinit by JobTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE moved HADOOP-8300 to MAPREDUCE-4192: --- Affects Version/s: (was: 0.20.2)

[jira] [Updated] (MAPREDUCE-3076) TestSleepJob fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-3076: -- Resolution: Fixed Fix Version/s: 0.20.206.0 Status

[jira] [Updated] (MAPREDUCE-3076) TestSleepJob fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-3076: -- Hadoop Flags: [Reviewed] +1 patch looks good. After the patch, Tes

[jira] [Commented] (MAPREDUCE-2981) Backport trunk fairscheduler to 0.20-security branch

[ https://issues.apache.org/jira/browse/MAPREDUCE-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113014#comment-13113014 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-2981: --- TestSleepJob fa

[jira] [Updated] (MAPREDUCE-2711) TestBlockPlacementPolicyRaid cannot be compiled

[ https://issues.apache.org/jira/browse/MAPREDUCE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-2711: -- Resolution: Fixed Fix Version/s: 0.24.0 0.

[jira] [Updated] (MAPREDUCE-2711) TestBlockPlacementPolicyRaid cannot be compiled

[ https://issues.apache.org/jira/browse/MAPREDUCE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-2711: -- Description: {{TestBlockPlacementPolicyRaid}} access internal {{FSN

[jira] [Updated] (MAPREDUCE-2711) TestBlockPlacementPolicyRaid cannot be compiled

[ https://issues.apache.org/jira/browse/MAPREDUCE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-2711: -- Status: Patch Available (was: In Progress) > TestBlockPlacementPol

[jira] [Updated] (MAPREDUCE-2711) TestBlockPlacementPolicyRaid cannot be compiled

[ https://issues.apache.org/jira/browse/MAPREDUCE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-2711: -- Attachment: m2711_20110908.patch m2711_20110908.patch: updated with

[jira] [Work started] (MAPREDUCE-2711) TestBlockPlacementPolicyRaid cannot be compiled

[ https://issues.apache.org/jira/browse/MAPREDUCE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on MAPREDUCE-2711 started by Tsz Wo (Nicholas), SZE. > TestBlockPlacementPolicyRaid cannot be compiled > --- > >

[jira] [Resolved] (MAPREDUCE-2805) Update RAID for HDFS-2241

[ https://issues.apache.org/jira/browse/MAPREDUCE-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved MAPREDUCE-2805. --- Resolution: Fixed Fix Version/s: 0.23.0 Hadoop Flags:

[jira] [Updated] (MAPREDUCE-2711) TestBlockPlacementPolicyRaid cannot be compiled

[ https://issues.apache.org/jira/browse/MAPREDUCE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-2711: -- Attachment: m2711_20110818.patch m2711_20110818.patch: last patch b

[jira] [Commented] (MAPREDUCE-2805) Update RAID for HDFS-2241

[ https://issues.apache.org/jira/browse/MAPREDUCE-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082976#comment-13082976 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-2805: --- Checked it manu

  1   2   3   4   5   >