[jira] [Commented] (HADOOP-16622) intermittent failure of ITestCommitOperations: too many s3guard writes

2019-10-12 Thread Kai Xie (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16950216#comment-16950216 ] Kai Xie commented on HADOOP-16622: -- Hi [~ste...@apache.org], I'm using Singapore endp

[jira] [Commented] (HADOOP-16536) Backport HADOOP-16158 and HADOOP-15273 to branch-2

2019-08-28 Thread Kai Xie (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917926#comment-16917926 ] Kai Xie commented on HADOOP-16536: -- [~jojochuang] could you help take a look when you

[jira] [Updated] (HADOOP-16536) Backport HADOOP-16158 and HADOOP-15273 to branch-2

2019-08-28 Thread Kai Xie (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16536: - Status: Patch Available (was: Open) > Backport HADOOP-16158 and HADOOP-15273 to branch-2 > ---

[jira] [Commented] (HADOOP-16536) Backport HADOOP-16158 and HADOOP-15273 to branch-2

2019-08-28 Thread Kai Xie (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917873#comment-16917873 ] Kai Xie commented on HADOOP-16536: -- Backport HADOOP-15273 as well, because HADOOP-1615

[jira] [Updated] (HADOOP-16536) Backport HADOOP-16158 and HADOOP-15273 to branch-2

2019-08-28 Thread Kai Xie (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16536: - Summary: Backport HADOOP-16158 and HADOOP-15273 to branch-2 (was: Backport HADOOP-16158 to branch-2)

[jira] [Updated] (HADOOP-16536) Backport HADOOP-16158 to branch-2

2019-08-28 Thread Kai Xie (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16536: - Fix Version/s: (was: 3.1.3) (was: 3.2.1) (

[jira] [Created] (HADOOP-16536) Backport HADOOP-16158 to branch-2

2019-08-28 Thread Kai Xie (Jira)
Kai Xie created HADOOP-16536: Summary: Backport HADOOP-16158 to branch-2 Key: HADOOP-16536 URL: https://issues.apache.org/jira/browse/HADOOP-16536 Project: Hadoop Common Issue Type: Improvement

[jira] [Commented] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-08-18 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910141#comment-16910141 ] Kai Xie commented on HADOOP-16158: -- Thanks [~jojochuang] for reviewing the patch and m

[jira] [Commented] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-08-12 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905480#comment-16905480 ] Kai Xie commented on HADOOP-16158: -- I removed patch attachments to avoid confusions.

[jira] [Updated] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-08-12 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Attachment: (was: HADOOP-16158-002.patch) > DistCp to support checksum validation when copy blocks

[jira] [Updated] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-08-12 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Attachment: (was: HADOOP-16158-001.patch) > DistCp to support checksum validation when copy blocks

[jira] [Updated] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-08-12 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Attachment: (was: HADOOP-16158-005.patch) > DistCp to support checksum validation when copy blocks

[jira] [Updated] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-08-12 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Attachment: (was: HADOOP-16158-004.patch) > DistCp to support checksum validation when copy blocks

[jira] [Updated] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-08-12 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Attachment: (was: HADOOP-16158-003.patch) > DistCp to support checksum validation when copy blocks

[jira] [Commented] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-06-06 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858323#comment-16858323 ] Kai Xie commented on HADOOP-16158: -- Move trunk's patch to github and yetus gave +1 ove

[jira] [Commented] (HADOOP-16344) Make DurationInfo "public unstable"

2019-06-06 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858300#comment-16858300 ] Kai Xie commented on HADOOP-16344: -- Hi [~ste...@apache.org] the original patch + the f

[jira] [Comment Edited] (HADOOP-16344) Make DurationInfo "public unstable"

2019-06-06 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857855#comment-16857855 ] Kai Xie edited comment on HADOOP-16344 at 6/6/19 4:44 PM: -- Yes

[jira] [Commented] (HADOOP-16344) Make DurationInfo "public unstable"

2019-06-06 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857855#comment-16857855 ] Kai Xie commented on HADOOP-16344: -- Yes the trunk is failed to compile. How about thi

[jira] [Commented] (HADOOP-16259) Distcp to set S3 Storage Class

2019-04-23 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16824161#comment-16824161 ] Kai Xie commented on HADOOP-16259: -- class FSProtos is generated from protobuf [FSProt

[jira] [Commented] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-04-12 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16816848#comment-16816848 ] Kai Xie commented on HADOOP-16158: -- Thanks Steve for the review comments and backporti

[jira] [Updated] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-04-12 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Attachment: HADOOP-16158-005.patch > DistCp to support checksum validation when copy blocks in parallel

[jira] [Updated] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-04-12 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Status: Patch Available (was: Open) > DistCp to support checksum validation when copy blocks in parall

[jira] [Updated] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-04-12 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Status: Open (was: Patch Available) > DistCp to support checksum validation when copy blocks in parall

[jira] [Updated] (HADOOP-16158) DistCp to support checksum validation when copy blocks in parallel

2019-04-12 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Summary: DistCp to support checksum validation when copy blocks in parallel (was: DistCp to supports c

[jira] [Commented] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-04-03 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808670#comment-16808670 ] Kai Xie commented on HADOOP-16158: -- Hi [~ste...@apache.org], the patch (004) is ready

[jira] [Comment Edited] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-21 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16798264#comment-16798264 ] Kai Xie edited comment on HADOOP-16158 at 3/21/19 5:06 PM: --- H

[jira] [Commented] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-21 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16798264#comment-16798264 ] Kai Xie commented on HADOOP-16158: -- Hi [~ste...@apache.org], the patch (004) is ready

[jira] [Updated] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-21 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Status: Patch Available (was: Open) > DistCp supports checksum validation when copy blocks in parallel

[jira] [Updated] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-21 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Attachment: HADOOP-16158-004.patch > DistCp supports checksum validation when copy blocks in parallel >

[jira] [Updated] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-21 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Status: Open (was: Patch Available) > DistCp supports checksum validation when copy blocks in parallel

[jira] [Updated] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Attachment: HADOOP-16158-003.patch > DistCp supports checksum validation when copy blocks in parallel >

[jira] [Updated] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Status: Patch Available (was: Open) > DistCp supports checksum validation when copy blocks in parallel

[jira] [Updated] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Status: Open (was: Patch Available) > DistCp supports checksum validation when copy blocks in parallel

[jira] [Updated] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Status: Open (was: Patch Available) > DistCp supports checksum validation when copy blocks in parallel

[jira] [Updated] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Attachment: HADOOP-16158-002.patch > DistCp supports checksum validation when copy blocks in parallel >

[jira] [Updated] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Status: Patch Available (was: Open) > DistCp supports checksum validation when copy blocks in parallel

[jira] [Commented] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-18 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795179#comment-16795179 ] Kai Xie commented on HADOOP-16158: -- Going to add a test case for the change > DistCp

[jira] [Updated] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-18 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Attachment: HADOOP-16158-001.patch > DistCp supports checksum validation when copy blocks in parallel >

[jira] [Updated] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-18 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16158: - Status: Patch Available (was: Open) > DistCp supports checksum validation when copy blocks in parallel

[jira] [Comment Edited] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-04 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783384#comment-16783384 ] Kai Xie edited comment on HADOOP-16158 at 3/4/19 1:56 PM: -- Hi

[jira] [Commented] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-04 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783384#comment-16783384 ] Kai Xie commented on HADOOP-16158: -- Hi Steve, thanks for the comment. `isSplit` here

[jira] [Created] (HADOOP-16158) DistCp supports checksum validation when copy blocks in parallel

2019-03-02 Thread Kai Xie (JIRA)
Kai Xie created HADOOP-16158: Summary: DistCp supports checksum validation when copy blocks in parallel Key: HADOOP-16158 URL: https://issues.apache.org/jira/browse/HADOOP-16158 Project: Hadoop Common

[jira] [Commented] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-02-27 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780007#comment-16780007 ] Kai Xie commented on HADOOP-16018: -- Thanks Steve for reviewing and merging the patch!

[jira] [Commented] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-02-13 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16767388#comment-16767388 ] Kai Xie commented on HADOOP-16018: -- Hi [~ste...@apache.org] the patch branch-2-006 is

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-02-13 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Patch Available (was: Open) > DistCp won't reassemble chunks when blocks per chunk > 0 > -

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-02-13 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Open (was: Patch Available) > DistCp won't reassemble chunks when blocks per chunk > 0 > -

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-02-13 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Attachment: HADOOP-16018-branch-2-006.patch > DistCp won't reassemble chunks when blocks per chunk > 0

[jira] [Commented] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-02-13 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16767290#comment-16767290 ] Kai Xie commented on HADOOP-16049: -- Thanks Steve for reviewing and merging the patch!

[jira] [Commented] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-24 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751909#comment-16751909 ] Kai Xie commented on HADOOP-16049: -- So the patch (branch-2-005) should be ready for re

[jira] [Commented] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-23 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16750604#comment-16750604 ] Kai Xie commented on HADOOP-16049: -- [~ste...@apache.org] anything else you think shoul

[jira] [Commented] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-21 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16748093#comment-16748093 ] Kai Xie commented on HADOOP-16049: -- All right, jenkins is good! But I assume it can st

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-21 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Open (was: Patch Available) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Commented] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-21 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16747933#comment-16747933 ] Kai Xie commented on HADOOP-16049: -- submitted branch-2-005 with the checkstyle fix. b

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-21 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Attachment: HADOOP-16049-branch-2-005.patch > DistCp result has data and checksum mismatch when blocks

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-21 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Patch Available (was: Open) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Commented] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16747651#comment-16747651 ] Kai Xie commented on HADOOP-16049: -- Triggered 2 jenkins jobs, one passed and the other

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Attachment: HADOOP-16049-branch-2-003.patch > DistCp result has data and checksum mismatch when blocks

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Open (was: Patch Available) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Patch Available (was: Open) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Attachment: HADOOP-16049-branch-2-004.patch > DistCp result has data and checksum mismatch when blocks

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Attachment: (was: HADOOP-16049-branch-2-002.patch) > DistCp result has data and checksum mismatch w

[jira] [Commented] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16747618#comment-16747618 ] Kai Xie commented on HADOOP-16049: -- submitted patch branch-2-004 that contains both th

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Attachment: (was: HADOOP-16049-branch-2-001.patch) > DistCp result has data and checksum mismatch w

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Open (was: Patch Available) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Patch Available (was: Open) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Patch Available (was: Open) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Attachment: HADOOP-16049-branch-2-003.patch > DistCp result has data and checksum mismatch when blocks

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-20 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Open (was: Patch Available) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-19 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Open (was: Patch Available) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-19 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Patch Available (was: Open) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-19 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Attachment: HADOOP-16049-branch-2-002.patch > DistCp result has data and checksum mismatch when blocks

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-19 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Open (was: Patch Available) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-19 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Attachment: (was: fake-branch-2-001.patch) > DistCp result has data and checksum mismatch when bloc

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-19 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Attachment: HADOOP-16049-branch-2-001.patch > DistCp result has data and checksum mismatch when blocks

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-19 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Patch Available (was: Open) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-19 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Status: Patch Available (was: Open) > DistCp result has data and checksum mismatch when blocks per chu

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-19 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Attachment: fake-branch-2-001.patch > DistCp result has data and checksum mismatch when blocks per chun

[jira] [Assigned] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-18 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie reassigned HADOOP-16049: Assignee: Kai Xie > DistCp result has data and checksum mismatch when blocks per chunk > 0 > ---

[jira] [Commented] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-18 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746440#comment-16746440 ] Kai Xie commented on HADOOP-16049: -- I roughly have some ideas to resolve distcp's unit

[jira] [Comment Edited] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745720#comment-16745720 ] Kai Xie edited comment on HADOOP-16018 at 1/18/19 2:39 AM: --- T

[jira] [Commented] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745720#comment-16745720 ] Kai Xie commented on HADOOP-16018: -- Thanks for resolving the image building issue on b

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Attachment: HADOOP-16018-branch-2-005.patch > DistCp won't reassemble chunks when blocks per chunk > 0

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Patch Available (was: Open) > DistCp won't reassemble chunks when blocks per chunk > 0 > -

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Open (was: Patch Available) > DistCp won't reassemble chunks when blocks per chunk > 0 > -

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Attachment: HADOOP-16018-branch-2-004.patch > DistCp won't reassemble chunks when blocks per chunk > 0

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Patch Available (was: Open) > DistCp won't reassemble chunks when blocks per chunk > 0 > -

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Open (was: Patch Available) > DistCp won't reassemble chunks when blocks per chunk > 0 > -

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Description: In 2.9.2 RetriableFileCopyCommand.copyBytes, {code:java} int bytesRead = readBytes(inStrea

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Description: In 2.9.2 RetriableFileCopyCommand.copyBytes, {code:java} int bytesRead = readBytes(inStrea

[jira] [Comment Edited] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745112#comment-16745112 ] Kai Xie edited comment on HADOOP-16049 at 1/17/19 2:35 PM: --- H

[jira] [Comment Edited] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745112#comment-16745112 ] Kai Xie edited comment on HADOOP-16049 at 1/17/19 2:31 PM: --- H

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Description: In 2.9.2 RetriableFileCopyCommand.copyBytes, {code:java} int bytesRead = readBytes(inStrea

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Description: In 2.9.2 RetriableFileCopyCommand.copyBytes, {code:java} int bytesRead = readBytes(inStrea

[jira] [Commented] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745112#comment-16745112 ] Kai Xie commented on HADOOP-16049: -- This ticket has been resolved by HADOOP-15292 by n

[jira] [Comment Edited] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745112#comment-16745112 ] Kai Xie edited comment on HADOOP-16049 at 1/17/19 2:28 PM: --- T

[jira] [Updated] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16049: - Description: In 2.9.2 RetriableFileCopyCommand.copyBytes, {code:java} int bytesRead = readBytes(inStrea

[jira] [Created] (HADOOP-16049) DistCp result has data and checksum mismatch when blocks per chunk > 0

2019-01-17 Thread Kai Xie (JIRA)
Kai Xie created HADOOP-16049: Summary: DistCp result has data and checksum mismatch when blocks per chunk > 0 Key: HADOOP-16049 URL: https://issues.apache.org/jira/browse/HADOOP-16049 Project: Hadoop Comm

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-15 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Attachment: (was: HADOOP-16018-branch-2-003.patch) > DistCp won't reassemble chunks when blocks per

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-15 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Attachment: (was: HADOOP-16018-branch-2-004.patch) > DistCp won't reassemble chunks when blocks per

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-15 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Attachment: (was: HADOOP-16018-branch-2-005.patch) > DistCp won't reassemble chunks when blocks per

  1   2   >