[jira] [Commented] (HDFS-12090) Handling writes from HDFS to Provided storages

2018-06-18 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16516437#comment-16516437 ] Ewan Higgs commented on HDFS-12090: --- We had two phone meetings this week to cover use c

[jira] [Comment Edited] (HDFS-13310) [PROVIDED Phase 2] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-06-14 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513173#comment-16513173 ] Ewan Higgs edited comment on HDFS-13310 at 6/15/18 12:32 AM: -

[jira] [Commented] (HDFS-13310) [PROVIDED Phase 2] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-06-14 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513176#comment-16513176 ] Ewan Higgs commented on HDFS-13310: --- The protocol should also have the target storage u

[jira] [Commented] (HDFS-13310) [PROVIDED Phase 2] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-06-14 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513173#comment-16513173 ] Ewan Higgs commented on HDFS-13310: --- Feedback from [~chris.douglas]: PUT_FILE adds ext

[jira] [Commented] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-06-14 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512472#comment-16512472 ] Ewan Higgs commented on HDFS-13186: --- [~chris.douglas]'s patch looked good to me.   00

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-06-14 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: HDFS-13186.009.patch > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementation

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-06-14 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Open (was: Patch Available) > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementa

[jira] [Commented] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-06-06 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16503283#comment-16503283 ] Ewan Higgs commented on HDFS-13186: --- 007 * Forgot to add org.apache.hadoop.fs.s3a.S3AM

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-06-06 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Patch Available (was: Open) > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementa

[jira] [Commented] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-06-06 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16503281#comment-16503281 ] Ewan Higgs commented on HDFS-13186: --- 006 * Address asflicense issues * Address checks

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-06-06 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: HDFS-13186.007.patch > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementation

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-06-06 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Open (was: Patch Available) > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementa

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-06-06 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: HDFS-13186.006.patch > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementation

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-06-06 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Patch Available (was: Open) > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementa

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-06-06 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Open (was: Patch Available) > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementa

[jira] [Commented] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-05-25 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16490524#comment-16490524 ] Ewan Higgs commented on HDFS-13186: --- 005 * MultipartUploader$complete returns a PathHan

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-05-25 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: HDFS-13186.005.patch > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-05-25 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Patch Available (was: Open) > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementat

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-05-25 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Open (was: Patch Available) > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementat

[jira] [Reopened] (HDFS-12449) TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s

2018-05-23 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs reopened HDFS-12449: --- This test is timing out again. > TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot

[jira] [Created] (HDFS-13606) [PROVIDED Phase 2] Implement full resync command for syncservice

2018-05-23 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-13606: - Summary: [PROVIDED Phase 2] Implement full resync command for syncservice Key: HDFS-13606 URL: https://issues.apache.org/jira/browse/HDFS-13606 Project: Hadoop HDFS

[jira] [Created] (HDFS-13605) [PROVIDED Phase 2] Implement pause/resume for syncservice

2018-05-23 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-13605: - Summary: [PROVIDED Phase 2] Implement pause/resume for syncservice Key: HDFS-13605 URL: https://issues.apache.org/jira/browse/HDFS-13605 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13580) FailOnTimeout error in TestDataNodeVolumeFailure$testVolumeFailure

2018-05-17 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-13580: - Summary: FailOnTimeout error in TestDataNodeVolumeFailure$testVolumeFailure Key: HDFS-13580 URL: https://issues.apache.org/jira/browse/HDFS-13580 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13579) Out of memory when running TestDFSStripedOutputStreamWithFailure testCloseWithExceptionsInStreamer

2018-05-17 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16478753#comment-16478753 ] Ewan Higgs commented on HDFS-13579: --- ad1b988a828608b12cafb6382436cd17f95bfcc5 (HDFS-1160

[jira] [Created] (HDFS-13579) Out of memory when running TestDFSStripedOutputStreamWithFailure testCloseWithExceptionsInStreamer

2018-05-17 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-13579: - Summary: Out of memory when running TestDFSStripedOutputStreamWithFailure testCloseWithExceptionsInStreamer Key: HDFS-13579 URL: https://issues.apache.org/jira/browse/HDFS-13579

[jira] [Updated] (HDFS-12666) [PROVIDED Phase 2] Provided Storage Mount Manager (PSMM) mount

2018-05-04 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12666: -- Assignee: Ewan Higgs Status: Patch Available (was: Open) Attaching patch that implements the Moun

[jira] [Updated] (HDFS-12666) [PROVIDED Phase 2] Provided Storage Mount Manager (PSMM) mount

2018-05-04 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12666: -- Attachment: HDFS-12666-HDFS-12090.001.patch > [PROVIDED Phase 2] Provided Storage Mount Manager (PSMM) m

[jira] [Commented] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-04-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16458530#comment-16458530 ] Ewan Higgs commented on HDFS-13186: --- 004 - MPU learns abort. - FS MPU::complete forces o

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-04-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Release Note: (was: 004 - MPU learns abort. - FS MPU::complete forces ordering of parts. - further test

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-04-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Release Note: 004 - MPU learns abort. - FS MPU::complete forces ordering of parts. - further tests to as

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-04-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: HDFS-13186.004.patch > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

[jira] [Updated] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-04-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Open (was: Patch Available) > [PROVIDED Phase 2] Multipart Multinode uploader API + Implementat

[jira] [Commented] (HDFS-13186) [PROVIDED Phase 2] Multipart Multinode uploader API + Implementations

2018-04-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16456519#comment-16456519 ] Ewan Higgs commented on HDFS-13186: --- [~chris.douglas], thanks for the feedback. {quote}T

[jira] [Commented] (HDFS-13421) [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode

2018-04-10 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432041#comment-16432041 ] Ewan Higgs commented on HDFS-13421: --- -001 * Attached patch that implements the DNA_BACK

[jira] [Updated] (HDFS-13421) [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode

2018-04-10 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13421: -- Attachment: HDFS-13421-HDFS-12090.001.patch > [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanod

[jira] [Updated] (HDFS-13421) [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode

2018-04-10 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13421: -- Status: Patch Available (was: Open) > [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode > ---

[jira] [Created] (HDFS-13421) [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode

2018-04-10 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-13421: - Summary: [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode Key: HDFS-13421 URL: https://issues.apache.org/jira/browse/HDFS-13421 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-13310) [PROVIDED Phase 2] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-31 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421497#comment-16421497 ] Ewan Higgs commented on HDFS-13310: --- Hi Daryn, {quote}I don't understand why the DN need

[jira] [Commented] (HDFS-13310) [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-28 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418235#comment-16418235 ] Ewan Higgs commented on HDFS-13310: --- Submitting an updated patch (002) that adds offset

[jira] [Updated] (HDFS-13310) [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-28 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13310: -- Status: Patch Available (was: Open) > [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup

[jira] [Updated] (HDFS-13310) [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-28 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13310: -- Status: Open (was: Patch Available) > [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup

[jira] [Updated] (HDFS-13310) [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-28 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13310: -- Attachment: HDFS-13310-HDFS-12090.002.patch > [WRITE] The DatanodeProtocol should be have DNA_BACKUP to

[jira] [Updated] (HDFS-13310) [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-22 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13310: -- Status: Patch Available (was: Open) Adding patch that introduces the API between NN and DN through the

[jira] [Updated] (HDFS-13310) [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-22 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13310: -- Attachment: HDFS-13310-HDFS-12090.001.patch > [WRITE] The DatanodeProtocol should be have DNA_BACKUP to

[jira] [Created] (HDFS-13310) [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-19 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-13310: - Summary: [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks Key: HDFS-13310 URL: https://issues.apache.org/jira/browse/HDFS-13310 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13287) TestINodeFile#testGetBlockType results in NPE when run alone

2018-03-16 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16401643#comment-16401643 ] Ewan Higgs commented on HDFS-13287: --- Tested. LGTM. Could also do this in a {{@Before}}

[jira] [Commented] (HDFS-13088) Allow HDFS files/blocks to be over-replicated.

2018-03-15 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16400419#comment-16400419 ] Ewan Higgs commented on HDFS-13088: --- Do we want {{setReplication}} in FileSystem. If thi

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Open (was: Patch Available) > [WRITE] Multipart Multinode uploader API + Implementations >

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: HDFS-13186.003.patch > [WRITE] Multipart Multinode uploader API + Implementations >

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Patch Available (was: Open) +asf license for TestFileSystemMultipartUploader   > [WRITE] Mult

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Patch Available (was: Open) Submitted patch with findbugs and checkstyle issues addressed. > [

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: HDFS-13186.001.patch > [WRITE] Multipart Multinode uploader API + Implementations >

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: HDFS-13186.002.patch > [WRITE] Multipart Multinode uploader API + Implementations >

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: (was: HDFS-13186.patch) > [WRITE] Multipart Multinode uploader API + Implementations > -

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: HDFS-13186.002.patch > [WRITE] Multipart Multinode uploader API + Implementations >

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Open (was: Patch Available) > [WRITE] Multipart Multinode uploader API + Implementations >

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: (was: HDFS-13186.002.patch) > [WRITE] Multipart Multinode uploader API + Implementations

[jira] [Commented] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-08 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391495#comment-16391495 ] Ewan Higgs commented on HDFS-13186: --- [~ste...@apache.org] {quote} * I worry about how to

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-08 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Status: Patch Available (was: Open) Submitting a patch with an abstract class for {{MultipartUploader}}

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-08 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Attachment: HDFS-13186.patch > [WRITE] Multipart Multinode uploader API + Implementations >

[jira] [Updated] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-02-23 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13186: -- Summary: [WRITE] Multipart Multinode uploader API + Implementations (was: Multipart Multinode uploader

[jira] [Created] (HDFS-13186) Multipart Multinode uploader API + Implementations

2018-02-23 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-13186: - Summary: Multipart Multinode uploader API + Implementations Key: HDFS-13186 URL: https://issues.apache.org/jira/browse/HDFS-13186 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-13185) Refactor DistCpSync to bring code into hadoop-hdfs-client project

2018-02-23 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-13185: - Summary: Refactor DistCpSync to bring code into hadoop-hdfs-client project Key: HDFS-13185 URL: https://issues.apache.org/jira/browse/HDFS-13185 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13118) SnapshotDiffReport should provide the INode type

2018-02-12 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13118: -- Status: Open (was: Patch Available) > SnapshotDiffReport should provide the INode type > --

[jira] [Updated] (HDFS-13118) SnapshotDiffReport should provide the INode type

2018-02-12 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13118: -- Status: Patch Available (was: Open) > SnapshotDiffReport should provide the INode type > --

[jira] [Commented] (HDFS-13118) SnapshotDiffReport should provide the INode type

2018-02-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16358361#comment-16358361 ] Ewan Higgs commented on HDFS-13118: --- [~shashikant], thanks for the fast feedback! The t

[jira] [Updated] (HDFS-13118) SnapshotDiffReport should provide the INode type

2018-02-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13118: -- Status: Open (was: Patch Available) > SnapshotDiffReport should provide the INode type > --

[jira] [Updated] (HDFS-13118) SnapshotDiffReport should provide the INode type

2018-02-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13118: -- Attachment: HDFS-13118.002.patch > SnapshotDiffReport should provide the INode type > --

[jira] [Updated] (HDFS-13118) SnapshotDiffReport should provide the INode type

2018-02-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13118: -- Status: Patch Available (was: Open) > SnapshotDiffReport should provide the INode type > --

[jira] [Updated] (HDFS-13118) SnapshotDiffReport should provide the INode type

2018-02-08 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13118: -- Assignee: Ewan Higgs Affects Version/s: 3.0.0 Status: Patch Available (was:

[jira] [Updated] (HDFS-13118) SnapshotDiffReport should provide the INode type

2018-02-08 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13118: -- Attachment: HDFS-13118.001.patch > SnapshotDiffReport should provide the INode type > --

[jira] [Updated] (HDFS-13118) SnapshotDiffReport should provide the INode type

2018-02-08 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13118: -- Issue Type: Improvement (was: Bug) > SnapshotDiffReport should provide the INode type > ---

[jira] [Created] (HDFS-13118) SnapshotDiffReport should provide the INode type

2018-02-07 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-13118: - Summary: SnapshotDiffReport should provide the INode type Key: HDFS-13118 URL: https://issues.apache.org/jira/browse/HDFS-13118 Project: Hadoop HDFS Issue Type: Bu

[jira] [Commented] (HDFS-12090) Handling writes from HDFS to Provided storages

2018-01-25 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16339082#comment-16339082 ] Ewan Higgs commented on HDFS-12090: --- [~virajith], [~rakeshr] thank you both for your fee

[jira] [Commented] (HDFS-12090) Handling writes from HDFS to Provided storages

2018-01-19 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332058#comment-16332058 ] Ewan Higgs commented on HDFS-12090: --- I've uploaded an updated patch that removes the SPS

[jira] [Updated] (HDFS-12090) Handling writes from HDFS to Provided storages

2018-01-19 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12090: -- Attachment: HDFS-12090.0001.patch > Handling writes from HDFS to Provided storages > ---

[jira] [Updated] (HDFS-12090) Handling writes from HDFS to Provided storages

2018-01-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12090: -- Attachment: HDFS-12090..patch Attached is a work in progress patch for the backup case. It's not bea

[jira] [Commented] (HDFS-12885) Add visibility/stability annotations

2017-12-05 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16278334#comment-16278334 ] Ewan Higgs commented on HDFS-12885: --- LGTM. > Add visibility/stability annotations > ---

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272868#comment-16272868 ] Ewan Higgs commented on HDFS-12665: --- LGTM! > [AliasMap] Create a version of the AliasMa

[jira] [Commented] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272840#comment-16272840 ] Ewan Higgs commented on HDFS-12685: --- LGTM! > [READ] FsVolumeImpl exception when scannin

[jira] [Commented] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-28 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16268517#comment-16268517 ] Ewan Higgs commented on HDFS-12685: --- This adds a new constructor that does not take a bl

[jira] [Updated] (HDFS-12478) [WRITE] Command line tools for managing Provided Storage Backup mounts

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12478: -- Attachment: HDFS-12478-HDFS-9806.003.patch Attaching updated patch with fixed rebase with new RouterRPCS

[jira] [Updated] (HDFS-12090) Handling writes from HDFS to Provided storages

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12090: -- Attachment: HDFS-12090-Functional-Specification.003.pdf Attaching version of specification with less for

[jira] [Updated] (HDFS-12090) Handling writes from HDFS to Provided storages

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12090: -- Attachment: (was: HDFS-9806 Functional Specification (003).pdf) > Handling writes from HDFS to Provi

[jira] [Updated] (HDFS-12090) Handling writes from HDFS to Provided storages

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12090: -- Attachment: HDFS-9806 Functional Specification (003).pdf Attaching version of specification which was no

[jira] [Updated] (HDFS-12478) [WRITE] Command line tools for managing Provided Storage Backup mounts

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12478: -- Attachment: HDFS-12478-HDFS-9806.002.patch Applying a patch rebased onto HDFS-9806 ({{91258222182}}). >

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Status: Patch Available (was: Open) > [AliasMap] Create a version of the AliasMap that runs in memory i

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.009.patch Attaching a patch that gets rid of more Checkstyle warnings b

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Status: Open (was: Patch Available) > [AliasMap] Create a version of the AliasMap that runs in memory i

[jira] [Updated] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12713: -- Attachment: HDFS-12713-HDFS-9806.002.patch Attaching patch that adds BlockPoolID to the {{getReader}} fu

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246335#comment-16246335 ] Ewan Higgs commented on HDFS-12713: --- {quote}Hi Ewan Higgs, Yes, I think that makes sense

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.006.patch [~virajith], thanks for updating the patch. I'm attaching a

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-08 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16243860#comment-16243860 ] Ewan Higgs commented on HDFS-12713: --- In HDFS-12665, [~virajith] suggested that we make t

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-08 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.004.patch Attaching a patch that is rebased on changes to HDFS-11902 (w

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-08 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Status: Open (was: Patch Available) > [AliasMap] Create a version of the AliasMap that runs in memory i

[jira] [Updated] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-10-31 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12713: -- Status: Patch Available (was: Open) > [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS

[jira] [Updated] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-10-31 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12713: -- Attachment: HDFS-12713-HDFS-9806.001.patch Submitting a patch that removes the BlockPoolId from the File

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.003.patch Attaching patch that rebased on the latest HDFS-11902 patch.

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Status: Patch Available (was: Open) > [AliasMap] Create a version of the AliasMap that runs in memory i

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Status: Open (was: Patch Available) > [AliasMap] Create a version of the AliasMap that runs in memory i

<    1   2   3   4   5   >