[jira] [Resolved] (HADOOP-18317) Clarify in which branch CVE-2022-26612 is fixed

2024-09-30 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson resolved HADOOP-18317. --- Assignee: Andrew Olson Resolution: Done > Clarify in which branch CVE-2022-26612 is f

[jira] [Commented] (HADOOP-18317) Clarify in which branch CVE-2022-26612 is fixed

2024-09-30 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885925#comment-17885925 ] Andrew Olson commented on HADOOP-18317: --- Confirming 2.10.2: [https://github.com/

[jira] [Commented] (HADOOP-19031) CVE-2024-23454: Apache Hadoop: Temporary File Local Information Disclosure

2024-09-30 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885923#comment-17885923 ] Andrew Olson commented on HADOOP-19031: --- Are there any plans to fix this in 2.10.

[jira] [Commented] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-05-20 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112170#comment-17112170 ] Andrew Olson commented on HADOOP-16900: --- Thanks for fixing this, [~ste...@apache.

[jira] [Updated] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-05-20 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-16900: -- Description: If a written file size exceeds 10,000 * {{fs.s3a.multipart.size}}, a corrupt tru

[jira] [Commented] (HADOOP-16090) S3A Client to add explicit support for versioned stores

2020-03-27 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068692#comment-17068692 ] Andrew Olson commented on HADOOP-16090: --- It seems perhaps there should be some ge

[jira] [Assigned] (HADOOP-16047) Avoid expensive rename when DistCp is writing to S3

2020-03-25 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson reassigned HADOOP-16047: - Assignee: Andrew Olson > Avoid expensive rename when DistCp is writing to S3 > ---

[jira] [Commented] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-03-17 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060983#comment-17060983 ] Andrew Olson commented on HADOOP-16900: --- That plan sounds good from here [~ste...

[jira] [Commented] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-03-05 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17052576#comment-17052576 ] Andrew Olson commented on HADOOP-16900: --- Looked into the DistCp issue further. We

[jira] [Commented] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-03-04 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17051330#comment-17051330 ] Andrew Olson commented on HADOOP-16900: --- [~ste...@apache.org] An adaptive solutio

[jira] [Comment Edited] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-03-03 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050575#comment-17050575 ] Andrew Olson edited comment on HADOOP-16900 at 3/3/20 9:39 PM: --

[jira] [Commented] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-03-03 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050575#comment-17050575 ] Andrew Olson commented on HADOOP-16900: --- [~ste...@apache.org] [~gabor.bota] I thi

[jira] [Updated] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-03-02 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-16900: -- Description: If a written file size exceeds 10,000 * {{fs.s3a.multipart.size}}, a corrupt tru

[jira] [Created] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-03-02 Thread Andrew Olson (Jira)
Andrew Olson created HADOOP-16900: - Summary: Very large files can be truncated when written through S3AFileSystem Key: HADOOP-16900 URL: https://issues.apache.org/jira/browse/HADOOP-16900 Project: Had

[jira] [Commented] (HADOOP-16090) S3A Client to add explicit support for versioned stores

2019-12-04 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988048#comment-16988048 ] Andrew Olson commented on HADOOP-16090: --- Not sure if the best place for this ques

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-07-09 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16881254#comment-16881254 ] Andrew Olson commented on HADOOP-15281: --- Attached a corrected branch-2 patch file

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-07-09 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Attachment: HADOOP-15281-branch-2-002.patch > Distcp to add no-rename copy option > -

[jira] [Commented] (HADOOP-13980) S3Guard CLI: Add fsck check command

2019-07-09 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16881233#comment-16881233 ] Andrew Olson commented on HADOOP-13980: --- +1 for TSV, the human readability / exce

[jira] [Updated] (HADOOP-16294) Enable access to context by DistCp subclasses

2019-05-09 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-16294: -- Summary: Enable access to context by DistCp subclasses (was: Enable access to input options

[jira] [Updated] (HADOOP-16294) Enable access to input options by DistCp subclasses

2019-05-09 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-16294: -- Description: In the DistCp class, the context is private with no getter method allowing retr

[jira] [Updated] (HADOOP-16294) Enable access to input options by DistCp subclasses

2019-05-06 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-16294: -- Status: Patch Available (was: In Progress) > Enable access to input options by DistCp subcla

[jira] [Work started] (HADOOP-16294) Enable access to input options by DistCp subclasses

2019-05-06 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16294 started by Andrew Olson. - > Enable access to input options by DistCp subclasses >

[jira] [Commented] (HADOOP-16294) Enable access to input options by DistCp subclasses

2019-05-06 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833834#comment-16833834 ] Andrew Olson commented on HADOOP-16294: --- Opened a pull request for this, https://

[jira] [Created] (HADOOP-16294) Enable access to input options by DistCp subclasses

2019-05-06 Thread Andrew Olson (JIRA)
Andrew Olson created HADOOP-16294: - Summary: Enable access to input options by DistCp subclasses Key: HADOOP-16294 URL: https://issues.apache.org/jira/browse/HADOOP-16294 Project: Hadoop Common

[jira] [Assigned] (HADOOP-16221) S3Guard: fail write that doesn't update metadata store

2019-04-05 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson reassigned HADOOP-16221: - Assignee: Ben Roling > S3Guard: fail write that doesn't update metadata store > --

[jira] [Commented] (HADOOP-16147) Allow CopyListing sequence file keys and values to be more easily customized

2019-03-22 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16799045#comment-16799045 ] Andrew Olson commented on HADOOP-16147: --- Thank you Steve, appreciate it. > Allow

[jira] [Updated] (HADOOP-16147) Allow CopyListing sequence file keys and values to be more easily customized

2019-03-22 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-16147: -- Fix Version/s: 3.3.0 > Allow CopyListing sequence file keys and values to be more easily cust

[jira] [Commented] (HADOOP-16147) Allow CopyListing sequence file keys and values to be more easily customized

2019-03-21 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16798335#comment-16798335 ] Andrew Olson commented on HADOOP-16147: --- [~ste...@apache.org] would you mind taki

[jira] [Commented] (HADOOP-12046) Avoid creating "._COPYING_" temporary file when copying file to Swift file system

2019-03-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792709#comment-16792709 ] Andrew Olson commented on HADOOP-12046: --- HADOOP-15281 has been completed. Resolvi

[jira] [Resolved] (HADOOP-12046) Avoid creating "._COPYING_" temporary file when copying file to Swift file system

2019-03-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson resolved HADOOP-12046. --- Resolution: Duplicate > Avoid creating "._COPYING_" temporary file when copying file to Swi

[jira] [Commented] (HADOOP-16147) Allow CopyListing sequence file keys and values to be more easily customized

2019-02-27 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779476#comment-16779476 ] Andrew Olson commented on HADOOP-16147: --- Attached patch update to address the che

[jira] [Updated] (HADOOP-16147) Allow CopyListing sequence file keys and values to be more easily customized

2019-02-27 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-16147: -- Attachment: HADOOP-16147-002.patch > Allow CopyListing sequence file keys and values to be mo

[jira] [Commented] (HADOOP-16147) Allow CopyListing sequence file keys and values to be more easily customized

2019-02-26 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16778060#comment-16778060 ] Andrew Olson commented on HADOOP-16147: --- Responding to [~hadoopqa], {quote} Plea

[jira] [Updated] (HADOOP-16147) Allow CopyListing sequence file keys and values to be more easily customized

2019-02-25 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-16147: -- Assignee: Andrew Olson Attachment: HADOOP-16147-001.patch Status: Patch Availabl

[jira] [Created] (HADOOP-16147) Allow CopyListing sequence file keys and values to be more easily customized

2019-02-25 Thread Andrew Olson (JIRA)
Andrew Olson created HADOOP-16147: - Summary: Allow CopyListing sequence file keys and values to be more easily customized Key: HADOOP-16147 URL: https://issues.apache.org/jira/browse/HADOOP-16147 Proj

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-12 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Description: Currently Distcp uploads a file by two strategies # append parts # copy to temp

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-12 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Fix Version/s: 3.1.3 > Distcp to add no-rename copy option >

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-12 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766158#comment-16766158 ] Andrew Olson commented on HADOOP-15281: --- Updated fix versions. If there is a comp

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-12 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Fix Version/s: (was: 3.1.3) 3.3.0 > Distcp to add no-rename copy optio

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-07 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16762989#comment-16762989 ] Andrew Olson commented on HADOOP-15281: --- [~eepayne] Because SLF4J was introduced

[jira] [Commented] (HADOOP-10007) distcp / mv is not working on ftp

2019-02-07 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16762762#comment-16762762 ] Andrew Olson commented on HADOOP-10007: --- I think this can be resolved as a duplic

[jira] [Issue Comment Deleted] (HADOOP-10007) distcp / mv is not working on ftp

2019-02-07 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-10007: -- Comment: was deleted (was: I think this can be resolved as a duplicate of HADOOP-15281.) > d

[jira] [Commented] (HADOOP-10007) distcp / mv is not working on ftp

2019-02-07 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16762761#comment-16762761 ] Andrew Olson commented on HADOOP-10007: --- I think this can be resolved as a duplic

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-07 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16762757#comment-16762757 ] Andrew Olson commented on HADOOP-15281: --- Thanks for accepting the patch. We don't

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-06 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16762035#comment-16762035 ] Andrew Olson commented on HADOOP-15281: --- [~ste...@apache.org] Please use 'andrew.

[jira] [Comment Edited] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16761032#comment-16761032 ] Andrew Olson edited comment on HADOOP-15281 at 2/5/19 8:47 PM: --

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16761199#comment-16761199 ] Andrew Olson commented on HADOOP-15281: --- Attached updated patch addressing the re

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Attachment: HADOOP-15281-004.patch > Distcp to add no-rename copy option > --

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Description: Currently Distcp uploads a file by two strategies # append parts # copy to temp

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16761032#comment-16761032 ] Andrew Olson commented on HADOOP-15281: --- Thanks [~ste...@apache.org], I'll get th

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-04 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16760095#comment-16760095 ] Andrew Olson commented on HADOOP-15281: --- [~ste...@apache.org] Ok, thank you. > D

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

2019-02-01 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758736#comment-16758736 ] Andrew Olson commented on HADOOP-16085: --- [~mackrorysd] Looks like it's possible t

[jira] [Commented] (HADOOP-10007) distcp / mv is not working on ftp

2019-02-01 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758415#comment-16758415 ] Andrew Olson commented on HADOOP-10007: --- A patch is now available for HADOOP-1528

[jira] [Commented] (HADOOP-12046) Avoid creating "._COPYING_" temporary file when copying file to Swift file system

2019-02-01 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758414#comment-16758414 ] Andrew Olson commented on HADOOP-12046: --- A patch is now available for HADOOP-1528

[jira] [Commented] (HADOOP-13980) S3Guard CLI: Add fsck check command

2019-01-31 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16757479#comment-16757479 ] Andrew Olson commented on HADOOP-13980: --- [~gabor.bota] Ok great, I imagined that

[jira] [Commented] (HADOOP-13980) S3Guard CLI: Add fsck check command

2019-01-31 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16757434#comment-16757434 ] Andrew Olson commented on HADOOP-13980: --- Could this be limited to a specified par

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-25 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16752319#comment-16752319 ] Andrew Olson commented on HADOOP-15281: --- [~ste...@apache.org] Got a +1 from Jenki

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-24 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Status: Open (was: Patch Available) > Distcp to add no-rename copy option >

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-24 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Attachment: HADOOP-15281-003.patch Status: Patch Available (was: Open) Updated to fi

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-24 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Attachment: HADOOP-15281-002.patch Status: Patch Available (was: Open) Attaching an

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-24 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Status: Open (was: Patch Available) > Distcp to add no-rename copy option >

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-24 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751494#comment-16751494 ] Andrew Olson commented on HADOOP-15281: --- I will fix the test failure. > Distcp t

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-24 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Status: Patch Available (was: Open) > Distcp to add no-rename copy option >

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-24 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Attachment: HADOOP-15281-001.patch > Distcp to add no-rename copy option > --

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-24 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751375#comment-16751375 ] Andrew Olson commented on HADOOP-15281: --- [~ste...@apache.org] thanks, I've attach

[jira] [Assigned] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-24 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson reassigned HADOOP-15281: - Assignee: Andrew Olson > Distcp to add no-rename copy option > ---

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-22 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16749237#comment-16749237 ] Andrew Olson commented on HADOOP-15281: --- [~ste...@apache.org] I don't seem to hav

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-22 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16749222#comment-16749222 ] Andrew Olson commented on HADOOP-15281: --- Attaching patch file > Distcp to add no

[jira] [Issue Comment Deleted] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-22 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Comment: was deleted (was: Attaching patch file) > Distcp to add no-rename copy option > ---

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742433#comment-16742433 ] Andrew Olson commented on HADOOP-15281: --- Ok, sounds good from here - thanks for t

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742311#comment-16742311 ] Andrew Olson commented on HADOOP-15281: --- We've successfully tested a quick+dirty

[jira] [Comment Edited] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742311#comment-16742311 ] Andrew Olson edited comment on HADOOP-15281 at 1/14/19 5:10 PM: -

[jira] [Commented] (HADOOP-16047) Avoid expensive rename when DistCp is writing to S3

2019-01-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742302#comment-16742302 ] Andrew Olson commented on HADOOP-16047: --- Thanks [~ste...@apache.org] > Avoid exp

[jira] [Commented] (HADOOP-16047) Avoid expensive rename when DistCp is writing to S3

2019-01-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742212#comment-16742212 ] Andrew Olson commented on HADOOP-16047: --- Instead of a new config property, would

[jira] [Created] (HADOOP-16047) Avoid expensive rename when DistCp is writing to S3

2019-01-14 Thread Andrew Olson (JIRA)
Andrew Olson created HADOOP-16047: - Summary: Avoid expensive rename when DistCp is writing to S3 Key: HADOOP-16047 URL: https://issues.apache.org/jira/browse/HADOOP-16047 Project: Hadoop Common

[jira] [Commented] (HADOOP-13075) Add support for SSE-KMS and SSE-C in s3a filesystem

2017-01-26 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840142#comment-15840142 ] Andrew Olson commented on HADOOP-13075: --- [~moist] I think you're misunderstanding.

[jira] [Commented] (HADOOP-13075) Add support for SSE-KMS and SSE-C in s3a filesystem

2016-08-01 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401964#comment-15401964 ] Andrew Olson commented on HADOOP-13075: --- [~spacepluk] For specifying the default b

[jira] [Commented] (HADOOP-13075) Add support for SSE-KMS and SSE-C in s3a filesystem

2016-08-01 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401948#comment-15401948 ] Andrew Olson commented on HADOOP-13075: --- [~spacepluk] Not encrypting is the defaul

[jira] [Commented] (HADOOP-13075) Add support for SSE-KMS and SSE-C in s3a filesystem

2016-07-06 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15364327#comment-15364327 ] Andrew Olson commented on HADOOP-13075: --- The pull request looks good from here. Th

[jira] [Commented] (HADOOP-13075) Add support for SSE-KMS and SSE-C in s3a filesystem

2016-05-01 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265766#comment-15265766 ] Andrew Olson commented on HADOOP-13075: --- Looks like 1.9.x, https://github.com/aws

[jira] [Updated] (HADOOP-13075) Add support for SSE-KMS and SSE-C in s3a filesystem

2016-04-29 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-13075: -- Description: S3 provides 3 types of server-side encryption [1], * SSE-S3 (Amazon S3-Managed K

[jira] [Updated] (HADOOP-13075) Add support for SSE-KMS and SSE-C in s3a filesystem

2016-04-29 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-13075: -- Description: S3 provides 3 types of server-side encryption [1], * SSE-S3 (Amazon S3-Managed K

[jira] [Updated] (HADOOP-13075) Add support for SSE-KMS and SSE-C in s3a filesystem

2016-04-29 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-13075: -- Description: S3 provides 3 types of server-side encryption [1], * SSE-S3 (Amazon S3-Managed K

[jira] [Updated] (HADOOP-13075) Add support for SSE-KMS and SSE-C in s3a filesystem

2016-04-29 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-13075: -- Description: S3 provides 3 types of server-side encryption [1], * SSE-S3 (Amazon S3-Managed K

[jira] [Created] (HADOOP-13075) Add support for SSE-KMS and SSE-C in s3a filesystem

2016-04-29 Thread Andrew Olson (JIRA)
Andrew Olson created HADOOP-13075: - Summary: Add support for SSE-KMS and SSE-C in s3a filesystem Key: HADOOP-13075 URL: https://issues.apache.org/jira/browse/HADOOP-13075 Project: Hadoop Common

[jira] [Commented] (HADOOP-12891) S3AFileSystem should configure Multipart Copy threshold and chunk size

2016-04-21 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252140#comment-15252140 ] Andrew Olson commented on HADOOP-12891: --- Thanks Steve, looks good from here. > S3

[jira] [Commented] (HADOOP-12891) S3AFileSystem should configure Multipart Copy threshold and chunk size

2016-04-20 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250060#comment-15250060 ] Andrew Olson commented on HADOOP-12891: --- +1 for this patch. > just mention in the

[jira] [Updated] (HADOOP-12891) S3AFileSystem should configure Multipart Copy threshold and chunk size

2016-03-07 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-12891: -- Description: In the AWS S3 Java SDK the defaults for Multipart Copy threshold and chunk size

[jira] [Updated] (HADOOP-12891) S3AFileSystem should configure Multipart Copy threshold and chunk size

2016-03-04 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-12891: -- Description: In the AWS S3 Java SDK the defaults for Multipart Copy threshold and chunk size

[jira] [Created] (HADOOP-12891) S3AFileSystem should configure Multipart Copy threshold and chunk size

2016-03-04 Thread Andrew Olson (JIRA)
Andrew Olson created HADOOP-12891: - Summary: S3AFileSystem should configure Multipart Copy threshold and chunk size Key: HADOOP-12891 URL: https://issues.apache.org/jira/browse/HADOOP-12891 Project: H

[jira] [Commented] (HADOOP-12169) ListStatus on empty dir in S3A lists itself instead of returning an empty list

2016-03-03 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178809#comment-15178809 ] Andrew Olson commented on HADOOP-12169: --- Can this patch be merged? > ListStatus o