[jira] [Updated] (HADOOP-14524) Make CryptoCodec Closeable so it can be cleaned up proactively

2017-06-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14524: --- Attachment: HADOOP-14524.branch-2.01.patch Thanks for the review Andrew! Attaching a branch-2 patch,

[jira] [Commented] (HADOOP-14495) Add set options interface to FSDataOutputStreamBuilder

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051596#comment-16051596 ] Steve Loughran commented on HADOOP-14495: - I think we need to to allow apps to d

[jira] [Commented] (HADOOP-14486) TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051597#comment-16051597 ] Steve Loughran commented on HADOOP-14486: - bq. Sorry for so confusing you, i wou

[jira] [Commented] (HADOOP-14289) Move log4j APIs over to slf4j in hadoop-common

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051598#comment-16051598 ] Steve Loughran commented on HADOOP-14289: - thanks for doing this > Move log4j A

[jira] [Commented] (HADOOP-11505) Various native parts use bswap incorrectly and unportably

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051603#comment-16051603 ] Steve Loughran commented on HADOOP-11505: - I'm watching this, but its been > a d

[jira] [Updated] (HADOOP-14486) TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14486: Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Avai

[jira] [Commented] (HADOOP-14486) TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0

2017-06-16 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051618#comment-16051618 ] Hongyuan Li commented on HADOOP-14486: -- :) That's Ok. During this, i learned a lot

[jira] [Commented] (HADOOP-14469) FTPFileSystem#listStatus get currentPath and parentPath at the same time, causing recursively list action endless

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051631#comment-16051631 ] Steve Loughran commented on HADOOP-14469: - I know the size of the list may be le

[jira] [Updated] (HADOOP-14508) TestDFSIO throws NPE when set -sequential argument.

2017-06-16 Thread wenxin he (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wenxin he updated HADOOP-14508: --- Attachment: HADOOP-14508.001.patch > TestDFSIO throws NPE when set -sequential argument. > -

[jira] [Commented] (HADOOP-14521) KMS client needs retry logic

2017-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051637#comment-16051637 ] Hadoop QA commented on HADOOP-14521: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-14486) TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0

2017-06-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051639#comment-16051639 ] Hudson commented on HADOOP-14486: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Com

[jira] [Commented] (HADOOP-14469) FTPFileSystem#listStatus get currentPath and parentPath at the same time, causing recursively list action endless

2017-06-16 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051655#comment-16051655 ] Hongyuan Li commented on HADOOP-14469: -- Ok, got your meanings, i will try to do it

[jira] [Comment Edited] (HADOOP-14486) TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0

2017-06-16 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051618#comment-16051618 ] Hongyuan Li edited comment on HADOOP-14486 at 6/16/17 9:26 AM: ---

[jira] [Commented] (HADOOP-14524) Make CryptoCodec Closeable so it can be cleaned up proactively

2017-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051679#comment-16051679 ] Hadoop QA commented on HADOOP-14524: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Commented] (HADOOP-14499) Findbugs warning in LocalMetadataStore

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051690#comment-16051690 ] Steve Loughran commented on HADOOP-14499: - We should have the local version matc

[jira] [Resolved] (HADOOP-13568) S3AFastOutputStream to implement flush()

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13568. - Resolution: Won't Fix Fix Version/s: 2.9.0 Closing as a wontfix. the problem here

[jira] [Resolved] (HADOOP-13222) s3a.mkdirs() to delete empty fake parent directories

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13222. - Resolution: Duplicate covered by HADOOP-14255, which is in the codebase > s3a.mkdirs()

[jira] [Resolved] (HADOOP-13779) s3a to skip s3 bucket existence check in initialize() for faster creation

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13779. - Resolution: Duplicate Duplicate of HADOOP-13757 > s3a to skip s3 bucket existence check

[jira] [Resolved] (HADOOP-13829) S3A getContentSummary to use flat listFiles instead of treewalk

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13829. - Resolution: Duplicate duplicate of HADOOP-13704 > S3A getContentSummary to use flat lis

[jira] [Resolved] (HADOOP-9978) Support range reads in s3n interface to split objects for mappers to read

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-9978. Resolution: Won't Fix Not making changes to s3n any more; s3a has lots of improvements on s

[jira] [Created] (HADOOP-14529) retire s3n

2017-06-16 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14529: --- Summary: retire s3n Key: HADOOP-14529 URL: https://issues.apache.org/jira/browse/HADOOP-14529 Project: Hadoop Common Issue Type: Improvement

[jira] [Resolved] (HADOOP-11444) Jets3tFileSystemStore fails to remove initial slash from object keys, resulting in objects with double forward slashes being stored

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-11444. - Resolution: Won't Fix s3:// has been cut; WONTFIX > Jets3tFileSystemStore fails to remo

[jira] [Resolved] (HADOOP-6916) Implement append operation for S3FileSystem

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-6916. Resolution: Won't Fix S3:// has been cut from trunk; WONTFIX > Implement append operation

[jira] [Resolved] (HADOOP-13574) Unnecessary file existence check causes problems with S3

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13574. - Resolution: Duplicate This is an s3 list inconsistency surfacing on s3n job commits. It

[jira] [Resolved] (HADOOP-13623) regression: ITestS3NContractRootDir

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13623. - Resolution: Cannot Reproduce > regression: ITestS3NContractRootDir > ---

[jira] [Resolved] (HADOOP-9293) For S3 use credentials file

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-9293. Resolution: Won't Fix > For S3 use credentials file > --- > >

[jira] [Commented] (HADOOP-9293) For S3 use credentials file

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051745#comment-16051745 ] Steve Loughran commented on HADOOP-9293: S3a now supports the hadoop credendials

[jira] [Updated] (HADOOP-10218) Using brace glob pattern in S3N URL causes exception due to Path created with empty string

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-10218: Summary: Using brace glob pattern in S3N URL causes exception due to Path created with emp

[jira] [Resolved] (HADOOP-11487) FileNotFound on distcp to s3n/s3a due to creation inconsistency

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-11487. - Resolution: Duplicate > FileNotFound on distcp to s3n/s3a due to creation inconsistency

[jira] [Reopened] (HADOOP-11487) FileNotFound on distcp to s3n/s3a due to creation inconsistency

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-11487: - > FileNotFound on distcp to s3n/s3a due to creation inconsistency > ---

[jira] [Resolved] (HADOOP-11487) FileNotFound on distcp to s3n/s3a due to creation inconsistency

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-11487. - Resolution: Fixed Fix Version/s: 2.8.0 > FileNotFound on distcp to s3n/s3a due to

[jira] [Commented] (HADOOP-11487) FileNotFound on distcp to s3n/s3a due to creation inconsistency

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051749#comment-16051749 ] Steve Loughran commented on HADOOP-11487: - The specific codepath here is address

[jira] [Resolved] (HADOOP-14326) S3A to support S3 reduced redundancy storage

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14326. - Resolution: Duplicate HADOOP-12020 covers this > S3A to support S3 reduced redundancy s

[jira] [Commented] (HADOOP-12020) Support AWS S3 reduced redundancy storage class

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051762#comment-16051762 ] Steve Loughran commented on HADOOP-12020: - What we need: # add config (eventual

[jira] [Updated] (HADOOP-14528) s3a encryption tests fail when dest bucket has fs.s3a.server-side-encryption.key set

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14528: Parent Issue: HADOOP-14325 (was: HADOOP-13204) > s3a encryption tests fail when dest buck

[jira] [Created] (HADOOP-14530) Translate ARN exception to something other than FNFE

2017-06-16 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14530: --- Summary: Translate ARN exception to something other than FNFE Key: HADOOP-14530 URL: https://issues.apache.org/jira/browse/HADOOP-14530 Project: Hadoop Common

[jira] [Commented] (HADOOP-14530) Translate ARN exception to something other than FNFE

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051765#comment-16051765 ] Steve Loughran commented on HADOOP-14530: - Stack {code} test_999_DeleteHugeFiles

[jira] [Created] (HADOOP-14531) Improve S3A error handling & reporting

2017-06-16 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14531: --- Summary: Improve S3A error handling & reporting Key: HADOOP-14531 URL: https://issues.apache.org/jira/browse/HADOOP-14531 Project: Hadoop Common Issue

[jira] [Updated] (HADOOP-13276) S3a operations keep retrying if the password is wrong

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13276: Parent Issue: HADOOP-14531 (was: HADOOP-13204) > S3a operations keep retrying if the pass

[jira] [Updated] (HADOOP-14303) Review retry logic on all S3 SDK calls, implement where needed

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14303: Parent Issue: HADOOP-14531 (was: HADOOP-13204) > Review retry logic on all S3 SDK calls,

[jira] [Updated] (HADOOP-14126) remove jackson, joda and other transient aws SDK dependencies from hadoop-aws

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14126: Parent Issue: HADOOP-14531 (was: HADOOP-13204) > remove jackson, joda and other transient

[jira] [Updated] (HADOOP-14381) S3AUtils.translateException to map 503 reponse to => throttling failure

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14381: Parent Issue: HADOOP-14531 (was: HADOOP-13204) > S3AUtils.translateException to map 503 r

[jira] [Updated] (HADOOP-14126) remove jackson, joda and other transient aws SDK dependencies from hadoop-aws

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14126: Parent Issue: HADOOP-13204 (was: HADOOP-14531) > remove jackson, joda and other transient

[jira] [Updated] (HADOOP-14510) Use error code detail in AWS server responses for finer grained exceptions

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14510: Parent Issue: HADOOP-14531 (was: HADOOP-13204) > Use error code detail in AWS server resp

[jira] [Updated] (HADOOP-13334) AmazonClient 30x exceptions to include redirect URL in message

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13334: Parent Issue: HADOOP-14531 (was: HADOOP-13204) > AmazonClient 30x exceptions to include r

[jira] [Updated] (HADOOP-13664) S3AInputStream to use a retry policy on read failures

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13664: Parent Issue: HADOOP-14531 (was: HADOOP-13204) > S3AInputStream to use a retry policy on

[jira] [Updated] (HADOOP-13205) S3A to support custom retry policies; maybe failfast on unknown host

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13205: Parent Issue: HADOOP-14531 (was: HADOOP-13204) > S3A to support custom retry policies; ma

[jira] [Commented] (HADOOP-14531) Improve S3A error handling & reporting

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051772#comment-16051772 ] Steve Loughran commented on HADOOP-14531: - Note that HADOOP-13786 has done some

[jira] [Commented] (HADOOP-13204) Über-jira: S3a phase III: scale and tuning

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051771#comment-16051771 ] Steve Loughran commented on HADOOP-13204: - Moved all tasks related to exception

[jira] [Updated] (HADOOP-14531) Improve S3A error handling & reporting

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14531: Description: Improve S3a error handling and reporting this includes # looking at error co

[jira] [Commented] (HADOOP-14508) TestDFSIO throws NPE when set -sequential argument.

2017-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051780#comment-16051780 ] Hadoop QA commented on HADOOP-14508: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Commented] (HADOOP-7464) hadoop fs -stat '{glob}' gives null with combo of absolute and non-existent files

2017-06-16 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051792#comment-16051792 ] Andras Bokor commented on HADOOP-7464: -- Closing as dup of HADOOP-7174. Please note t

[jira] [Resolved] (HADOOP-7464) hadoop fs -stat '{glob}' gives null with combo of absolute and non-existent files

2017-06-16 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor resolved HADOOP-7464. -- Resolution: Duplicate > hadoop fs -stat '{glob}' gives null with combo of absolute and non-exis

[jira] [Assigned] (HADOOP-11608) hadoop-annotations build fails on JDK9 (lacking tools.jar)

2017-06-16 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor reassigned HADOOP-11608: - Assignee: Andras Bokor > hadoop-annotations build fails on JDK9 (lacking tools.jar) > -

[jira] [Updated] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7

2017-06-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-14356: -- Attachment: HADOOP-14356-branch-2.7-004.patch HI [~ajisakaa]/[~shv] As we get

[jira] [Commented] (HADOOP-14531) Improve S3A error handling & reporting

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051835#comment-16051835 ] Steve Loughran commented on HADOOP-14531: - Also: we can extend the InconsistentC

[jira] [Commented] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7

2017-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051840#comment-16051840 ] Hadoop QA commented on HADOOP-14356: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HADOOP-14126) remove jackson, joda and other transient aws SDK dependencies from hadoop-aws

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14126: Attachment: HADOOP-14126-001.patch Patch 001 * downgrade hadoop-common dependency to prov

[jira] [Assigned] (HADOOP-14126) remove jackson, joda and other transient aws SDK dependencies from hadoop-aws

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-14126: --- Assignee: Steve Loughran > remove jackson, joda and other transient aws SDK depende

[jira] [Updated] (HADOOP-14126) remove jackson, joda and other transient aws SDK dependencies from hadoop-aws

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14126: Status: Patch Available (was: Open) testing s3 frankfurt, no problems seen except for HAD

[jira] [Updated] (HADOOP-13894) s3a troubleshooting to cover the "JSON parse error" message

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13894: Parent Issue: HADOOP-14531 (was: HADOOP-13204) > s3a troubleshooting to cover the "JSON p

[jira] [Updated] (HADOOP-14126) remove jackson, joda and other transient aws SDK dependencies from hadoop-aws

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14126: Priority: Minor (was: Major) > remove jackson, joda and other transient aws SDK dependenc

[jira] [Commented] (HADOOP-14103) sort out hadoop-aws contract-test-options.xml

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051864#comment-16051864 ] Steve Loughran commented on HADOOP-14103: - John, have you had a chance to look

[jira] [Commented] (HADOOP-14490) Upgrade azure-storage sdk version >5.2.0

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051877#comment-16051877 ] Steve Loughran commented on HADOOP-14490: - # do we need to switch to non depreca

[jira] [Commented] (HADOOP-14126) remove jackson, joda and other transient aws SDK dependencies from hadoop-aws

2017-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051883#comment-16051883 ] Hadoop QA commented on HADOOP-14126: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-14518) Customize User-Agent header sent in HTTP/HTTPS requests by WASB.

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051884#comment-16051884 ] Steve Loughran commented on HADOOP-14518: - looks pretty good, just needs some fi

[jira] [Created] (HADOOP-14532) TestOozieCLI.testSlaEvents is not testing SLAServlet.

2017-06-16 Thread Peter Cseh (JIRA)
Peter Cseh created HADOOP-14532: --- Summary: TestOozieCLI.testSlaEvents is not testing SLAServlet. Key: HADOOP-14532 URL: https://issues.apache.org/jira/browse/HADOOP-14532 Project: Hadoop Common

[jira] [Resolved] (HADOOP-14532) TestOozieCLI.testSlaEvents is not testing SLAServlet.

2017-06-16 Thread Peter Cseh (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Cseh resolved HADOOP-14532. - Resolution: Invalid > TestOozieCLI.testSlaEvents is not testing SLAServlet. > --

[jira] [Assigned] (HADOOP-7002) Wrong description of copyFromLocal and copyToLocal in documentation

2017-06-16 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor reassigned HADOOP-7002: Assignee: Andras Bokor > Wrong description of copyFromLocal and copyToLocal in documentati

[jira] [Updated] (HADOOP-7002) Wrong description of copyFromLocal and copyToLocal in documentation

2017-06-16 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-7002: - Status: Patch Available (was: Open) > Wrong description of copyFromLocal and copyToLocal in docu

[jira] [Updated] (HADOOP-7002) Wrong description of copyFromLocal and copyToLocal in documentation

2017-06-16 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-7002: - Attachment: HADOOP-7002.01.patch > Wrong description of copyFromLocal and copyToLocal in document

[jira] [Updated] (HADOOP-7002) Wrong description of copyFromLocal and copyToLocal in documentation

2017-06-16 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-7002: - Target Version/s: 3.0.0-alpha4 > Wrong description of copyFromLocal and copyToLocal in documentat

[jira] [Commented] (HADOOP-7002) Wrong description of copyFromLocal and copyToLocal in documentation

2017-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051932#comment-16051932 ] Hadoop QA commented on HADOOP-7002: --- | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-8030) Configuration class can throw exceptions in quiet mode; quiet mode usage unclear

2017-06-16 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051937#comment-16051937 ] Andras Bokor commented on HADOOP-8030: -- I agree. Quiet mode not just hide some logs

[jira] [Updated] (HADOOP-14469) FTPFileSystem#listStatus get currentPath and parentPath at the same time, causing recursively list action endless

2017-06-16 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14469: - Attachment: HADOOP-14469-004.patch resubmit the patch > FTPFileSystem#listStatus get currentPat

[jira] [Updated] (HADOOP-14469) FTPFileSystem#listStatus get currentPath and parentPath at the same time, causing recursively list action endless

2017-06-16 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14469: - Attachment: (was: HADOOP-14469-004.patch) > FTPFileSystem#listStatus get currentPath and par

[jira] [Issue Comment Deleted] (HADOOP-14469) FTPFileSystem#listStatus get currentPath and parentPath at the same time, causing recursively list action endless

2017-06-16 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14469: - Comment: was deleted (was: resubmit the patch) > FTPFileSystem#listStatus get currentPath and p

[jira] [Commented] (HADOOP-14505) simplify mkdirs() after S3Guard delete tracking change

2017-06-16 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052030#comment-16052030 ] Sean Mackrory commented on HADOOP-14505: So the changes in HADOOP-13760 actually

[jira] [Updated] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Weisen Han (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weisen Han updated HADOOP-14533: Component/s: tracing > TraceAdmin#run, the size of args cannot be less than zero,which is a linkli

[jira] [Updated] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Weisen Han (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weisen Han updated HADOOP-14533: Component/s: common > TraceAdmin#run, the size of args cannot be less than zero,which is a linklis

[jira] [Created] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Weisen Han (JIRA)
Weisen Han created HADOOP-14533: --- Summary: TraceAdmin#run, the size of args cannot be less than zero,which is a linklist Key: HADOOP-14533 URL: https://issues.apache.org/jira/browse/HADOOP-14533 Project

[jira] [Updated] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Weisen Han (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weisen Han updated HADOOP-14533: Description: {code} @Override public int run(String argv[]) throws Exception { LinkedLis

[jira] [Commented] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Weisen Han (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052037#comment-16052037 ] Weisen Han commented on HADOOP-14533: - [~owen.omalley] can you assign this to me ?

[jira] [Updated] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Weisen Han (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weisen Han updated HADOOP-14533: Description: {code} @Override public int run(String argv[]) throws Exception { LinkedLis

[jira] [Commented] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052040#comment-16052040 ] Wei-Chiu Chuang commented on HADOOP-14533: -- [~Weisen Han] thanks for reporting

[jira] [Assigned] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Weisen Han (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weisen Han reassigned HADOOP-14533: --- Assignee: Weisen Han > TraceAdmin#run, the size of args cannot be less than zero,which is a

[jira] [Commented] (HADOOP-14469) FTPFileSystem#listStatus get currentPath and parentPath at the same time, causing recursively list action endless

2017-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052075#comment-16052075 ] Hadoop QA commented on HADOOP-14469: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Weisen Han (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weisen Han updated HADOOP-14533: Status: Patch Available (was: Open) > TraceAdmin#run, the size of args cannot be less than zero,w

[jira] [Updated] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Weisen Han (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weisen Han updated HADOOP-14533: Attachment: HADOOP-14533-001.patch > TraceAdmin#run, the size of args cannot be less than zero,whi

[jira] [Commented] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Weisen Han (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052081#comment-16052081 ] Weisen Han commented on HADOOP-14533: - [~tonywei] submit the patch, could you give m

[jira] [Comment Edited] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052093#comment-16052093 ] Wei-Chiu Chuang edited comment on HADOOP-14533 at 6/16/17 4:24 PM: ---

[jira] [Commented] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052093#comment-16052093 ] Wei-Chiu Chuang commented on HADOOP-14533: -- Good catch. +1 pending Jenkins. >

[jira] [Updated] (HADOOP-14469) FTPFileSystem#listStatus get currentPath and parentPath at the same time, causing recursively list action endless

2017-06-16 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14469: - Attachment: HADOOP-14469-004.patch resubmit patch > FTPFileSystem#listStatus get currentPath an

[jira] [Updated] (HADOOP-14524) Make CryptoCodec Closeable so it can be cleaned up proactively

2017-06-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14524: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4 2

[jira] [Commented] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-06-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052150#comment-16052150 ] Steve Loughran commented on HADOOP-14135: - you know, I'm staring at the code won

[jira] [Commented] (HADOOP-14524) Make CryptoCodec Closeable so it can be cleaned up proactively

2017-06-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052151#comment-16052151 ] Hudson commented on HADOOP-14524: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Com

[jira] [Commented] (HADOOP-14469) FTPFileSystem#listStatus get currentPath and parentPath at the same time, causing recursively list action endless

2017-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052162#comment-16052162 ] Hadoop QA commented on HADOOP-14469: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HADOOP-14503) Make RollingAverages a mutable metric

2017-06-16 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HADOOP-14503: Attachment: HADOOP-14503-branch-2.001.patch > Make RollingAverages a mutable metric >

[jira] [Commented] (HADOOP-14533) TraceAdmin#run, the size of args cannot be less than zero,which is a linklist

2017-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052307#comment-16052307 ] Hadoop QA commented on HADOOP-14533: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-14296) Move logging APIs over to slf4j in hadoop-tools

2017-06-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052334#comment-16052334 ] Andrew Wang commented on HADOOP-14296: -- Does this just need an obligatory +1 LGTM?

  1   2   >