[jira] [Created] (HADOOP-13136) shade protobuf in the hadoop-common jar

2016-05-12 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-13136: --- Summary: shade protobuf in the hadoop-common jar Key: HADOOP-13136 URL: https://issues.apache.org/jira/browse/HADOOP-13136 Project: Hadoop Common Issue Type: S

[jira] [Created] (HADOOP-13137) TraceAdmin should support Kerberized NameNode

2016-05-12 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HADOOP-13137: Summary: TraceAdmin should support Kerberized NameNode Key: HADOOP-13137 URL: https://issues.apache.org/jira/browse/HADOOP-13137 Project: Hadoop Common

[jira] [Commented] (HADOOP-11505) Various native parts use bswap incorrectly and unportably

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281356#comment-15281356 ] Steve Loughran commented on HADOOP-11505: - the ASF build infra is shared across

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Status: Open (was: Patch Available) > add low level counter metrics for S3A; use in read

[jira] [Commented] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281362#comment-15281362 ] Steve Loughran commented on HADOOP-13028: - # this output is not indented for mac

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Status: Patch Available (was: Open) > add low level counter metrics for S3A; use in read

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Attachment: HADOOP-13028-branch-2-012.patch patch 012: fix javadoc warning on close(). Whi

[jira] [Commented] (HADOOP-13137) TraceAdmin should support Kerberized NameNode

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281375#comment-15281375 ] Steve Loughran commented on HADOOP-13137: - if the command takes {{-D name=value

[jira] [Commented] (HADOOP-13101) TestDNS#{testDefaultDnsServer,testNullDnsServer} failed intermittently

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281381#comment-15281381 ] Steve Loughran commented on HADOOP-13101: - I think it's one of the build machine

[jira] [Moved] (HADOOP-13138) Unable to append to a SequenceFile with Compression.NONE.

2016-05-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B moved HDFS-10393 to HADOOP-13138: --- Affects Version/s: (was: 2.7.2) 2.7.2

[jira] [Updated] (HADOOP-13138) Unable to append to a SequenceFile with Compression.NONE.

2016-05-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-13138: --- Attachment: HADOOP-13138-01.patch Attaching the patch for the above Problem. Thanks [~mgerv

[jira] [Updated] (HADOOP-13138) Unable to append to a SequenceFile with Compression.NONE.

2016-05-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-13138: --- Status: Patch Available (was: Open) > Unable to append to a SequenceFile with Compression.N

[jira] [Commented] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281421#comment-15281421 ] Hadoop QA commented on HADOOP-13028: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-13138) Unable to append to a SequenceFile with Compression.NONE.

2016-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281448#comment-15281448 ] Hadoop QA commented on HADOOP-13138: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281459#comment-15281459 ] Steve Loughran commented on HADOOP-13028: - Actually this has thrown up something

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Status: Open (was: Patch Available) > add low level counter metrics for S3A; use in read

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Status: Patch Available (was: Open) > add low level counter metrics for S3A; use in read

[jira] [Created] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-12 Thread Pieter Reuse (JIRA)
Pieter Reuse created HADOOP-13139: - Summary: Branch-2: S3a to use thread pool that blocks clients Key: HADOOP-13139 URL: https://issues.apache.org/jira/browse/HADOOP-13139 Project: Hadoop Common

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Attachment: HADOOP-13028-012.patch Patch 012 for trunk > add low level counter metrics fo

[jira] [Work started] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-12 Thread Pieter Reuse (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-13139 started by Pieter Reuse. - > Branch-2: S3a to use thread pool that blocks clients >

[jira] [Updated] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-12 Thread Pieter Reuse (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pieter Reuse updated HADOOP-13139: -- Fix Version/s: 2.8.0 > Branch-2: S3a to use thread pool that blocks clients >

[jira] [Updated] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-12 Thread Pieter Reuse (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pieter Reuse updated HADOOP-13139: -- Attachment: HADOOP-13139-001.patch Added patch 001 > Branch-2: S3a to use thread pool that bl

[jira] [Updated] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-12 Thread Pieter Reuse (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pieter Reuse updated HADOOP-13139: -- Hadoop Flags: Incompatible change Affects Version/s: 2.8.0 Status: Patc

[jira] [Commented] (HADOOP-10776) Open up Delegation token fetching and renewal to STORM (Possibly others)

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281468#comment-15281468 ] Steve Loughran commented on HADOOP-10776: - Can someone do a patch for this for 2

[jira] [Updated] (HADOOP-11487) FileNotFound on distcp to s3ns3a due to creation inconsistency

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-11487: Summary: FileNotFound on distcp to s3ns3a due to creation inconsistency (was: FileNotFou

[jira] [Updated] (HADOOP-11487) FileNotFound on distcp to s3n/s3a due to creation inconsistency

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-11487: Summary: FileNotFound on distcp to s3n/s3a due to creation inconsistency (was: FileNotFo

[jira] [Commented] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281471#comment-15281471 ] Hadoop QA commented on HADOOP-13139: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-11487) FileNotFound on distcp to s3n/s3a due to creation inconsistency

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281472#comment-15281472 ] Steve Loughran commented on HADOOP-11487: - eu-central is consistent, so its not

[jira] [Commented] (HADOOP-13113) Enable parallel test execution for hadoop-aws.

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281478#comment-15281478 ] Steve Loughran commented on HADOOP-13113: - +1 It's pretty painful to look at wh

[jira] [Commented] (HADOOP-13113) Enable parallel test execution for hadoop-aws.

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281481#comment-15281481 ] Steve Loughran commented on HADOOP-13113: - oh, can you tack in a couple of lines

[jira] [Commented] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281485#comment-15281485 ] Steve Loughran commented on HADOOP-13139: - This would be great for helping cross

[jira] [Updated] (HADOOP-11487) FileNotFound on distcp to s3n/s3a due to creation inconsistency

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-11487: Affects Version/s: 2.7.2 > FileNotFound on distcp to s3n/s3a due to creation inconsistency

[jira] [Updated] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-12 Thread Pieter Reuse (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pieter Reuse updated HADOOP-13139: -- Attachment: HADOOP-13139-branch-2.001.patch Changed name to HADOOP-13139-branch-2.001.patch >

[jira] [Updated] (HADOOP-13122) Customize User-Agent header sent in HTTP requests by S3A.

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13122: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Avai

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Status: Open (was: Patch Available) > add low level counter metrics for S3A; use in read

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Attachment: HADOOP-13028-branch-2-013.patch Patch -013; as before though now applies to la

[jira] [Commented] (HADOOP-13122) Customize User-Agent header sent in HTTP requests by S3A.

2016-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281506#comment-15281506 ] Hudson commented on HADOOP-13122: - FAILURE: Integrated in Hadoop-trunk-Commit #9751 (See

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Status: Patch Available (was: Open) > add low level counter metrics for S3A; use in read

[jira] [Commented] (HADOOP-11505) Various native parts use bswap incorrectly and unportably

2016-05-12 Thread Amir Sanjar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281514#comment-15281514 ] Amir Sanjar commented on HADOOP-11505: -- Steve, valid points but ppc build has gotte

[jira] [Commented] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281521#comment-15281521 ] Hadoop QA commented on HADOOP-13028: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Status: Open (was: Patch Available) > add low level counter metrics for S3A; use in read

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Attachment: HADOOP-13028-013.patch Patch 013 as applied to current trunk > add low level

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Status: Patch Available (was: Open) > add low level counter metrics for S3A; use in read

[jira] [Commented] (HADOOP-12709) Deprecate s3:// in branch-2,; cut from trunk

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281530#comment-15281530 ] Steve Loughran commented on HADOOP-12709: - Patch LGTM, though I will need to do

[jira] [Updated] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-12 Thread Pieter Reuse (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pieter Reuse updated HADOOP-13139: -- Status: In Progress (was: Patch Available) > Branch-2: S3a to use thread pool that blocks cli

[jira] [Updated] (HADOOP-7363) TestRawLocalFileSystemContract is needed

2016-05-12 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-7363: - Attachment: HADOOP-7363.01.patch Adding [^HADOOP-7363.01.patch]. It will fail until HADOOP-13073

[jira] [Commented] (HADOOP-13131) add tests to verify that s3a supports SSE-S3 encryption

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281532#comment-15281532 ] Steve Loughran commented on HADOOP-13131: - # it's my lack of use of {{Parameteri

[jira] [Updated] (HADOOP-7363) TestRawLocalFileSystemContract is needed

2016-05-12 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-7363: - Attachment: HADOOP-7363.01.patch > TestRawLocalFileSystemContract is needed > ---

[jira] [Updated] (HADOOP-7363) TestRawLocalFileSystemContract is needed

2016-05-12 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-7363: - Attachment: (was: HADOOP-7363.01.patch) > TestRawLocalFileSystemContract is needed >

[jira] [Updated] (HADOOP-7363) TestRawLocalFileSystemContract is needed

2016-05-12 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-7363: - Attachment: (was: HADOOP-7363.01.patch) > TestRawLocalFileSystemContract is needed >

[jira] [Updated] (HADOOP-7363) TestRawLocalFileSystemContract is needed

2016-05-12 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-7363: - Attachment: HADOOP-7363.01.patch > TestRawLocalFileSystemContract is needed > ---

[jira] [Commented] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281543#comment-15281543 ] Hadoop QA commented on HADOOP-13139: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13130: Issue Type: Sub-task (was: Bug) Parent: HADOOP-11694 > s3a failures can surface a

[jira] [Commented] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281559#comment-15281559 ] Steve Loughran commented on HADOOP-13130: - Another example, forbidden access to

[jira] [Commented] (HADOOP-7363) TestRawLocalFileSystemContract is needed

2016-05-12 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281561#comment-15281561 ] Andras Bokor commented on HADOOP-7363: -- [^HADOOP-7363.01.patch] was tested on Window

[jira] [Updated] (HADOOP-13131) add tests to verify that s3a supports SSE-S3 encryption

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13131: Status: Open (was: Patch Available) > add tests to verify that s3a supports SSE-S3 encryp

[jira] [Updated] (HADOOP-13131) add tests to verify that s3a supports SSE-S3 encryption

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13131: Attachment: HADOOP-13131-002.patch new patch uses params > add tests to verify that s3a s

[jira] [Updated] (HADOOP-13131) add tests to verify that s3a supports SSE-S3 encryption

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13131: Target Version/s: 2.8.0 Status: Patch Available (was: Open) Patch 002. Test

[jira] [Commented] (HADOOP-13137) TraceAdmin should support Kerberized NameNode

2016-05-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281571#comment-15281571 ] Wei-Chiu Chuang commented on HADOOP-13137: -- Hi Steve, Thanks for the suggestion

[jira] [Commented] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281578#comment-15281578 ] Hadoop QA commented on HADOOP-13028: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281565#comment-15281565 ] Steve Loughran commented on HADOOP-13130: - Here's what I'm thinking # All metho

[jira] [Commented] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281595#comment-15281595 ] Hadoop QA commented on HADOOP-13028: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-12269) Update aws-sdk dependency to 1.10.6; move to aws-sdk-s3

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281608#comment-15281608 ] Steve Loughran commented on HADOOP-12269: - we can't fix the binding, and with th

[jira] [Commented] (HADOOP-13078) switch hadoop-aws back to using the (heavy) amazon-sdk JAR

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281611#comment-15281611 ] Steve Loughran commented on HADOOP-13078: - OK, in 1.10.6+ there is no uber JAR,

[jira] [Resolved] (HADOOP-13078) switch hadoop-aws back to using the (heavy) amazon-sdk JAR

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13078. - Resolution: Won't Fix > switch hadoop-aws back to using the (heavy) amazon-sdk JAR > ---

[jira] [Assigned] (HADOOP-13078) switch hadoop-aws back to using the (heavy) amazon-sdk JAR

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-13078: --- Assignee: Steve Loughran > switch hadoop-aws back to using the (heavy) amazon-sdk J

[jira] [Updated] (HADOOP-13116) Jets3tNativeS3FileSystemContractTest does not run.

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13116: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Avai

[jira] [Commented] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281632#comment-15281632 ] Steve Loughran commented on HADOOP-13028: - Patches working happily against branc

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13028: --- Hadoop Flags: Reviewed Here is my explicit +1 for patch v013 on both trunk and branch-2. St

[jira] [Commented] (HADOOP-12975) Add jitter to CachingGetSpaceUsed's thread

2016-05-12 Thread Elliott Clark (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281648#comment-15281648 ] Elliott Clark commented on HADOOP-12975: Yeah that's a typo. > Add jitter to Ca

[jira] [Commented] (HADOOP-13050) Upgrade to AWS SDK 10.10+ for Java 8u60+

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281647#comment-15281647 ] Steve Loughran commented on HADOOP-13050: - I'll make this patch something where

[jira] [Updated] (HADOOP-12975) Add jitter to CachingGetSpaceUsed's thread

2016-05-12 Thread Elliott Clark (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark updated HADOOP-12975: --- Attachment: HADOOP-12975v6.patch > Add jitter to CachingGetSpaceUsed's thread >

[jira] [Commented] (HADOOP-12975) Add jitter to CachingGetSpaceUsed's thread

2016-05-12 Thread Elliott Clark (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281661#comment-15281661 ] Elliott Clark commented on HADOOP-12975: bq.Can we throw an exception We could b

[jira] [Work started] (HADOOP-11694) Über-jira: S3a phase II: robustness, scale and performance

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-11694 started by Steve Loughran. --- > Über-jira: S3a phase II: robustness, scale and performance > --

[jira] [Commented] (HADOOP-13131) add tests to verify that s3a supports SSE-S3 encryption

2016-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281686#comment-15281686 ] Hadoop QA commented on HADOOP-13131: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-13116) Jets3tNativeS3FileSystemContractTest does not run.

2016-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281699#comment-15281699 ] Hudson commented on HADOOP-13116: - FAILURE: Integrated in Hadoop-trunk-Commit #9752 (See

[jira] [Commented] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281704#comment-15281704 ] Colin Patrick McCabe commented on HADOOP-13028: --- bq. This is something to

[jira] [Updated] (HADOOP-13137) TraceAdmin should support Kerberized NameNode

2016-05-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-13137: - Attachment: HADOOP-13137.001.patch A quick fix (no test, no doc). I ran this patch on a

[jira] [Commented] (HADOOP-12975) Add jitter to CachingGetSpaceUsed's thread

2016-05-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281731#comment-15281731 ] Colin Patrick McCabe commented on HADOOP-12975: --- Thanks, [~eclark]. +1 pe

[jira] [Updated] (HADOOP-12022) fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits

2016-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HADOOP-12022: - Fix Version/s: (was: 3.0.0) > fix site -Pdocs -Pdist in hadoop-proje

[jira] [Commented] (HADOOP-12291) Add support for nested groups in LdapGroupsMapping

2016-05-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281847#comment-15281847 ] Anu Engineer commented on HADOOP-12291: --- [~ekundin] Thanks for taking care of the

[jira] [Updated] (HADOOP-10230) GSetByHashMap breaks contract of GSet

2016-05-12 Thread Andres Perez (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andres Perez updated HADOOP-10230: -- Attachment: HADOOP-10230.002.patch I added the methods that were missing. > GSetByHashMap bre

[jira] [Commented] (HADOOP-12975) Add jitter to CachingGetSpaceUsed's thread

2016-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281877#comment-15281877 ] Hadoop QA commented on HADOOP-12975: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Resolved] (HADOOP-13047) S3a Forward seek in stream length to be configurable

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13047. - Resolution: Duplicate > S3a Forward seek in stream length to be configurable > -

[jira] [Resolved] (HADOOP-13058) S3A FS fails during init against a read-only FS if multipart purge is enabled

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13058. - Resolution: Duplicate fixed in HADOOP-13028 > S3A FS fails during init against a read-o

[jira] [Resolved] (HADOOP-12844) Recover when S3A fails on IOException in read()

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-12844. - Resolution: Fixed Fix Version/s: 2.8.0 > Recover when S3A fails on IOException in

[jira] [Commented] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281891#comment-15281891 ] Chris Nauroth commented on HADOOP-13130: +1 for the proposal. > s3a failures ca

[jira] [Updated] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13028: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Avai

[jira] [Commented] (HADOOP-13028) add low level counter metrics for S3A; use in read performance tests

2016-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281909#comment-15281909 ] Hudson commented on HADOOP-13028: - SUCCESS: Integrated in Hadoop-trunk-Commit #9753 (See

[jira] [Commented] (HADOOP-12291) Add support for nested groups in LdapGroupsMapping

2016-05-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281915#comment-15281915 ] Wei-Chiu Chuang commented on HADOOP-12291: -- +1 (non-binding) after fixing the c

[jira] [Commented] (HADOOP-12291) Add support for nested groups in LdapGroupsMapping

2016-05-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281919#comment-15281919 ] Wei-Chiu Chuang commented on HADOOP-12291: -- [~ekundin] you can take a look at m

[jira] [Commented] (HADOOP-13131) add tests to verify that s3a supports SSE-S3 encryption

2016-05-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281921#comment-15281921 ] Chris Nauroth commented on HADOOP-13131: Thank you for the updates in patch v002

[jira] [Commented] (HADOOP-13065) Add a new interface for retrieving FS and FC Statistics

2016-05-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281935#comment-15281935 ] Brahma Reddy Battula commented on HADOOP-13065: --- AFAIK Following is starte

[jira] [Updated] (HADOOP-10643) Add NativeS3Fs that delegates calls from FileContext apis to native s3 fs implementation

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-10643: Summary: Add NativeS3Fs that delegates calls from FileContext apis to native s3 fs impleme

[jira] [Commented] (HADOOP-13065) Add a new interface for retrieving FS and FC Statistics

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281950#comment-15281950 ] Steve Loughran commented on HADOOP-13065: - ouch. That means the key is nullw

[jira] [Moved] (HADOOP-13140) GlobalStorageStatistics should check null FileSystem scheme to avoid NPE

2016-05-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao moved HDFS-10395 to HADOOP-13140: --- Affects Version/s: (was: 2.8.0) 2.8.0 C

[jira] [Updated] (HADOOP-13083) The number of javadocs warnings is limited to 100

2016-05-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated HADOOP-13083: --- Priority: Critical (was: Major) > The number of javadocs warnings is limited to 100 >

[jira] [Commented] (HADOOP-13065) Add a new interface for retrieving FS and FC Statistics

2016-05-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281971#comment-15281971 ] Mingliang Liu commented on HADOOP-13065: Thank you [~brahmareddy] for reporting

[jira] [Updated] (HADOOP-13140) GlobalStorageStatistics should check null FileSystem scheme to avoid NPE

2016-05-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HADOOP-13140: --- Reporter: Brahma Reddy Battula (was: Mingliang Liu) > GlobalStorageStatistics should check null Fil

[jira] [Updated] (HADOOP-13140) GlobalStorageStatistics should check null FileSystem scheme to avoid NPE

2016-05-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HADOOP-13140: --- Assignee: Mingliang Liu > GlobalStorageStatistics should check null FileSystem scheme to avoid NPE >

  1   2   3   >