[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363527#comment-16363527 ] ASF GitHub Bot commented on HADOOP-13972: - Github user ssonker commented on the issue:

[jira] [Commented] (HADOOP-13761) S3Guard: implement retries for DDB failures and throttling; translate exceptions

2018-02-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363517#comment-16363517 ] Aaron Fabbri commented on HADOOP-13761: --- Some entertaining logs from the new scale test introduced

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363513#comment-16363513 ] John Zhuge commented on HADOOP-13972: - Thanks [~ssonker] for the PR. Added you as a contributor to

[jira] [Assigned] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HADOOP-13972: --- Assignee: Sharad Sonker > ADLS to support per-store configuration >

[jira] [Updated] (HADOOP-15040) Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation

2018-02-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-15040: -- Fix Version/s: 3.0.2 > Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log

[jira] [Commented] (HADOOP-15040) Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation

2018-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363476#comment-16363476 ] Hudson commented on HADOOP-15040: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13653 (See

[jira] [Commented] (HADOOP-15040) Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation

2018-02-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363462#comment-16363462 ] Aaron Fabbri commented on HADOOP-15040: --- Will also commit branch-3.0 in a moment, FYI. > Upgrade

[jira] [Updated] (HADOOP-15040) Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation

2018-02-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-15040: -- Fix Version/s: 3.1.0 > Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log

[jira] [Updated] (HADOOP-15040) Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation

2018-02-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-15040: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank

[jira] [Updated] (HADOOP-14080) UserGroupInformation#loginUserFromKeytab does not load hadoop tokens ?

2018-02-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HADOOP-14080: Target Version/s: 3.2.0 (was: 3.1.0) > UserGroupInformation#loginUserFromKeytab does not load

[jira] [Commented] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363423#comment-16363423 ] genericqa commented on HADOOP-14927: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15231) WavefrontSink for Hadoop Metrics2

2018-02-13 Thread Howard Yoo (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Howard Yoo updated HADOOP-15231: Issue Type: New Feature (was: Wish) > WavefrontSink for Hadoop Metrics2 >

[jira] [Commented] (HADOOP-15231) WavefrontSink for Hadoop Metrics2

2018-02-13 Thread Howard Yoo (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363420#comment-16363420 ] Howard Yoo commented on HADOOP-15231: - created new PR for the WavefrontSink to be merged in github :

[jira] [Commented] (HADOOP-14734) add option to tag DDB table(s) created

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363395#comment-16363395 ] genericqa commented on HADOOP-14734: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

2018-02-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363379#comment-16363379 ] Aaron Fabbri edited comment on HADOOP-14927 at 2/14/18 2:21 AM: v1

[jira] [Updated] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

2018-02-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14927: -- Attachment: HADOOP-14927.001.patch > ITestS3GuardTool failures in testDestroyNoBucket() >

[jira] [Updated] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

2018-02-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14927: -- Status: Patch Available (was: In Progress) v1 patch. Also fix a nearby javadoc error >

[jira] [Work started] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

2018-02-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-14927 started by Aaron Fabbri. - > ITestS3GuardTool failures in testDestroyNoBucket() >

[jira] [Updated] (HADOOP-14734) add option to tag DDB table(s) created

2018-02-13 Thread Abraham Fine (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abraham Fine updated HADOOP-14734: -- Attachment: HADOOP-14734-002.patch > add option to tag DDB table(s) created >

[jira] [Commented] (HADOOP-14734) add option to tag DDB table(s) created

2018-02-13 Thread Abraham Fine (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363352#comment-16363352 ] Abraham Fine commented on HADOOP-14734: --- Fixed findbugs. Integration tests run against us-west-2

[jira] [Updated] (HADOOP-15231) WavefrontSink for Hadoop Metrics2

2018-02-13 Thread Howard Yoo (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Howard Yoo updated HADOOP-15231: Description: Wavefront is a SaaS based large scale real time metrics monitoring and analytic

[jira] [Created] (HADOOP-15231) WavefrontSink for Hadoop Metrics2

2018-02-13 Thread Howard Yoo (JIRA)
Howard Yoo created HADOOP-15231: --- Summary: WavefrontSink for Hadoop Metrics2 Key: HADOOP-15231 URL: https://issues.apache.org/jira/browse/HADOOP-15231 Project: Hadoop Common Issue Type: Wish

[jira] [Commented] (HADOOP-15230) org.apache.hadoop.metrics2.GraphiteSink is not implemented correctly

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363309#comment-16363309 ] ASF GitHub Bot commented on HADOOP-15230: - GitHub user howardyoo opened a pull request:

[jira] [Commented] (HADOOP-15230) org.apache.hadoop.metrics2.GraphiteSink is not implemented correctly

2018-02-13 Thread Howard Yoo (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363311#comment-16363311 ] Howard Yoo commented on HADOOP-15230: - pushed a new PR to fix this issue at :

[jira] [Commented] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-02-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363299#comment-16363299 ] Ajay Kumar commented on HADOOP-12897: - [~arpitagarwal] thanks for review, commit.

[jira] [Updated] (HADOOP-15230) org.apache.hadoop.metrics2.GraphiteSink is not implemented correctly

2018-02-13 Thread Howard Yoo (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Howard Yoo updated HADOOP-15230: Description: org.apache.hadoop.metrics2.GraphiteSink's implementation has certain problems that

[jira] [Updated] (HADOOP-15230) org.apache.hadoop.metrics2.GraphiteSink is not implemented correctly

2018-02-13 Thread Howard Yoo (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Howard Yoo updated HADOOP-15230: Flags: Patch Labels: GraphiteSink, metrics (was: ) >

[jira] [Updated] (HADOOP-15230) org.apache.hadoop.metrics2.GraphiteSink is not implemented correctly

2018-02-13 Thread Howard Yoo (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Howard Yoo updated HADOOP-15230: Tags: metrics graphite (was: metrics) > org.apache.hadoop.metrics2.GraphiteSink is not

[jira] [Created] (HADOOP-15230) org.apache.hadoop.metrics2.GraphiteSink is not implemented correctly

2018-02-13 Thread Howard Yoo (JIRA)
Howard Yoo created HADOOP-15230: --- Summary: org.apache.hadoop.metrics2.GraphiteSink is not implemented correctly Key: HADOOP-15230 URL: https://issues.apache.org/jira/browse/HADOOP-15230 Project: Hadoop

[jira] [Commented] (HADOOP-14734) add option to tag DDB table(s) created

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363269#comment-16363269 ] genericqa commented on HADOOP-14734: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14734) add option to tag DDB table(s) created

2018-02-13 Thread Abraham Fine (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363218#comment-16363218 ] Abraham Fine commented on HADOOP-14734: --- A couple things to note about the patch: * The document

[jira] [Updated] (HADOOP-14734) add option to tag DDB table(s) created

2018-02-13 Thread Abraham Fine (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abraham Fine updated HADOOP-14734: -- Status: Patch Available (was: Open) > add option to tag DDB table(s) created >

[jira] [Updated] (HADOOP-14734) add option to tag DDB table(s) created

2018-02-13 Thread Abraham Fine (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abraham Fine updated HADOOP-14734: -- Attachment: HADOOP-14734-001.patch > add option to tag DDB table(s) created >

[jira] [Commented] (HADOOP-15206) BZip2 drops and duplicates records when input split size is small

2018-02-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363203#comment-16363203 ] Jason Lowe commented on HADOOP-15206: - Thanks for updating the patch! I believe the latest patch

[jira] [Commented] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

2018-02-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363190#comment-16363190 ] Aaron Fabbri commented on HADOOP-14927: --- I do see it occasionally, just haven't bothered to post a

[jira] [Commented] (HADOOP-15076) Enhance s3a troubleshooting docs, add perf section

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363153#comment-16363153 ] genericqa commented on HADOOP-15076: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363149#comment-16363149 ] Steve Loughran commented on HADOOP-15176: - Test failure: looks like the specific test needs

[jira] [Updated] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15176: Status: Open (was: Patch Available) > Enhance IAM assumed role support in S3A client >

[jira] [Commented] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363132#comment-16363132 ] Steve Loughran commented on HADOOP-14507: - This is ready for review. +[~lmccay] > extend

[jira] [Created] (HADOOP-15229) Add FileSystem builder-based open API to match create()

2018-02-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15229: --- Summary: Add FileSystem builder-based open API to match create() Key: HADOOP-15229 URL: https://issues.apache.org/jira/browse/HADOOP-15229 Project: Hadoop

[jira] [Commented] (HADOOP-14178) Move Mockito up to version 2.x

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363107#comment-16363107 ] genericqa commented on HADOOP-14178: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15076) Enhance s3a troubleshooting docs, add perf section

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363104#comment-16363104 ] Steve Loughran commented on HADOOP-15076: - patch 006: * pull out AccessDenied into its own

[jira] [Updated] (HADOOP-15076) Enhance s3a troubleshooting docs, add perf section

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15076: Status: Patch Available (was: Open) > Enhance s3a troubleshooting docs, add perf section

[jira] [Updated] (HADOOP-15076) Enhance s3a troubleshooting docs, add perf section

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15076: Attachment: HADOOP-15076-006.patch > Enhance s3a troubleshooting docs, add perf section >

[jira] [Resolved] (HADOOP-14530) Translate AWS SSE-KMS missing key exception to something

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14530. - Resolution: Won't Fix Fix Version/s: 3.1.0 There's nothing meaningful to change

[jira] [Updated] (HADOOP-14530) Translate AWS SSE-KMS missing key exception to something

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14530: Summary: Translate AWS SSE-KMS missing key exception to something (was: Translate ARN

[jira] [Updated] (HADOOP-14530) Translate ARN exception to something

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14530: Parent Issue: HADOOP-14831 (was: HADOOP-15220) > Translate ARN exception to something >

[jira] [Updated] (HADOOP-14530) Translate ARN exception to something

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14530: Description: when you use SSE-KMS and the ARN is invalid for that region, you get a 400

[jira] [Resolved] (HADOOP-14325) Stabilise S3A Server Side Encryption

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14325. - Resolution: Fixed Fix Version/s: 3.1.0 > Stabilise S3A Server Side Encryption >

[jira] [Updated] (HADOOP-14530) Translate ARN exception to something

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14530: Summary: Translate ARN exception to something (was: Translate ARN exception to something

[jira] [Updated] (HADOOP-14528) s3a encryption tests fail when dest bucket has fs.s3a.server-side-encryption.key set

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14528: Parent Issue: HADOOP-15220 (was: HADOOP-14325) > s3a encryption tests fail when dest

[jira] [Resolved] (HADOOP-14332) Document S3A SSE

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14332. - Resolution: Duplicate Assignee: Steve Loughran > Document S3A SSE >

[jira] [Commented] (HADOOP-14332) Document S3A SSE

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363047#comment-16363047 ] Steve Loughran commented on HADOOP-14332: - Covering in HADOOP-15076 > Document S3A SSE >

[jira] [Updated] (HADOOP-14972) S3A add histogram metrics types for latency, etc.

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14972: Parent Issue: HADOOP-15220 (was: HADOOP-14831) > S3A add histogram metrics types for

[jira] [Commented] (HADOOP-15228) S3A Retry policy to retry on NoResponseException

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363028#comment-16363028 ] Steve Loughran commented on HADOOP-15228: - {code} 2017-02-07 10:01:07,950 INFO

[jira] [Created] (HADOOP-15228) S3A Retry policy to retry on NoResponseException

2018-02-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15228: --- Summary: S3A Retry policy to retry on NoResponseException Key: HADOOP-15228 URL: https://issues.apache.org/jira/browse/HADOOP-15228 Project: Hadoop Common

[jira] [Commented] (HADOOP-15227) add mapreduce.outputcommitter.factory.scheme.s3a to core-default

2018-02-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363017#comment-16363017 ] Jason Lowe commented on HADOOP-15227: - Does this go in core-default or mapred-default? The property

[jira] [Created] (HADOOP-15227) add mapreduce.outputcommitter.factory.scheme.s3a to core-default

2018-02-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15227: --- Summary: add mapreduce.outputcommitter.factory.scheme.s3a to core-default Key: HADOOP-15227 URL: https://issues.apache.org/jira/browse/HADOOP-15227 Project:

[jira] [Commented] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362918#comment-16362918 ] genericqa commented on HADOOP-14507: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HADOOP-14077) Improve the patch of HADOOP-13119

2018-02-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved HADOOP-14077. Resolution: Fixed This has already been part of a release. Please leave it resolved. >

[jira] [Commented] (HADOOP-14799) Update nimbus-jose-jwt to 4.41.1

2018-02-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362907#comment-16362907 ] Ray Chiang commented on HADOOP-14799: - [~lmccay], this was originally done as one of a batch of

[jira] [Commented] (HADOOP-14903) Add json-smart explicitly to pom.xml

2018-02-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362895#comment-16362895 ] Brahma Reddy Battula commented on HADOOP-14903: --- As  -HADOOP-14799-  committed to

[jira] [Updated] (HADOOP-14799) Update nimbus-jose-jwt to 4.41.1

2018-02-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-14799: -- Fix Version/s: 2.8.4 2.9.1 2.10.0 >

[jira] [Commented] (HADOOP-14799) Update nimbus-jose-jwt to 4.41.1

2018-02-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362879#comment-16362879 ] Brahma Reddy Battula commented on HADOOP-14799: --- Pushed to branch-2,branch-2.9 and

[jira] [Updated] (HADOOP-14334) S3 SSEC tests to downgrade when running against a mandatory encryption object store

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14334: Parent Issue: HADOOP-15220 (was: HADOOP-14325) > S3 SSEC tests to downgrade when

[jira] [Commented] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362864#comment-16362864 ] Hudson commented on HADOOP-12897: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13652 (See

[jira] [Commented] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362855#comment-16362855 ] genericqa commented on HADOOP-15176: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362850#comment-16362850 ] ASF GitHub Bot commented on HADOOP-13972: - Github user ssonker commented on the issue:

[jira] [Updated] (HADOOP-13637) improve setting of max connections in AWS client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13637: Target Version/s: (was: 3.1.0) > improve setting of max connections in AWS client >

[jira] [Resolved] (HADOOP-14620) S3A authentication failure for regions other than us-east-1

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14620. - Resolution: Works for Me Fix Version/s: 3.1.0 > S3A authentication failure for

[jira] [Commented] (HADOOP-14620) S3A authentication failure for regions other than us-east-1

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362845#comment-16362845 ] Steve Loughran commented on HADOOP-14620: - I've now got a diagnostics tool to help diagnose

[jira] [Updated] (HADOOP-14831) Über-jira: S3a phase IV: Hadoop 3.1 features

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14831: Priority: Blocker (was: Major) Issue Type: Improvement (was: Bug) > Über-jira:

[jira] [Resolved] (HADOOP-13308) S3A delete and rename may fail to preserve parent directory.

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13308. - Resolution: Won't Fix > S3A delete and rename may fail to preserve parent directory. >

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Status: Patch Available (was: Open) > extend per-bucket secret key config with explicit

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Attachment: HADOOP-14507-007.patch > extend per-bucket secret key config with explicit

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Attachment: (was: HADOOP-14507-007.patch) > extend per-bucket secret key config with

[jira] [Updated] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-02-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HADOOP-12897: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362745#comment-16362745 ] ASF GitHub Bot commented on HADOOP-13972: - Github user steveloughran commented on the issue:

[jira] [Commented] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362721#comment-16362721 ] Steve Loughran commented on HADOOP-14507: - Patch 007, working on trunk properly. Test: S3A

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Attachment: HADOOP-14507-007.patch > extend per-bucket secret key config with explicit

[jira] [Commented] (HADOOP-15223) Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and emptyMap() when available

2018-02-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362712#comment-16362712 ] Akira Ajisaka commented on HADOOP-15223: Thanks [~zhenyi] for the patch! Some comments: 1. Would

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362708#comment-16362708 ] ASF GitHub Bot commented on HADOOP-13972: - Github user ssonker commented on the issue:

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362702#comment-16362702 ] ASF GitHub Bot commented on HADOOP-13972: - Github user ssonker commented on the issue:

[jira] [Commented] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362682#comment-16362682 ] Akira Ajisaka commented on HADOOP-10571: Thanks! Now I'm +1 pending Jenkins and Steve's next

[jira] [Updated] (HADOOP-14178) Move Mockito up to version 2.x

2018-02-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14178: --- Attachment: HADOOP-14178.008.patch > Move Mockito up to version 2.x >

[jira] [Commented] (HADOOP-14178) Move Mockito up to version 2.x

2018-02-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362679#comment-16362679 ] Akira Ajisaka commented on HADOOP-14178: Thanks! 008 patch addressed your comment. > Move

[jira] [Updated] (HADOOP-14800) eliminate double stack trace on some s3guard CLI failures

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14800: Parent Issue: HADOOP-14825 (was: HADOOP-15226) > eliminate double stack trace on some

[jira] [Updated] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14468: Target Version/s: 3.2.0 > S3Guard: make short-circuit getFileStatus() configurable >

[jira] [Commented] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362675#comment-16362675 ] Steve Loughran commented on HADOOP-14927: - Have you got the patch for this? Or can we close it

[jira] [Updated] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14468: Parent Issue: HADOOP-15226 (was: HADOOP-14825) > S3Guard: make short-circuit

[jira] [Commented] (HADOOP-14825) Über-JIRA: S3Guard Phase II: Hadoop 3.1 features

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362673#comment-16362673 ] Steve Loughran commented on HADOOP-14825: - I've just created a phase III JIRA for Hadoop 3.2,

[jira] [Reopened] (HADOOP-14077) Improve the patch of HADOOP-13119

2018-02-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened HADOOP-14077: > Improve the patch of HADOOP-13119 > - > > Key:

[jira] [Updated] (HADOOP-13936) S3Guard: DynamoDB can go out of sync with S3AFileSystem::delete operation

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13936: Priority: Blocker (was: Minor) > S3Guard: DynamoDB can go out of sync with

[jira] [Assigned] (HADOOP-13936) S3Guard: DynamoDB can go out of sync with S3AFileSystem::delete operation

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-13936: --- Assignee: Steve Loughran > S3Guard: DynamoDB can go out of sync with

[jira] [Commented] (HADOOP-14077) Improve the patch of HADOOP-13119

2018-02-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362666#comment-16362666 ] Eric Yang commented on HADOOP-14077: [~yuanbo] Hadoop Security team has brought to my attention that

[jira] [Updated] (HADOOP-15183) S3Guard store becomes inconsistent after partial failure of rename

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15183: Priority: Blocker (was: Major) > S3Guard store becomes inconsistent after partial

[jira] [Commented] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362664#comment-16362664 ] Steve Loughran commented on HADOOP-15176: - Testing: S3 ireland. This is ready for review now >

[jira] [Commented] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362660#comment-16362660 ] Steve Loughran commented on HADOOP-15176: - * skip tests of rename in assumed role which fail

[jira] [Updated] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15176: Status: Patch Available (was: Open) > Enhance IAM assumed role support in S3A client >

[jira] [Updated] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15176: Attachment: HADOOP-15176-003.patch > Enhance IAM assumed role support in S3A client >

  1   2   >