[jira] [Commented] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-10 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644730#comment-16644730 ] Gabor Bota commented on HADOOP-15819: - I think we should focus on solving this case first, so it

[jira] [Comment Edited] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-09 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643749#comment-16643749 ] Gabor Bota edited comment on HADOOP-15819 at 10/9/18 5:37 PM: -- Also note:

[jira] [Comment Edited] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-09 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643749#comment-16643749 ] Gabor Bota edited comment on HADOOP-15819 at 10/9/18 5:10 PM: -- Also note:

[jira] [Commented] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-09 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643749#comment-16643749 ] Gabor Bota commented on HADOOP-15819: - Also note: I was getting interesting errors when I removed

[jira] [Commented] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-09 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643742#comment-16643742 ] Gabor Bota commented on HADOOP-15819: - If I remove {{IOUtils.closeStream(getFileSystem());}} from

[jira] [Work started] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-09 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-15819 started by Gabor Bota. --- > S3A integration test failures: FileSystem is closed! - without parallel test

[jira] [Assigned] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-09 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15819: --- Assignee: Gabor Bota > S3A integration test failures: FileSystem is closed! - without

[jira] [Comment Edited] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642397#comment-16642397 ] Gabor Bota edited comment on HADOOP-15827 at 10/8/18 9:32 PM: -- Thanks, it

[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642400#comment-16642400 ] Gabor Bota commented on HADOOP-15827: - I hope the issue will be solved with this. Thanks for

[jira] [Updated] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15827: Status: Patch Available (was: Open) > NPE in DynamoDBMetadataStore.lambda$listChildren for root

[jira] [Updated] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15827: Attachment: HADOOP-15827.001.patch > NPE in DynamoDBMetadataStore.lambda$listChildren for root +

[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642397#comment-16642397 ] Gabor Bota commented on HADOOP-15827: - Thanks, it makes sense now. I was able to reproduce the

[jira] [Comment Edited] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642283#comment-16642283 ] Gabor Bota edited comment on HADOOP-15827 at 10/8/18 7:11 PM: -- I'm not

[jira] [Issue Comment Deleted] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15827: Comment: was deleted (was: But line 644 is just a comment. How can it be?) > NPE in

[jira] [Comment Edited] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642283#comment-16642283 ] Gabor Bota edited comment on HADOOP-15827 at 10/8/18 6:36 PM: -- I'm not

[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642286#comment-16642286 ] Gabor Bota commented on HADOOP-15827: - But line 644 is just a comment. How can it be? > NPE in

[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642283#comment-16642283 ] Gabor Bota commented on HADOOP-15827: - I'm not really sure if this is happening in the return.

[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642265#comment-16642265 ] Gabor Bota commented on HADOOP-15827: - I'm not able to reproduce the issue by running

[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard

2018-10-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642218#comment-16642218 ] Gabor Bota commented on HADOOP-15827: - I'll check it soon. > NPE in

[jira] [Commented] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638351#comment-16638351 ] Gabor Bota commented on HADOOP-15819: - So that's {{fs.s3a.impl.disable.cache}}

[jira] [Commented] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638306#comment-16638306 ] Gabor Bota commented on HADOOP-15819: - >From that perspective, every test could use the same

[jira] [Updated] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15819: Attachment: closed_fs_closers_example_5klines.log.zip > S3A integration test failures:

[jira] [Updated] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15819: Attachment: S3ACloseEnforcedFileSystem.java > S3A integration test failures: FileSystem is

[jira] [Created] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-04 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15819: --- Summary: S3A integration test failures: FileSystem is closed! - without parallel test run Key: HADOOP-15819 URL: https://issues.apache.org/jira/browse/HADOOP-15819

[jira] [Assigned] (HADOOP-15796) ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled

2018-10-02 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15796: --- Assignee: Gabor Bota > ClassCastException: S3AFileSystem cannot be cast to

[jira] [Comment Edited] (HADOOP-15796) ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled

2018-10-02 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16635524#comment-16635524 ] Gabor Bota edited comment on HADOOP-15796 at 10/2/18 1:56 PM: -- The

[jira] [Commented] (HADOOP-15796) ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled

2018-10-02 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16635524#comment-16635524 ] Gabor Bota commented on HADOOP-15796: - The following error keeps popping up when running tests

[jira] [Commented] (HADOOP-15796) ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634181#comment-16634181 ] Gabor Bota commented on HADOOP-15796: - Thanks for looking in this [~ste...@apache.org]! I

[jira] [Updated] (HADOOP-15621) S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15621: Status: Patch Available (was: In Progress) > S3Guard: Implement time-based (TTL) expiry for

[jira] [Commented] (HADOOP-15621) S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633804#comment-16633804 ] Gabor Bota commented on HADOOP-15621: - re-tested {{mvn -Dparallel-tests -DtestsThreadCount=8 clean

[jira] [Commented] (HADOOP-15799) ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when running with dynamo

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633724#comment-16633724 ] Gabor Bota commented on HADOOP-15799: - Cleaned up my test setup, and tested this again. It's not

[jira] [Issue Comment Deleted] (HADOOP-15799) ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when running with dynamo

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15799: Comment: was deleted (was: Ok, so I think I've figured out the issue - I had the failure with

[jira] [Comment Edited] (HADOOP-15799) ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when running with dynamo

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633720#comment-16633720 ] Gabor Bota edited comment on HADOOP-15799 at 10/1/18 8:38 AM: -- Ok, so I

[jira] [Commented] (HADOOP-15799) ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when running with dynamo

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633720#comment-16633720 ] Gabor Bota commented on HADOOP-15799: - Ok, so I think I've figured out the issue - I had the

[jira] [Assigned] (HADOOP-15799) ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when running with dynamo

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15799: --- Assignee: Gabor Bota > ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when

[jira] [Updated] (HADOOP-15800) ITestS3GuardListConsistency#testConsistentListAfterDelete fails when running with dynamo

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15800: Description: I've seen a new failure when running verify for HADOOP-15621. First I thought it

[jira] [Commented] (HADOOP-15799) ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when running with dynamo

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633632#comment-16633632 ] Gabor Bota commented on HADOOP-15799: - us-west-1, and I was in that region when the test failed.

[jira] [Assigned] (HADOOP-15798) ITestS3GuardListConsistency#testConsistentListAfterDelete failing with LocalMetadataStore

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15798: --- Assignee: Gabor Bota > ITestS3GuardListConsistency#testConsistentListAfterDelete failing

[jira] [Commented] (HADOOP-15798) ITestS3GuardListConsistency#testConsistentListAfterDelete failing with LocalMetadataStore

2018-10-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633631#comment-16633631 ] Gabor Bota commented on HADOOP-15798: - Thanks [~ste...@apache.org]! I'll add that when I fix the

[jira] [Commented] (HADOOP-15621) S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-09-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631196#comment-16631196 ] Gabor Bota commented on HADOOP-15621: - Finally, I've uploaded the second patch for this. During the

[jira] [Updated] (HADOOP-15621) S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-09-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15621: Attachment: HADOOP-15621.002.patch > S3Guard: Implement time-based (TTL) expiry for

[jira] [Comment Edited] (HADOOP-15621) S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-09-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607040#comment-16607040 ] Gabor Bota edited comment on HADOOP-15621 at 9/27/18 11:50 PM: --- Based on

[jira] [Updated] (HADOOP-15621) S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-09-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15621: Attachment: (was: HADOOP-15621.002.patch) > S3Guard: Implement time-based (TTL) expiry for

[jira] [Updated] (HADOOP-15621) S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-09-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15621: Attachment: HADOOP-15621.002.patch > S3Guard: Implement time-based (TTL) expiry for

[jira] [Updated] (HADOOP-15621) S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-09-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15621: Attachment: (was: HADOOP-15621.002.patch) > S3Guard: Implement time-based (TTL) expiry for

[jira] [Updated] (HADOOP-15621) S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-09-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15621: Attachment: HADOOP-15621.002.patch > S3Guard: Implement time-based (TTL) expiry for

[jira] [Updated] (HADOOP-15800) ITestS3GuardListConsistency#testConsistentListAfterDelete fails when running with dynamo

2018-09-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15800: Description: I've seen a new failure when running verify for HADOOP-15621. First I thought it

[jira] [Created] (HADOOP-15800) ITestS3GuardListConsistency#testConsistentListAfterDelete fails when running with dynamo

2018-09-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15800: --- Summary: ITestS3GuardListConsistency#testConsistentListAfterDelete fails when running with dynamo Key: HADOOP-15800 URL: https://issues.apache.org/jira/browse/HADOOP-15800

[jira] [Updated] (HADOOP-15799) ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when running with dynamo

2018-09-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15799: Description: I've seen a new failure when running verify for HADOOP-15621. First I thought it

[jira] [Created] (HADOOP-15799) ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when running with dynamo

2018-09-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15799: --- Summary: ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when running with dynamo Key: HADOOP-15799 URL: https://issues.apache.org/jira/browse/HADOOP-15799

[jira] [Created] (HADOOP-15798) ITestS3GuardListConsistency#testConsistentListAfterDelete failing with LocalMetadataStore

2018-09-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15798: --- Summary: ITestS3GuardListConsistency#testConsistentListAfterDelete failing with LocalMetadataStore Key: HADOOP-15798 URL: https://issues.apache.org/jira/browse/HADOOP-15798

[jira] [Updated] (HADOOP-15796) ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled

2018-09-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15796: Issue Type: Sub-task (was: Bug) Parent: HADOOP-15619 > ClassCastException:

[jira] [Updated] (HADOOP-15796) ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled

2018-09-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15796: Description: Sometimes we get {{java.io.IOException: s3a://TEST-BUCKET: FileSystem is closed!}}

[jira] [Created] (HADOOP-15796) ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled

2018-09-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15796: --- Summary: ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled Key: HADOOP-15796 URL: https://issues.apache.org/jira/browse/HADOOP-15796

[jira] [Assigned] (HADOOP-15370) S3A log message on rm s3a://bucket/ not intuitive

2018-09-25 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15370: --- Assignee: Gabor Bota > S3A log message on rm s3a://bucket/ not intuitive >

[jira] [Assigned] (HADOOP-15603) S3A to support configuring various AWS S3 client extended options

2018-09-25 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15603: --- Assignee: (was: Gabor Bota) > S3A to support configuring various AWS S3 client

[jira] [Assigned] (HADOOP-15780) S3Guard: document how to deal with non-S3Guard processes writing data to S3Guarded buckets

2018-09-25 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15780: --- Assignee: Gabor Bota > S3Guard: document how to deal with non-S3Guard processes writing

[jira] [Assigned] (HADOOP-15779) S3guard: add inconsistency detection metrics

2018-09-25 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15779: --- Assignee: Gabor Bota > S3guard: add inconsistency detection metrics >

[jira] [Updated] (HADOOP-15621) S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-09-25 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15621: Priority: Major (was: Minor) > S3Guard: Implement time-based (TTL) expiry for Authoritative

[jira] [Updated] (HADOOP-15621) S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-09-25 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15621: Summary: S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing (was:

[jira] [Updated] (HADOOP-15621) S3guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

2018-09-25 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15621: Summary: S3guard: Implement time-based (TTL) expiry for Authoritative Directory Listing (was:

[jira] [Issue Comment Deleted] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

2018-09-24 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15621: Comment: was deleted (was: There is no call from {{S3AFileSytem}} to {{MetadataStore#put}}

[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

2018-09-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:51 PM: -- Just a

[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

2018-09-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:51 PM: -- There is no

[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

2018-09-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:44 PM: -- Just a

[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

2018-09-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:44 PM: -- Just a

[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

2018-09-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:40 PM: -- Just a

[jira] [Commented] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

2018-09-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota commented on HADOOP-15621: - Just a note: There is no call from {{S3AFileSytem}} to

[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

2018-09-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607040#comment-16607040 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:31 PM: -- Based on

[jira] [Commented] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614784#comment-16614784 ] Gabor Bota commented on HADOOP-15754: - Had to fix

[jira] [Updated] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15754: Attachment: HADOOP-15754.002.patch > s3guard: testDynamoTableTagging should clear existing

[jira] [Comment Edited] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613931#comment-16613931 ] Gabor Bota edited comment on HADOOP-15754 at 9/13/18 6:59 PM: -- I can fix

[jira] [Comment Edited] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613931#comment-16613931 ] Gabor Bota edited comment on HADOOP-15754 at 9/13/18 6:56 PM: -- I can fix

[jira] [Commented] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613931#comment-16613931 ] Gabor Bota commented on HADOOP-15754: - I can fix this by setting the region manually in the test if

[jira] [Commented] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613771#comment-16613771 ] Gabor Bota commented on HADOOP-15754: - Thanks for testing it [~ste...@apache.org]. I've tested

[jira] [Commented] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613420#comment-16613420 ] Gabor Bota commented on HADOOP-15754: - Had to add the fix to

[jira] [Updated] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15754: Attachment: HADOOP-15754.001.patch > s3guard: testDynamoTableTagging should clear existing

[jira] [Updated] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15754: Status: Patch Available (was: Open) > s3guard: testDynamoTableTagging should clear existing

[jira] [Commented] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613389#comment-16613389 ] Gabor Bota commented on HADOOP-15754: - Moving this under HADOOP-15226, because this will fix an

[jira] [Updated] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15754: Issue Type: Sub-task (was: Bug) Parent: HADOOP-15226 > s3guard: testDynamoTableTagging

[jira] [Assigned] (HADOOP-15754) s3guard: testDynamoTableTagging should clear existing config

2018-09-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15754: --- Assignee: Gabor Bota > s3guard: testDynamoTableTagging should clear existing config >

[jira] [Commented] (HADOOP-14734) add option to tag DDB table(s) created

2018-09-12 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611877#comment-16611877 ] Gabor Bota commented on HADOOP-14734: - Fixed checkstyle issues in v5. Tests and verify ran

[jira] [Updated] (HADOOP-14734) add option to tag DDB table(s) created

2018-09-12 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-14734: Attachment: HADOOP-14734.005.patch > add option to tag DDB table(s) created >

[jira] [Commented] (HADOOP-14734) add option to tag DDB table(s) created

2018-09-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610547#comment-16610547 ] Gabor Bota commented on HADOOP-14734: - Hi [~ste...@apache.org], Hope you don't mind if I continue

[jira] [Updated] (HADOOP-14734) add option to tag DDB table(s) created

2018-09-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-14734: Attachment: HADOOP-14734.004.patch > add option to tag DDB table(s) created >

[jira] [Commented] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

2018-09-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607040#comment-16607040 ] Gabor Bota commented on HADOOP-15621: - Based on your comments [~fabbri] I think we could rename

[jira] [Updated] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

2018-09-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15621: Status: In Progress (was: Patch Available) > s3guard: implement time-based (TTL) expiry for

[jira] [Commented] (HADOOP-15709) Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants

2018-09-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604534#comment-16604534 ] Gabor Bota commented on HADOOP-15709: - Hi [~smeng], thanks for the review. I'd rather add

[jira] [Updated] (HADOOP-15709) Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants

2018-09-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15709: Attachment: HADOOP-15709.003.patch > Move S3Guard LocalMetadataStore constants to >

[jira] [Comment Edited] (HADOOP-15635) s3guard set-capacity command to fail fast if bucket is unguarded

2018-09-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604527#comment-16604527 ] Gabor Bota edited comment on HADOOP-15635 at 9/5/18 3:13 PM: - Thanks for

[jira] [Comment Edited] (HADOOP-15635) s3guard set-capacity command to fail fast if bucket is unguarded

2018-09-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604527#comment-16604527 ] Gabor Bota edited comment on HADOOP-15635 at 9/5/18 3:13 PM: - Thanks for

[jira] [Comment Edited] (HADOOP-15635) s3guard set-capacity command to fail fast if bucket is unguarded

2018-09-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604527#comment-16604527 ] Gabor Bota edited comment on HADOOP-15635 at 9/5/18 3:11 PM: - Thanks for

[jira] [Commented] (HADOOP-15635) s3guard set-capacity command to fail fast if bucket is unguarded

2018-09-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604527#comment-16604527 ] Gabor Bota commented on HADOOP-15635: - Thanks for the review [~hgadre], [~mackrorysd], I've

[jira] [Updated] (HADOOP-15635) s3guard set-capacity command to fail fast if bucket is unguarded

2018-09-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15635: Status: Open (was: Patch Available) > s3guard set-capacity command to fail fast if bucket is

[jira] [Updated] (HADOOP-15635) s3guard set-capacity command to fail fast if bucket is unguarded

2018-09-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15635: Attachment: HADOOP-15635.003.patch > s3guard set-capacity command to fail fast if bucket is

[jira] [Updated] (HADOOP-15635) s3guard set-capacity command to fail fast if bucket is unguarded

2018-09-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15635: Status: Patch Available (was: Open) > s3guard set-capacity command to fail fast if bucket is

[jira] [Updated] (HADOOP-15709) Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants

2018-09-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15709: Status: Patch Available (was: Open) > Move S3Guard LocalMetadataStore constants to >

[jira] [Updated] (HADOOP-15709) Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants

2018-09-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15709: Status: Open (was: Patch Available) > Move S3Guard LocalMetadataStore constants to >

[jira] [Updated] (HADOOP-15717) TGT renewal thread does not log IOException

2018-09-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15717: Description: I came across a case where tgt.getEndTime() was returned null and it resulted in

[jira] [Commented] (HADOOP-15717) TGT renewal thread does not log IOException

2018-09-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603144#comment-16603144 ] Gabor Bota commented on HADOOP-15717: - Thanks for the clarification. It would be nice to have this

<    4   5   6   7   8   9   10   11   12   13   >