[jira] [Commented] (HADOOP-16375) ITestS3AMetadataPersistenceException failure

[ https://issues.apache.org/jira/browse/HADOOP-16375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868000#comment-16868000 ] Ben Roling commented on HADOOP-16375: - This is odd.  setup() is already doing FileS

[jira] [Commented] (HADOOP-16085) S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849748#comment-16849748 ] Ben Roling commented on HADOOP-16085: - Yeah, I wasn't sure about that add.  I tried

[jira] [Commented] (HADOOP-16085) S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16843993#comment-16843993 ] Ben Roling commented on HADOOP-16085: - Thanks Steve for all your help! > S3Guard:

[jira] [Created] (HADOOP-16319) ITestS3AMiscOperations.testEmptyFileChecksums and ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted fail with default encryption enabled on bucket

Ben Roling created HADOOP-16319: --- Summary: ITestS3AMiscOperations.testEmptyFileChecksums and ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted fail with default encryption enabled on bucket Key: HADOOP-16319

[jira] [Commented] (HADOOP-16221) S3Guard: fail write that doesn't update metadata store

[ https://issues.apache.org/jira/browse/HADOOP-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831010#comment-16831010 ] Ben Roling commented on HADOOP-16221: - Thanks [~fabbri] for sharing your perspectiv

[jira] [Commented] (HADOOP-16221) S3Guard: fail write that doesn't update metadata store

[ https://issues.apache.org/jira/browse/HADOOP-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830322#comment-16830322 ] Ben Roling commented on HADOOP-16221: - Awesome, thanks! > S3Guard: fail write that

[jira] [Commented] (HADOOP-16252) Use configurable dynamo table name prefix in S3Guard tests

[ https://issues.apache.org/jira/browse/HADOOP-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16825178#comment-16825178 ] Ben Roling commented on HADOOP-16252: - Awesome! > Use configurable dynamo table na

[jira] [Commented] (HADOOP-16252) Use configurable dynamo table name prefix in S3Guard tests

[ https://issues.apache.org/jira/browse/HADOOP-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820653#comment-16820653 ] Ben Roling commented on HADOOP-16252: - {quote}I see you mentioned your testing in t

[jira] [Commented] (HADOOP-16085) S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820336#comment-16820336 ] Ben Roling commented on HADOOP-16085: - bq. Have been discussing with Steve Loughran

[jira] [Commented] (HADOOP-16252) Use configurable dynamo table name prefix in S3Guard tests

[ https://issues.apache.org/jira/browse/HADOOP-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818010#comment-16818010 ] Ben Roling commented on HADOOP-16252: - bq. Are the tests still actually creating ta

[jira] [Created] (HADOOP-16252) Use configurable dynamo table name prefix in S3Guard tests

Ben Roling created HADOOP-16252: --- Summary: Use configurable dynamo table name prefix in S3Guard tests Key: HADOOP-16252 URL: https://issues.apache.org/jira/browse/HADOOP-16252 Project: Hadoop Common

[jira] [Commented] (HADOOP-16221) S3Guard: fail write that doesn't update metadata store

[ https://issues.apache.org/jira/browse/HADOOP-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805149#comment-16805149 ] Ben Roling commented on HADOOP-16221: - I'm preparing a patch for this. I appreciat

[jira] [Commented] (HADOOP-16085) S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805009#comment-16805009 ] Ben Roling commented on HADOOP-16085: - I just logged HADOOP-16221 which is somewhat

[jira] [Created] (HADOOP-16221) S3Guard: fail write that doesn't update metadata store

Ben Roling created HADOOP-16221: --- Summary: S3Guard: fail write that doesn't update metadata store Key: HADOOP-16221 URL: https://issues.apache.org/jira/browse/HADOOP-16221 Project: Hadoop Common

[jira] [Commented] (HADOOP-16085) S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1680#comment-1680 ] Ben Roling commented on HADOOP-16085: - I posted a PR with my latest progress: https

[jira] [Commented] (HADOOP-16085) S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793905#comment-16793905 ] Ben Roling commented on HADOOP-16085: - I should also note that the new patch implem

[jira] [Updated] (HADOOP-16085) S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-16085: Attachment: HADOOP-16085-003.patch > S3Guard: use object version or etags to protect against inco

[jira] [Commented] (HADOOP-16085) S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793895#comment-16793895 ] Ben Roling commented on HADOOP-16085: - With HADOOP-15625 now complete, I've been pr

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16791986#comment-16791986 ] Ben Roling commented on HADOOP-15625: - Is part of it bad fs.s3a.s3guard.ddb.table a

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790971#comment-16790971 ] Ben Roling commented on HADOOP-15625: - I also went ahead and ran the integration te

[jira] [Comment Edited] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790913#comment-16790913 ] Ben Roling edited comment on HADOOP-15625 at 3/12/19 7:34 PM: ---

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790913#comment-16790913 ] Ben Roling commented on HADOOP-15625: - I ran the integration tests again against a

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790819#comment-16790819 ] Ben Roling commented on HADOOP-15625: - I guess I just accidentally hit the keyboard

[jira] [Assigned] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling reassigned HADOOP-15625: --- Assignee: Ben Roling (was: Brahma Reddy Battula) > S3A input stream to use etags/version

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790813#comment-16790813 ] Ben Roling commented on HADOOP-15625: - I just ran the integration tests ({{mvn -T 1

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790704#comment-16790704 ] Ben Roling commented on HADOOP-15625: - 016 patch attached.  As suggested, it addres

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-15625: Attachment: HADOOP-15625-016.patch > S3A input stream to use etags/version number to detect chang

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790686#comment-16790686 ] Ben Roling commented on HADOOP-15625: - Thanks for the review [~gabor.bota].  I'll g

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790616#comment-16790616 ] Ben Roling commented on HADOOP-15625: - Thanks [~gabor.bota].  Did you get a chance

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789679#comment-16789679 ] Ben Roling commented on HADOOP-15625: - [~ste...@apache.org], [~gabor.bota] - any th

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787986#comment-16787986 ] Ben Roling commented on HADOOP-15625: - Thanks [~gabor.bota].  I was about to try th

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786878#comment-16786878 ] Ben Roling commented on HADOOP-15625: - [~ste...@apache.org] it looks like the build

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785888#comment-16785888 ] Ben Roling commented on HADOOP-15625: - {quote} java.lang.AssertionError: java.net.M

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-15625: Attachment: HADOOP-15625-015.patch > S3A input stream to use etags to detect changed source files

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785220#comment-16785220 ] Ben Roling commented on HADOOP-15625: - Thanks for the review Steve! Your amendment

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781915#comment-16781915 ] Ben Roling commented on HADOOP-15625: - On another tangent, something I noticed is t

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781824#comment-16781824 ] Ben Roling commented on HADOOP-15625: - bq. BTW, looking @ amazon snowball docs. The

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779863#comment-16779863 ] Ben Roling commented on HADOOP-15625: - Patch 012 fixes failure in hadoop.conf.TestC

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-15625: Attachment: HADOOP-15625-012.patch > S3A input stream to use etags to detect changed source files

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-15625: Attachment: HADOOP-15625-011.patch > S3A input stream to use etags to detect changed source files

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779750#comment-16779750 ] Ben Roling commented on HADOOP-15625: - 011 patch addresses "The patch has 13 line(s

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779741#comment-16779741 ] Ben Roling commented on HADOOP-15625: - bq. sorry, I must have meant core-default.xm

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779740#comment-16779740 ] Ben Roling commented on HADOOP-15625: - 010 patch addresses noisy warning logging.

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-15625: Attachment: HADOOP-15625-010.patch > S3A input stream to use etags to detect changed source files

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779674#comment-16779674 ] Ben Roling commented on HADOOP-15625: - 009 patch uploaded fixes line length, javado

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-15625: Attachment: HADOOP-15625-009.patch > S3A input stream to use etags to detect changed source files

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779534#comment-16779534 ] Ben Roling commented on HADOOP-15625: - I've uploaded a new patch: * added configs t

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-15625: Attachment: HADOOP-15625-008.patch > S3A input stream to use etags to detect changed source files

[jira] [Comment Edited] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16778676#comment-16778676 ] Ben Roling edited comment on HADOOP-15625 at 2/26/19 11:13 PM: --

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16778676#comment-16778676 ] Ben Roling commented on HADOOP-15625: - I got wrapped up in some other things so did

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-15625: Attachment: HADOOP-15625-007.patch > S3A input stream to use etags to detect changed source files

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16778565#comment-16778565 ] Ben Roling commented on HADOOP-15625: - [~ste...@apache.org] - something I noticed w

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16778532#comment-16778532 ] Ben Roling commented on HADOOP-15625: - bq. which means that you may open an object

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16778019#comment-16778019 ] Ben Roling commented on HADOOP-15625: - Thanks for your help and improvements on thi

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16777268#comment-16777268 ] Ben Roling commented on HADOOP-15625: - New patch uploaded to make a minor variable

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-15625: Attachment: HADOOP-15625-006.patch > S3A input stream to use etags to detect changed source files

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775662#comment-16775662 ] Ben Roling commented on HADOOP-15625: - [~ste...@apache.org] I've uploaded a new pat

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-15625: Attachment: HADOOP-15625-005.patch > S3A input stream to use etags to detect changed source files

[jira] [Comment Edited] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775662#comment-16775662 ] Ben Roling edited comment on HADOOP-15625 at 2/22/19 10:42 PM: --

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-15625: Attachment: HADOOP-15625-004.patch > S3A input stream to use etags to detect changed source files

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775311#comment-16775311 ] Ben Roling commented on HADOOP-15625: - Sorry, [~noslowerdna] clarified for me that

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775306#comment-16775306 ] Ben Roling commented on HADOOP-15625: - bq. How about you make the exception a PathI

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773081#comment-16773081 ] Ben Roling commented on HADOOP-15625: - Thanks Steve. I'll implement the configurat

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16771969#comment-16771969 ] Ben Roling commented on HADOOP-15625: - bq. although I wouldn't expect it to be seen

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16771359#comment-16771359 ] Ben Roling commented on HADOOP-15625: - Thanks [~ste...@apache.org].  I'm not taking

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769624#comment-16769624 ] Ben Roling commented on HADOOP-15625: - Hey [~ste...@apache.org] - just wanted to ch

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16767530#comment-16767530 ] Ben Roling commented on HADOOP-15625: - {quote}I'd like to have this fail with some

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16767309#comment-16767309 ] Ben Roling commented on HADOOP-15625: - {quote}With the way the code is structured n

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16767306#comment-16767306 ] Ben Roling commented on HADOOP-15625: - Thanks for the feedback Steve! It does look

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765489#comment-16765489 ] Ben Roling commented on HADOOP-16085: - I commented on HADOOP-15625: https://issues

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765486#comment-16765486 ] Ben Roling commented on HADOOP-15625: - Hmm, it seems like I cannot upload a patch t

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765485#comment-16765485 ] Ben Roling commented on HADOOP-15625: - I've got a patch that modifies only S3AInput

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16763676#comment-16763676 ] Ben Roling commented on HADOOP-16085: - Thanks for the feedback [~ste...@apache.org]

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16763130#comment-16763130 ] Ben Roling commented on HADOOP-16085: - I've uploaded a new patch based on trunk and

[jira] [Updated] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-16085: Attachment: HADOOP-16085_002.patch > S3Guard: use object version to protect against inconsistent

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758741#comment-16758741 ] Ben Roling commented on HADOOP-16085: - Oh, I see.  For us overwrites would be rare

[jira] [Comment Edited] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758719#comment-16758719 ] Ben Roling edited comment on HADOOP-16085 at 2/1/19 10:21 PM: ---

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758719#comment-16758719 ] Ben Roling commented on HADOOP-16085: - Thanks for keeping the feedback coming!  

[jira] [Comment Edited] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758479#comment-16758479 ] Ben Roling edited comment on HADOOP-16085 at 2/1/19 4:35 PM:

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758479#comment-16758479 ] Ben Roling commented on HADOOP-16085: - I've attached my first version of the patch.

[jira] [Updated] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-16085: Attachment: HADOOP-16085_3.2.0_001.patch > S3Guard: use object version to protect against inconsi

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758432#comment-16758432 ] Ben Roling commented on HADOOP-16085: - Thanks for the thoughts [~fabbri].  I have a

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756508#comment-16756508 ] Ben Roling commented on HADOOP-16085: - Thanks for the feedback.  I've went ahead an

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16755292#comment-16755292 ] Ben Roling commented on HADOOP-16085: - [~gabor.bota] thanks for the response.  You

[jira] [Created] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

Ben Roling created HADOOP-16085: --- Summary: S3Guard: use object version to protect against inconsistent read after replace/overwrite Key: HADOOP-16085 URL: https://issues.apache.org/jira/browse/HADOOP-16085

[jira] [Updated] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Roling updated HADOOP-16085: Component/s: fs/s3 > S3Guard: use object version to protect against inconsistent read after > re

[jira] [Commented] (HADOOP-10015) UserGroupInformation prints out excessive ERROR warnings

[ https://issues.apache.org/jira/browse/HADOOP-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16090304#comment-16090304 ] Ben Roling commented on HADOOP-10015: - Just as a note for convenience to users of Cl

[jira] [Commented] (HADOOP-7154) Should set MALLOC_ARENA_MAX in hadoop-config.sh

[ https://issues.apache.org/jira/browse/HADOOP-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244166#comment-14244166 ] Ben Roling commented on HADOOP-7154: Thanks for the confirmation Todd! > Should set

[jira] [Commented] (HADOOP-7154) Should set MALLOC_ARENA_MAX in hadoop-config.sh

[ https://issues.apache.org/jira/browse/HADOOP-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238591#comment-14238591 ] Ben Roling commented on HADOOP-7154: Ok, so after further consideration I think my la

[jira] [Commented] (HADOOP-7154) Should set MALLOC_ARENA_MAX in hadoop-config.sh

[ https://issues.apache.org/jira/browse/HADOOP-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14230532#comment-14230532 ] Ben Roling commented on HADOOP-7154: [~tlipcon] - I know this bug is pretty old, but