[jira] [Commented] (HADOOP-16878) FileUtil.copy() to throw IOException if the source and destination are the same

2021-05-27 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17352444#comment-17352444 ] Gabor Bota commented on HADOOP-16878: - I think fixing the broken functionality woul

[jira] [Created] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-17454: --- Summary: [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0 Key: HADOOP-17454 URL: https://issues.apache.org/jira/browse/HADOOP-17454 Project: Hadoop C

[jira] [Updated] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-17454: Affects Version/s: 3.3.0 > [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0 >

[jira] [Commented] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258817#comment-17258817 ] Gabor Bota commented on HADOOP-17454: - cc [~ste...@apache.org] > [s3a] Disable buc

[jira] [Updated] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-17454: Release Note: S3A bucket existence check is disabled (fs.s3a.bucket.probe is 0), so there will be

[jira] [Assigned] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16995: --- Assignee: Gabor Bota (was: Mukund Thakur) > ITestS3AConfiguration proxy tests fail when b

[jira] [Work started] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16995 started by Gabor Bota. --- > ITestS3AConfiguration proxy tests fail when bucket probes == 0 > -

[jira] [Updated] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-17454: Description: Set the value of fs.s3a.bucket.probe to 0 by default. Bucket existence checks are do

[jira] [Work started] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17454 started by Gabor Bota. --- > [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0 >

[jira] [Updated] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16995: Priority: Major (was: Minor) > ITestS3AConfiguration proxy tests fail when bucket probes == 0 >

[jira] [Commented] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258860#comment-17258860 ] Gabor Bota commented on HADOOP-17454: - https://github.com/apache/hadoop/pull/2593

[jira] [Commented] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258861#comment-17258861 ] Gabor Bota commented on HADOOP-16995: - https://github.com/apache/hadoop/pull/2593

[jira] [Created] (HADOOP-17455) [s3a] Intermittent failure of ITestS3ADeleteCost.testDeleteSingleFileInDir

2021-01-05 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-17455: --- Summary: [s3a] Intermittent failure of ITestS3ADeleteCost.testDeleteSingleFileInDir Key: HADOOP-17455 URL: https://issues.apache.org/jira/browse/HADOOP-17455 Project: H

[jira] [Resolved] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-17454. - Resolution: Fixed got +1 from Steve on PR, committed to trunk > [s3a] Disable bucket existence

[jira] [Resolved] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16995. - Resolution: Fixed got +1 from Steve on the PR, committed to trunk > ITestS3AConfiguration pro

[jira] [Commented] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-01-16 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743988#comment-16743988 ] Gabor Bota commented on HADOOP-15999: - [~ste...@apache.org] so the order would be t

[jira] [Assigned] (HADOOP-16057) IndexOutOfBoundsException in ITestS3GuardToolLocal

2019-01-18 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16057: --- Assignee: Adam Antal (was: Gabor Bota) > IndexOutOfBoundsException in ITestS3GuardToolLoc

[jira] [Assigned] (HADOOP-16057) IndexOutOfBoundsException in ITestS3GuardToolLocal

2019-01-18 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16057: --- Assignee: Gabor Bota (was: Adam Antal) > IndexOutOfBoundsException in ITestS3GuardToolLoc

[jira] [Commented] (HADOOP-16057) IndexOutOfBoundsException in ITestS3GuardToolLocal

2019-01-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16747827#comment-16747827 ] Gabor Bota commented on HADOOP-16057: - It's connected, as the causes of these issue

[jira] [Commented] (HADOOP-16057) IndexOutOfBoundsException in ITestS3GuardToolLocal

2019-01-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16747820#comment-16747820 ] Gabor Bota commented on HADOOP-16057: - while testing HADOOP-15229 I've found this a

[jira] [Comment Edited] (HADOOP-16057) IndexOutOfBoundsException in ITestS3GuardToolLocal

2019-01-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16747827#comment-16747827 ] Gabor Bota edited comment on HADOOP-16057 at 1/21/19 10:25 AM: --

[jira] [Commented] (HADOOP-16057) IndexOutOfBoundsException in ITestS3GuardToolLocal

2019-01-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16748027#comment-16748027 ] Gabor Bota commented on HADOOP-16057: - I'm +1 about rolling back that change and re

[jira] [Comment Edited] (HADOOP-16057) IndexOutOfBoundsException in ITestS3GuardToolLocal

2019-01-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16748027#comment-16748027 ] Gabor Bota edited comment on HADOOP-16057 at 1/21/19 3:33 PM: ---

[jira] [Commented] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile() + S3 Select

2019-01-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16748145#comment-16748145 ] Gabor Bota commented on HADOOP-15229: - Hey [~ste...@apache.org], thanks for working

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

2019-01-29 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16755248#comment-16755248 ] Gabor Bota commented on HADOOP-16085: - Hi [~ben.roling],  I think I know about the

[jira] [Comment Edited] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

2019-01-29 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16755248#comment-16755248 ] Gabor Bota edited comment on HADOOP-16085 at 1/29/19 6:02 PM: ---

[jira] [Comment Edited] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

2019-01-29 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16755248#comment-16755248 ] Gabor Bota edited comment on HADOOP-16085 at 1/29/19 6:06 PM: ---

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

2019-01-30 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756448#comment-16756448 ] Gabor Bota commented on HADOOP-16085: - What you've described is a different issue t

[jira] [Comment Edited] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

2019-01-30 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756448#comment-16756448 ] Gabor Bota edited comment on HADOOP-16085 at 1/30/19 7:08 PM: ---

[jira] [Comment Edited] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

2019-01-30 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756448#comment-16756448 ] Gabor Bota edited comment on HADOOP-16085 at 1/30/19 7:08 PM: ---

[jira] [Commented] (HADOOP-13980) S3Guard CLI: Add fsck check command

2019-01-31 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16757449#comment-16757449 ] Gabor Bota commented on HADOOP-13980: - I haven't started working on the feature yet

[jira] [Updated] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Attachment: HADOOP-15999.002.patch > [s3a] Better support for out-of-band operations > --

[jira] [Updated] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Attachment: (was: HADOOP-15999.002.patch) > [s3a] Better support for out-of-band operations >

[jira] [Updated] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Attachment: HADOOP-15999.002.patch > [s3a] Better support for out-of-band operations > --

[jira] [Commented] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16760516#comment-16760516 ] Gabor Bota commented on HADOOP-15999: - patch v2 itests run against Ireland successf

[jira] [Commented] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16760519#comment-16760519 ] Gabor Bota commented on HADOOP-15999: - [~ste...@apache.org] I think if we commit th

[jira] [Comment Edited] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16760516#comment-16760516 ] Gabor Bota edited comment on HADOOP-15999 at 2/5/19 7:11 AM:

[jira] [Comment Edited] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16760516#comment-16760516 ] Gabor Bota edited comment on HADOOP-15999 at 2/5/19 7:09 AM:

[jira] [Commented] (HADOOP-14576) s3guard DynamoDB resource not found: tables not ACTIVE state after initial connection

2019-02-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16761532#comment-16761532 ] Gabor Bota commented on HADOOP-14576: - I haven't seen this error yet during testing

[jira] [Assigned] (HADOOP-14576) s3guard DynamoDB resource not found: tables not ACTIVE state after initial connection

2019-02-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-14576: --- Assignee: (was: Gabor Bota) > s3guard DynamoDB resource not found: tables not ACTIVE s

[jira] [Work started] (HADOOP-13980) S3Guard CLI: Add fsck check command

2019-02-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-13980 started by Gabor Bota. --- > S3Guard CLI: Add fsck check command > --- > >

[jira] [Assigned] (HADOOP-15183) S3Guard store becomes inconsistent after partial failure of rename

2019-02-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15183: --- Assignee: Gabor Bota > S3Guard store becomes inconsistent after partial failure of rename

[jira] [Commented] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-19 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16771897#comment-16771897 ] Gabor Bota commented on HADOOP-15999: - Thanks for the review [~ste...@apache.org]!

[jira] [Updated] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-20 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Attachment: HADOOP-15999.003.patch > [s3a] Better support for out-of-band operations > --

[jira] [Updated] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-20 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Status: Open (was: Patch Available) > [s3a] Better support for out-of-band operations >

[jira] [Updated] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-20 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Status: Patch Available (was: Open) > [s3a] Better support for out-of-band operations >

[jira] [Commented] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-20 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772956#comment-16772956 ] Gabor Bota commented on HADOOP-15999: - patch v3: run against Ireland successful add

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-02-20 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15625: Attachment: HADOOP-15999.004.patch > S3A input stream to use etags to detect changed source files

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-02-20 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15625: Attachment: (was: HADOOP-15999.004.patch) > S3A input stream to use etags to detect changed s

[jira] [Updated] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-20 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Attachment: HADOOP-15999.004.patch > [s3a] Better support for out-of-band operations > --

[jira] [Commented] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-20 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773201#comment-16773201 ] Gabor Bota commented on HADOOP-15999: - Thanks [~ste...@apache.org]. This was an iss

[jira] [Updated] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Attachment: HADOOP-15999.005.patch > [s3a] Better support for out-of-band operations > --

[jira] [Commented] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773939#comment-16773939 ] Gabor Bota commented on HADOOP-15999: - In my latest patch I've added texts for all

[jira] [Updated] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Attachment: HADOOP-15999.006.patch > [s3a] Better support for out-of-band operations > --

[jira] [Commented] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774129#comment-16774129 ] Gabor Bota commented on HADOOP-15999: - uploaded v006 with the toStrings > [s3a] Be

[jira] [Work started] (HADOOP-15780) S3Guard: document how to deal with non-S3Guard processes writing data to S3Guarded buckets

2019-02-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-15780 started by Gabor Bota. --- > S3Guard: document how to deal with non-S3Guard processes writing data to > S3

[jira] [Commented] (HADOOP-15780) S3Guard: document how to deal with non-S3Guard processes writing data to S3Guarded buckets

2019-02-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774318#comment-16774318 ] Gabor Bota commented on HADOOP-15780: - Most of the work for this will be done in HA

[jira] [Updated] (HADOOP-15780) S3Guard: document how to deal with non-S3Guard processes writing data to S3Guarded buckets

2019-02-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15780: Priority: Major (was: Minor) > S3Guard: document how to deal with non-S3Guard processes writing

[jira] [Commented] (HADOOP-16132) Support multipart download in S3AFileSystem

2019-02-21 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774336#comment-16774336 ] Gabor Bota commented on HADOOP-16132: - Hi [~justin.uang]! Thanks for creating this

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-02-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779400#comment-16779400 ] Gabor Bota commented on HADOOP-15999: - Downloaded the patch and looking into the to

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-02-28 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780436#comment-16780436 ] Gabor Bota commented on HADOOP-15999: - -1 for the latest (007) patch, because 8 out

[jira] [Assigned] (HADOOP-16138) hadoop fs mkdir / of nonexistent abfs container raises NPE

2019-02-28 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16138: --- Assignee: Gabor Bota > hadoop fs mkdir / of nonexistent abfs container raises NPE > --

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-01 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781817#comment-16781817 ] Gabor Bota commented on HADOOP-15999: - Sure, here are the stacktraces: https://gi

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783633#comment-16783633 ] Gabor Bota commented on HADOOP-15999: - It was really me - so running the tests in m

[jira] [Comment Edited] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783633#comment-16783633 ] Gabor Bota edited comment on HADOOP-15999 at 3/4/19 6:39 PM:

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784294#comment-16784294 ] Gabor Bota commented on HADOOP-15999: - I figured it out: the timeout in the LocalMS

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784299#comment-16784299 ] Gabor Bota commented on HADOOP-15999: - I'm thinking about to use a {{static}} cache

[jira] [Updated] (HADOOP-16168) mvn clean site is not compiling in trunk

2019-03-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16168: Issue Type: Bug (was: Improvement) > mvn clean site is not compiling in trunk >

[jira] [Comment Edited] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784294#comment-16784294 ] Gabor Bota edited comment on HADOOP-15999 at 3/5/19 10:29 AM: ---

[jira] [Updated] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Attachment: HADOOP-15999.008.patch > S3Guard: Better support for out-of-band operations > ---

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784393#comment-16784393 ] Gabor Bota commented on HADOOP-15999: - Uploaded patch 8. Integration tests run agai

[jira] [Work started] (HADOOP-16138) hadoop fs mkdir / of nonexistent abfs container raises NPE

2019-03-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16138 started by Gabor Bota. --- > hadoop fs mkdir / of nonexistent abfs container raises NPE > -

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-03-06 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785822#comment-16785822 ] Gabor Bota commented on HADOOP-15625: - Running the itests with {{mvn clean verify -

[jira] [Comment Edited] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-03-06 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785822#comment-16785822 ] Gabor Bota edited comment on HADOOP-15625 at 3/6/19 4:22 PM:

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-03-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15625: Status: Open (was: Patch Available) > S3A input stream to use etags to detect changed source fil

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-03-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15625: Status: Patch Available (was: Open) > S3A input stream to use etags to detect changed source fil

[jira] [Assigned] (HADOOP-14936) S3Guard: remove "experimental" from documentation

2019-03-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-14936: --- Assignee: Gabor Bota > S3Guard: remove "experimental" from documentation > ---

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-03-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15625: Attachment: HADOOP-15625-015.patch > S3A input stream to use etags to detect changed source files

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-03-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787975#comment-16787975 ] Gabor Bota commented on HADOOP-15625: - Switching to in progress -> patch submitted

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-03-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789701#comment-16789701 ] Gabor Bota commented on HADOOP-15625: - Test failures seem unrelated. I'll do anothe

[jira] [Commented] (HADOOP-13327) Add OutputStream + Syncable to the Filesystem Specification

2019-03-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789697#comment-16789697 ] Gabor Bota commented on HADOOP-13327: - I did my initial review and commented on the

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-03-12 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790651#comment-16790651 ] Gabor Bota commented on HADOOP-15625: - My review on patch v15: h3. S3AInputStream.

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-12 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790695#comment-16790695 ] Gabor Bota commented on HADOOP-15625: - OK, thanks for the clarification [~ben.rolin

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-12 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790761#comment-16790761 ] Gabor Bota commented on HADOOP-15625: - Thanks [~ben.roling]. +1 from my side pendin

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-12 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790770#comment-16790770 ] Gabor Bota commented on HADOOP-15999: - fixed the ordering in patch 009. I will crea

[jira] [Updated] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-12 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Attachment: HADOOP-15999.009.patch > S3Guard: Better support for out-of-band operations > ---

[jira] [Comment Edited] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16791686#comment-16791686 ] Gabor Bota edited comment on HADOOP-15625 at 3/13/19 1:20 PM: ---

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16791686#comment-16791686 ] Gabor Bota commented on HADOOP-15625: - Thanks [~ben.roling]! I've tested the latest

[jira] [Assigned] (HADOOP-16063) Docker based pseudo-cluster definitions and test scripts for Hdfs/Yarn

2019-03-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16063: --- Assignee: Gabor Bota > Docker based pseudo-cluster definitions and test scripts for Hdfs/Y

[jira] [Assigned] (HADOOP-16092) Move the source of hadoop/ozone containers to the same repository

2019-03-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16092: --- Assignee: Gabor Bota > Move the source of hadoop/ozone containers to the same repository >

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16791892#comment-16791892 ] Gabor Bota commented on HADOOP-15999: - I get random failures/timeouts with integrat

[jira] [Created] (HADOOP-16184) S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

2019-03-13 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16184: --- Summary: S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker Key: HADOOP-16184 URL: https://issues.apache.org/jira/browse/HADOOP-16184 Pro

[jira] [Created] (HADOOP-16185) S3Guard: Optimize performance of handling OOB operations in non-authoritative mode

2019-03-13 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16185: --- Summary: S3Guard: Optimize performance of handling OOB operations in non-authoritative mode Key: HADOOP-16185 URL: https://issues.apache.org/jira/browse/HADOOP-16185 Pr

[jira] [Updated] (HADOOP-16184) S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

2019-03-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16184: Description: When a file is deleted in S3 using S3Guard a tombstone marker will be added for tha

[jira] [Assigned] (HADOOP-16186) NPE in ITestS3AFileSystemContract teardown in DynamoDBMetadataStore.lambda$listChildren

2019-03-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16186: --- Assignee: Gabor Bota > NPE in ITestS3AFileSystemContract teardown in > DynamoDBMetadataS

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792645#comment-16792645 ] Gabor Bota commented on HADOOP-15999: - verify ran successfuly against ireland.  >

[jira] [Comment Edited] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792645#comment-16792645 ] Gabor Bota edited comment on HADOOP-15999 at 3/14/19 1:34 PM: ---

[jira] [Comment Edited] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792645#comment-16792645 ] Gabor Bota edited comment on HADOOP-15999 at 3/14/19 1:34 PM: ---

[jira] [Comment Edited] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792645#comment-16792645 ] Gabor Bota edited comment on HADOOP-15999 at 3/14/19 1:44 PM: ---

[jira] [Commented] (HADOOP-16186) NPE in ITestS3AFileSystemContract teardown in DynamoDBMetadataStore.lambda$listChildren

2019-03-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792902#comment-16792902 ] Gabor Bota commented on HADOOP-16186: - {quote}There's clearly some codepath which c

  1   2   3   4   5   6   7   8   9   10   >