[jira] [Commented] (HADOOP-18384) ITestS3AFileSystemStatistic failure in prefetch feature branch

2023-07-14 Thread Steve Loughran (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17743232#comment-17743232
 ] 

Steve Loughran commented on HADOOP-18384:
-

not seen for a while

> ITestS3AFileSystemStatistic failure in prefetch feature branch
> --
>
> Key: HADOOP-18384
> URL: https://issues.apache.org/jira/browse/HADOOP-18384
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: fs/s3, test
>Affects Versions: 3.4.0
>Reporter: Steve Loughran
>Assignee: Samrat Deb
>Priority: Minor
>
> testing the rebased prefetch feature branch; got a failure in 
> ITestS3AFileSystemStatistic
>  
> {code}
> tics.ITestS3AFileSystemStatistic
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.489 
> s <<< FAILURE! - in 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic
> [ERROR] 
> testBytesReadWithStream(org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic)
>   Time elapsed: 1.489 s  <<< FAILURE!
> java.lang.AssertionError: Mismatch in number of FS bytes read by InputStreams 
> expected:<2048> but was:<69537130>
> at 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic.testBytesReadWithStream(ITestS3AFileSystemStatistic.java:72)
> {code}
> that;s 64MB + ~237 kb, the kind of values you would get from prefetching
> but, prefetch was disabled in this test run.
> maybe its just the fs stats aren't being reset between test cases



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-18384) ITestS3AFileSystemStatistic failure in prefetch feature branch

2022-08-18 Thread Steve Loughran (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581480#comment-17581480
 ] 

Steve Loughran commented on HADOOP-18384:
-

yes, target trunk for changes

> ITestS3AFileSystemStatistic failure in prefetch feature branch
> --
>
> Key: HADOOP-18384
> URL: https://issues.apache.org/jira/browse/HADOOP-18384
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: fs/s3, test
>Reporter: Steve Loughran
>Assignee: Samrat Deb
>Priority: Major
>
> testing the rebased prefetch feature branch; got a failure in 
> ITestS3AFileSystemStatistic
>  
> {code}
> tics.ITestS3AFileSystemStatistic
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.489 
> s <<< FAILURE! - in 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic
> [ERROR] 
> testBytesReadWithStream(org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic)
>   Time elapsed: 1.489 s  <<< FAILURE!
> java.lang.AssertionError: Mismatch in number of FS bytes read by InputStreams 
> expected:<2048> but was:<69537130>
> at 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic.testBytesReadWithStream(ITestS3AFileSystemStatistic.java:72)
> {code}
> that;s 64MB + ~237 kb, the kind of values you would get from prefetching
> but, prefetch was disabled in this test run.
> maybe its just the fs stats aren't being reset between test cases



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-18384) ITestS3AFileSystemStatistic failure in prefetch feature branch

2022-08-18 Thread Samrat Deb (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581477#comment-17581477
 ] 

Samrat Deb commented on HADOOP-18384:
-

hi [~ste...@apache.org] 
greetings ! 

checked your branch got merged to trunk ! Is it good now for me to work on this 
test case ?
i will try to fix this test error ! 

> ITestS3AFileSystemStatistic failure in prefetch feature branch
> --
>
> Key: HADOOP-18384
> URL: https://issues.apache.org/jira/browse/HADOOP-18384
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: fs/s3, test
>Reporter: Steve Loughran
>Assignee: Samrat Deb
>Priority: Major
>
> testing the rebased prefetch feature branch; got a failure in 
> ITestS3AFileSystemStatistic
>  
> {code}
> tics.ITestS3AFileSystemStatistic
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.489 
> s <<< FAILURE! - in 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic
> [ERROR] 
> testBytesReadWithStream(org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic)
>   Time elapsed: 1.489 s  <<< FAILURE!
> java.lang.AssertionError: Mismatch in number of FS bytes read by InputStreams 
> expected:<2048> but was:<69537130>
> at 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic.testBytesReadWithStream(ITestS3AFileSystemStatistic.java:72)
> {code}
> that;s 64MB + ~237 kb, the kind of values you would get from prefetching
> but, prefetch was disabled in this test run.
> maybe its just the fs stats aren't being reset between test cases



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-18384) ITestS3AFileSystemStatistic failure in prefetch feature branch

2022-08-15 Thread Steve Loughran (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17579622#comment-17579622
 ] 

Steve Loughran commented on HADOOP-18384:
-


Go ahead, but know i've locked down the branch until i can get it into trunk.

i want to get my last changes (with class renames and moves) in, then apply the 
whole branch to trunk as one single patch...after which all changes can be 
there. no more rebasing, merge pain shared by all

> ITestS3AFileSystemStatistic failure in prefetch feature branch
> --
>
> Key: HADOOP-18384
> URL: https://issues.apache.org/jira/browse/HADOOP-18384
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: fs/s3, test
>Reporter: Steve Loughran
>Priority: Major
>
> testing the rebased prefetch feature branch; got a failure in 
> ITestS3AFileSystemStatistic
>  
> {code}
> tics.ITestS3AFileSystemStatistic
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.489 
> s <<< FAILURE! - in 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic
> [ERROR] 
> testBytesReadWithStream(org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic)
>   Time elapsed: 1.489 s  <<< FAILURE!
> java.lang.AssertionError: Mismatch in number of FS bytes read by InputStreams 
> expected:<2048> but was:<69537130>
> at 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic.testBytesReadWithStream(ITestS3AFileSystemStatistic.java:72)
> {code}
> that;s 64MB + ~237 kb, the kind of values you would get from prefetching
> but, prefetch was disabled in this test run.
> maybe its just the fs stats aren't being reset between test cases



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-18384) ITestS3AFileSystemStatistic failure in prefetch feature branch

2022-08-14 Thread Samrat Deb (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17579443#comment-17579443
 ] 

Samrat Deb commented on HADOOP-18384:
-

Hi [~ste...@apache.org] , 
can i please pick this task and try to fix the failure ?

> ITestS3AFileSystemStatistic failure in prefetch feature branch
> --
>
> Key: HADOOP-18384
> URL: https://issues.apache.org/jira/browse/HADOOP-18384
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: fs/s3, test
>Reporter: Steve Loughran
>Priority: Major
>
> testing the rebased prefetch feature branch; got a failure in 
> ITestS3AFileSystemStatistic
>  
> {code}
> tics.ITestS3AFileSystemStatistic
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.489 
> s <<< FAILURE! - in 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic
> [ERROR] 
> testBytesReadWithStream(org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic)
>   Time elapsed: 1.489 s  <<< FAILURE!
> java.lang.AssertionError: Mismatch in number of FS bytes read by InputStreams 
> expected:<2048> but was:<69537130>
> at 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic.testBytesReadWithStream(ITestS3AFileSystemStatistic.java:72)
> {code}
> that;s 64MB + ~237 kb, the kind of values you would get from prefetching
> but, prefetch was disabled in this test run.
> maybe its just the fs stats aren't being reset between test cases



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-18384) ITestS3AFileSystemStatistic failure in prefetch feature branch

2022-08-02 Thread Steve Loughran (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574327#comment-17574327
 ] 

Steve Loughran commented on HADOOP-18384:
-

transient; think it is a filesystem recycling issue where before/after values 
should be checked. however, we would expect a mismatch if the prefetch stream 
was actually enabled.

> ITestS3AFileSystemStatistic failure in prefetch feature branch
> --
>
> Key: HADOOP-18384
> URL: https://issues.apache.org/jira/browse/HADOOP-18384
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: fs/s3, test
>Reporter: Steve Loughran
>Priority: Major
>
> testing the rebased prefetch feature branch; got a failure in 
> ITestS3AFileSystemStatistic
>  
> {code}
> tics.ITestS3AFileSystemStatistic
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.489 
> s <<< FAILURE! - in 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic
> [ERROR] 
> testBytesReadWithStream(org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic)
>   Time elapsed: 1.489 s  <<< FAILURE!
> java.lang.AssertionError: Mismatch in number of FS bytes read by InputStreams 
> expected:<2048> but was:<69537130>
> at 
> org.apache.hadoop.fs.s3a.statistics.ITestS3AFileSystemStatistic.testBytesReadWithStream(ITestS3AFileSystemStatistic.java:72)
> {code}
> that;s 64MB + ~237 kb, the kind of values you would get from prefetching
> but, prefetch was disabled in this test run.
> maybe its just the fs stats aren't being reset between test cases



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org