[jira] [Comment Edited] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?
[
https://issues.apache.org/jira/browse/HADOOP-18168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510511#comment-17510511
]
Daniel Carl Jones edited comment on HADOOP-18168 at 3/22/22, 4:42 PM:
--
Current content of the landsat-pds bucket (2022-03-22 14:00).
{noformat}
❯ aws s3 ls s3://landsat-pds/
2016-08-19 18:12:04 105 robots.txt
2018-08-29 01:45:15 45603307 scene_list.gz{noformat}
Looks like _scene_list.gz_ is retained. However, ITestMarkerTool is relying on
assumptions about the bucket's contents (large number of objects).
was (Author: JIRAUSER284792):
Current content of the landsat-pds bucket (2022-03-22 14:00).
{noformat}
❯ aws s3 ls s3://landsat-pds/
2016-08-19 18:12:04 105 robots.txt
2018-08-29 01:45:15 45603307 scene_list.gz{noformat}
> ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?
> --
>
> Key: HADOOP-18168
> URL: https://issues.apache.org/jira/browse/HADOOP-18168
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3, test
>Affects Versions: 3.3.3
>Reporter: Steve Loughran
>Priority: Minor
>
> {{ITestMarkerTool.testRunLimitedLandsatAudit}} is failing -a scan which was
> meant to stop after the first page of results is finishing because there
> aren't so many objects there.
>
> first visible sign of the landsat-pds cleanup
> now we have requester pays, we could do this against another store with
> stability promises, e.g common crawl.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?
[
https://issues.apache.org/jira/browse/HADOOP-18168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510511#comment-17510511
]
Daniel Carl Jones edited comment on HADOOP-18168 at 3/22/22, 4:17 PM:
--
Current content of the landsat-pds bucket (2022-03-22 14:00).
{noformat}
❯ aws s3 ls s3://landsat-pds/
2016-08-19 18:12:04 105 robots.txt
2018-08-29 01:45:15 45603307 scene_list.gz{noformat}
was (Author: JIRAUSER284792):
Bucket definitely looks empty right now (2022-03-22 14:00).
{noformat}
❯ aws s3 ls s3://landsat-pds/
2016-08-19 18:12:04 105 robots.txt
2018-08-29 01:45:15 45603307 scene_list.gz{noformat}
> ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?
> --
>
> Key: HADOOP-18168
> URL: https://issues.apache.org/jira/browse/HADOOP-18168
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3, test
>Affects Versions: 3.3.3
>Reporter: Steve Loughran
>Priority: Minor
>
> {{ITestMarkerTool.testRunLimitedLandsatAudit}} is failing -a scan which was
> meant to stop after the first page of results is finishing because there
> aren't so many objects there.
>
> first visible sign of the landsat-pds cleanup
> now we have requester pays, we could do this against another store with
> stability promises, e.g common crawl.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
