[ https://issues.apache.org/jira/browse/HDFS-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939563#comment-15939563 ]
Anu Engineer commented on HDFS-11569: ------------------------------------- I am worried that we will need to support pagination. Here is the back of envelop calculation. If we assume users are putting 4 KB sized objects into ozone and our containers are 5GB in size, then we can have 5GB/4KB objects in a container, which is 1,250,000. That surely cannot be returned via single RPC call. Now I do see that you have a filter called "prefix", but then again user may not know how many keys with that prefix exists and may not be able to deal with the list without pagination. > Ozone: Implement listKey function for KeyManager > ------------------------------------------------ > > Key: HDFS-11569 > URL: https://issues.apache.org/jira/browse/HDFS-11569 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone > Reporter: Weiwei Yang > Assignee: Weiwei Yang > > List keys by prefix from a container. This doesn't need to support pagination > as keys in a single container should be containable. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org