[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17389923#comment-17389923 ]
Stephen O'Donnell commented on HDFS-16147: ------------------------------------------ It is important that OIV can read these images. If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, is the NN still able to load it? I suspect it won't as there are multiple compressed sections, so it cannot read a single compressed stream from end to end. {quote} It can load 300M Fsimage with compression and parallelization , which can improve 50% loading time. {quote} Is the 50% improvement measured against a compressed single threaded load verses parallel compressed loading? How are the load times between "parallel not compressed " vs "parallel compressed"? > load fsimage with parallelization and compression > ------------------------------------------------- > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode > Affects Versions: 3.3.0 > Reporter: liuyongpan > Priority: Minor > Attachments: HDFS-16147.001.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org