[ https://issues.apache.org/jira/browse/LUCENE-4283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Han Jiang updated LUCENE-4283: ------------------------------ Attachment: LUCENE-4283-small-interval-partially.patch LUCENE-4283-small-interval-fully.patch Two patches: tidied some codes, and removed the partially decoding out to see how we improved only with smaller interval. *-fully.patch will refill a whole block of docs when docBuffer is used up, *-partially.patch will only decode an interval of block when necessary. > Support more frequent skip with Block Postings Format > ----------------------------------------------------- > > Key: LUCENE-4283 > URL: https://issues.apache.org/jira/browse/LUCENE-4283 > Project: Lucene - Core > Issue Type: Improvement > Reporter: Han Jiang > Priority: Minor > Attachments: LUCENE-4283-buggy.patch, LUCENE-4283-buggy.patch, > LUCENE-4283-slow.patch, LUCENE-4283-small-interval-fully.patch, > LUCENE-4283-small-interval-partially.patch > > > This change works on the new bulk branch. > Currently, our BlockPostingsFormat only supports skipInterval==blockSize. > Every time the skipper reaches the last level 0 skip point, we'll have to > decode a whole block to read doc/freq data. Also, a higher level skip list > will be created only for those df>blockSize^k, which means for most terms, > skipping will just be a linear scan. If we increase current blockSize for > better bulk i/o performance, current skip setting will be a bottleneck. > For ForPF, the encoded block can be easily splitted if we set > skipInterval=32*k. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org