[ https://issues.apache.org/jira/browse/LUCENE-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398582#comment-13398582 ]
Han Jiang edited comment on LUCENE-3892 at 6/21/12 5:01 PM: ------------------------------------------------------------ Now remove the memory write codes, and replace IntBuffer.get() with getInt(byte,byte,byte,byte), since this patch contains method unfolding, there is no actually difference...Seems that we're paying attenting on a wrong point. {noformat} Task QPS Base StdDev Base QPS For StdDev For Pct diff Phrase 5.02 0.46 3.66 0.30 -38% - -13% (-38% - -17%) AndHighMed 28.08 2.29 23.04 1.01 -27% - -6% (-29% - -12%) SpanNear 2.69 0.16 2.30 0.19 -25% - 0% (-26% - -8%) SloppyPhrase 4.18 0.22 3.83 0.18 -16% - 1% (-21% - -3%) Respell 41.92 2.15 39.54 2.45 -15% - 5% (-16% - 2%) Fuzzy1 44.47 1.99 43.34 3.07 -13% - 9% (-10% - 0%) Wildcard 19.70 1.06 19.60 1.16 -11% - 11% ( -8% - 8%) Fuzzy2 16.54 0.86 16.52 1.16 -11% - 12% (-10% - 3%) PKLookup 87.32 2.47 88.62 1.33 -2% - 6% ( -5% - 8%) AndHighHigh 7.55 0.43 7.84 0.15 -3% - 12% ( -7% - 8%) TermBGroup1M 19.86 0.14 21.41 0.70 3% - 12% ( -3% - 12%) TermGroup1M 13.35 0.17 14.40 0.38 3% - 12% ( 2% - 13%) IntNRQ 4.10 0.57 4.45 0.73 -20% - 46% ( -7% - 50%) TermBGroup1M1P 21.29 0.63 23.45 0.82 3% - 17% ( 6% - 20%) Prefix3 31.13 1.71 35.53 2.90 0% - 30% ( 5% - 27%) OrHighMed 4.96 0.61 5.83 0.35 -1% - 42% ( -9% - 23%) OrHighHigh 4.13 0.49 4.87 0.29 0% - 41% ( -8% - 23%) Term 42.93 1.17 52.11 2.21 13% - 30% ( 13% - 35%) {noformat} It is compared with result in https://issues.apache.org/jira/browse/LUCENE-3892?focusedCommentId=13396987&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13396987 was (Author: billy): Now remove the memory write codes, and replace IntBuffer.get() with getInt(byte,byte,byte,byte), since this patch contains method unfolding, there is no actually difference...Seems that we're paying attenting on a wrong point. {noformat} Task QPS Base StdDev Base QPS For StdDev For Pct diff Phrase 5.02 0.46 3.66 0.30 -38% - -13% AndHighMed 28.08 2.29 23.04 1.01 -27% - -6% SpanNear 2.69 0.16 2.30 0.19 -25% - 0% SloppyPhrase 4.18 0.22 3.83 0.18 -16% - 1% Respell 41.92 2.15 39.54 2.45 -15% - 5% Fuzzy1 44.47 1.99 43.34 3.07 -13% - 9% Wildcard 19.70 1.06 19.60 1.16 -11% - 11% Fuzzy2 16.54 0.86 16.52 1.16 -11% - 12% PKLookup 87.32 2.47 88.62 1.33 -2% - 6% AndHighHigh 7.55 0.43 7.84 0.15 -3% - 12% TermBGroup1M 19.86 0.14 21.41 0.70 3% - 12% TermGroup1M 13.35 0.17 14.40 0.38 3% - 12% IntNRQ 4.10 0.57 4.45 0.73 -20% - 46% TermBGroup1M1P 21.29 0.63 23.45 0.82 3% - 17% Prefix3 31.13 1.71 35.53 2.90 0% - 30% OrHighMed 4.96 0.61 5.83 0.35 -1% - 42% OrHighHigh 4.13 0.49 4.87 0.29 0% - 41% Term 42.93 1.17 52.11 2.21 13% - 30% {noformat} > Add a useful intblock postings format (eg, FOR, PFOR, PFORDelta, > Simple9/16/64, etc.) > ------------------------------------------------------------------------------------- > > Key: LUCENE-3892 > URL: https://issues.apache.org/jira/browse/LUCENE-3892 > Project: Lucene - Java > Issue Type: Improvement > Reporter: Michael McCandless > Labels: gsoc2012, lucene-gsoc-12 > Fix For: 4.1 > > Attachments: LUCENE-3892-direct-IntBuffer.patch, > LUCENE-3892_for.patch, LUCENE-3892_for_byte[].patch, > LUCENE-3892_for_int[].patch, LUCENE-3892_for_unfold_method.patch, > LUCENE-3892_pfor.patch, LUCENE-3892_pfor.patch, LUCENE-3892_pfor.patch, > LUCENE-3892_pfor_unfold_method.patch, LUCENE-3892_settings.patch, > LUCENE-3892_settings.patch > > > On the flex branch we explored a number of possible intblock > encodings, but for whatever reason never brought them to completion. > There are still a number of issues opened with patches in different > states. > Initial results (based on prototype) were excellent (see > http://blog.mikemccandless.com/2010/08/lucene-performance-with-pfordelta-codec.html > ). > I think this would make a good GSoC project. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org