[jira] Commented: (LUCENE-1410) PFOR implementation

2010-04-02 Thread Renaud Delbru (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12852855#action_12852855 ] Renaud Delbru commented on LUCENE-1410: --- Here some results on the perofrmance of

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-04-02 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12852868#action_12852868 ] Michael McCandless commented on LUCENE-1410: Thanks for sharing these thorough

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-04-02 Thread Renaud Delbru (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12852885#action_12852885 ] Renaud Delbru commented on LUCENE-1410: --- {quote} Curious that PFOR/FOR don't do well

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-04-02 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12852924#action_12852924 ] Paul Elschot commented on LUCENE-1410: -- I think the mixed performance results for

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-04-02 Thread Renaud Delbru (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12852930#action_12852930 ] Renaud Delbru commented on LUCENE-1410: --- {quote} The fact that S9 is already doing

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-04-02 Thread Renaud Delbru (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12852933#action_12852933 ] Renaud Delbru commented on LUCENE-1410: --- Just an update, I just executed the same

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-02-28 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12839509#action_12839509 ] Paul Elschot commented on LUCENE-1410: -- bq. I thought that removing the IntBuffer and

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-02-23 Thread Renaud Delbru (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12837231#action_12837231 ] Renaud Delbru commented on LUCENE-1410: --- I am reporting here some experiments I

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-02-15 Thread Renaud Delbru (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12833872#action_12833872 ] Renaud Delbru commented on LUCENE-1410: --- When performing some tests on PFOR, I have

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-02-15 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12833895#action_12833895 ] Paul Elschot commented on LUCENE-1410: -- That might indeed be a bug. In general the

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-02-15 Thread Renaud Delbru (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12833922#action_12833922 ] Renaud Delbru commented on LUCENE-1410: --- {quote} In general the

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-02-15 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12833952#action_12833952 ] Paul Elschot commented on LUCENE-1410: -- bq. Why not just computing the index (in the

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-24 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12804209#action_12804209 ] Michael McCandless commented on LUCENE-1410: bq. So why not encode the

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-24 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12804227#action_12804227 ] Paul Elschot commented on LUCENE-1410: -- I opened LUCENE-2232 to use VShort for

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-23 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12804127#action_12804127 ] Paul Elschot commented on LUCENE-1410: -- Zhang, 2008, see above, reports this: {quote}

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-21 Thread Renaud Delbru (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12803272#action_12803272 ] Renaud Delbru commented on LUCENE-1410: --- {quote} The only concern I have is that the

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-21 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12803376#action_12803376 ] Paul Elschot commented on LUCENE-1410: -- There is a margin indeed, but it depends on

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-19 Thread Renaud Delbru (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12802235#action_12802235 ] Renaud Delbru commented on LUCENE-1410: --- On another aspect, why is the PFOR/FOR is

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-19 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12802335#action_12802335 ] Paul Elschot commented on LUCENE-1410: -- The only reason why the number of compressed

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-18 Thread Renaud Delbru (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12801813#action_12801813 ] Renaud Delbru commented on LUCENE-1410: --- Hi, I have performed some benchmarks using

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-18 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12801905#action_12801905 ] Paul Elschot commented on LUCENE-1410: -- Did you see any effect of the JIT? This is

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-18 Thread Renaud Delbru (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12801918#action_12801918 ] Renaud Delbru commented on LUCENE-1410: --- {quote} Did you see any effect of the JIT?

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-18 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12801934#action_12801934 ] Paul Elschot commented on LUCENE-1410: -- {quote} In the first benchmark, I was not

[jira] Commented: (LUCENE-1410) PFOR implementation

2010-01-03 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12796107#action_12796107 ] Paul Elschot commented on LUCENE-1410: -- To encode the exceptions as suggested by

[jira] Commented: (LUCENE-1410) PFOR implementation

2009-10-06 Thread Eks Dev (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12762742#action_12762742 ] Eks Dev commented on LUCENE-1410: - Mike, That is definitely the way to go, distribution

Re: [jira] Commented: (LUCENE-1410) PFOR implementation

2009-10-06 Thread Paul Elschot
Eks, [ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12762742#action_12762742 ] Eks Dev commented on LUCENE-1410: - Mike, That is definitely the way to

Re: [jira] Commented: (LUCENE-1410) PFOR implementation

2009-10-06 Thread eks dev
October, 2009 23:33:03 Subject: Re: [jira] Commented: (LUCENE-1410) PFOR implementation Eks, [ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12762742#action_12762742 ] Eks Dev commented on LUCENE

Re: [jira] Commented: (LUCENE-1410) PFOR implementation

2009-10-06 Thread eks dev
-dev@lucene.apache.org Sent: Tuesday, 6 October, 2009 23:59:12 Subject: Re: [jira] Commented: (LUCENE-1410) PFOR implementation Paul, the point I was trying to make with this example was extreme, but realistic. Imagine 100Mio docs, sorted on field user_rights, a term user_rights:XX selects 40Mio

Re: [jira] Commented: (LUCENE-1410) PFOR implementation

2009-10-06 Thread Paul Elschot
: Re: [jira] Commented: (LUCENE-1410) PFOR implementation Eks, [ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12762742#action_12762742 ] Eks Dev commented on LUCENE-1410

[jira] Commented: (LUCENE-1410) PFOR implementation

2009-05-12 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12708590#action_12708590 ] Paul Elschot commented on LUCENE-1410: -- A very recent paper with some improvements to

[jira] Commented: (LUCENE-1410) PFOR implementation

2009-03-23 Thread Eks Dev (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12688284#action_12688284 ] Eks Dev commented on LUCENE-1410: - It looks like Google went there as well (Block

[jira] Commented: (LUCENE-1410) PFOR implementation

2009-03-23 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12688409#action_12688409 ] Paul Elschot commented on LUCENE-1410: -- The encoding in the google research slides is

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-12-16 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12656988#action_12656988 ] Paul Elschot commented on LUCENE-1410: -- I'd like to split off the performance test

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-11-08 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12645973#action_12645973 ] Paul Elschot commented on LUCENE-1410: -- I've been at this quite irregularly. I'm

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-12 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1263#action_1263 ] Michael McCandless commented on LUCENE-1410: bq. It should really make a

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-12 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12638900#action_12638900 ] Paul Elschot commented on LUCENE-1410: -- So there's roughly a factor 2 between PFOR

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-11 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12638744#action_12638744 ] Paul Elschot commented on LUCENE-1410: -- bq. I'm trying now to get a rudimentary test

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-11 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12638788#action_12638788 ] Paul Elschot commented on LUCENE-1410: -- The strange behaviour at 9 bits I reported

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-10 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12638543#action_12638543 ] Michael McCandless commented on LUCENE-1410: Paul, in decompress I added

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-10 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12638564#action_12638564 ] Paul Elschot commented on LUCENE-1410: -- Did you also move to relative addressing in

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-10 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12638573#action_12638573 ] Michael McCandless commented on LUCENE-1410: Another thing that bit me was

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12637427#action_12637427 ] Michael McCandless commented on LUCENE-1410: bq. That means there is quite a

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-06 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12637149#action_12637149 ] Paul Elschot commented on LUCENE-1410: -- I can't see the .tgz attachment at the

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-06 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12637154#action_12637154 ] Michael McCandless commented on LUCENE-1410: bq. One detail on the generated

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-06 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12637163#action_12637163 ] Paul Elschot commented on LUCENE-1410: -- bq. Did you also switch to relative getInts?

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-06 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12637191#action_12637191 ] Michael McCandless commented on LUCENE-1410: bq. The only concern I have

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-06 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12637272#action_12637272 ] Paul Elschot commented on LUCENE-1410: -- bq. Or... is this because a full block

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-04 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636799#action_12636799 ] Michael McCandless commented on LUCENE-1410: bq. As for decompression speed,

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-04 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636803#action_12636803 ] Paul Elschot commented on LUCENE-1410: -- I'm working on the 10 right now, but I'm

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-03 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636658#action_12636658 ] Paul Elschot commented on LUCENE-1410: -- Q: Can you add a method that figures out the

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-03 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636660#action_12636660 ] Paul Elschot commented on LUCENE-1410: -- Q: I'm using fixed 6-bit frame size. Can you

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636685#action_12636685 ] Michael McCandless commented on LUCENE-1410: bq. A: PFor.getNumFrameBits()

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-03 Thread Otis Gospodnetic (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636686#action_12636686 ] Otis Gospodnetic commented on LUCENE-1410: -- For people not intimately familiar

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636689#action_12636689 ] Michael McCandless commented on LUCENE-1410: There's also this recent

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-03 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636705#action_12636705 ] Paul Elschot commented on LUCENE-1410: -- Q: We should look at the asm that's produced?

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636715#action_12636715 ] Michael McCandless commented on LUCENE-1410: {quote} Q: We should look at the

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-03 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636730#action_12636730 ] Paul Elschot commented on LUCENE-1410: -- The number of bits is not really informative,

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-03 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636736#action_12636736 ] Paul Elschot commented on LUCENE-1410: -- I wrote: The number of bits is not really

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-02 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636292#action_12636292 ] Paul Elschot commented on LUCENE-1410: -- Sorry about the mistake in the patch, a

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-10-02 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12636295#action_12636295 ] Paul Elschot commented on LUCENE-1410: -- Another detail about the decompression