[jira] [Commented] (LUCENE-6040) Speedup broadword bit selection
[ https://issues.apache.org/jira/browse/LUCENE-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198601#comment-14198601 ] ASF subversion and git services commented on LUCENE-6040: - Commit 1636913 from [~jpountz] in branch 'dev/trunk' [ https://svn.apache.org/r1636913 ] LUCENE-6040: Speedup broadword bit selection. Speedup broadword bit selection --- Key: LUCENE-6040 URL: https://issues.apache.org/jira/browse/LUCENE-6040 Project: Lucene - Core Issue Type: Improvement Components: core/other Reporter: Paul Elschot Priority: Minor Attachments: LUCENE-6040.patch, LUCENE-6040.patch Use table lookup instead of some broadword manipulations -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-6040) Speedup broadword bit selection
[ https://issues.apache.org/jira/browse/LUCENE-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198603#comment-14198603 ] ASF subversion and git services commented on LUCENE-6040: - Commit 1636914 from [~jpountz] in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1636914 ] LUCENE-6040: Speedup broadword bit selection. Speedup broadword bit selection --- Key: LUCENE-6040 URL: https://issues.apache.org/jira/browse/LUCENE-6040 Project: Lucene - Core Issue Type: Improvement Components: core/other Reporter: Paul Elschot Priority: Minor Attachments: LUCENE-6040.patch, LUCENE-6040.patch Use table lookup instead of some broadword manipulations -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-6040) Speedup broadword bit selection
[ https://issues.apache.org/jira/browse/LUCENE-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199131#comment-14199131 ] ASF subversion and git services commented on LUCENE-6040: - Commit 1636963 from hoss...@apache.org in branch 'dev/trunk' [ https://svn.apache.org/r1636963 ] LUCENE-6040: svn:eol-style native Speedup broadword bit selection --- Key: LUCENE-6040 URL: https://issues.apache.org/jira/browse/LUCENE-6040 Project: Lucene - Core Issue Type: Improvement Components: core/other Reporter: Paul Elschot Priority: Minor Fix For: 5.0 Attachments: LUCENE-6040.patch, LUCENE-6040.patch Use table lookup instead of some broadword manipulations -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-6040) Speedup broadword bit selection
[ https://issues.apache.org/jira/browse/LUCENE-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199133#comment-14199133 ] ASF subversion and git services commented on LUCENE-6040: - Commit 1636964 from hoss...@apache.org in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1636964 ] LUCENE-6040: svn:eol-style native (merge r1636963) Speedup broadword bit selection --- Key: LUCENE-6040 URL: https://issues.apache.org/jira/browse/LUCENE-6040 Project: Lucene - Core Issue Type: Improvement Components: core/other Reporter: Paul Elschot Priority: Minor Fix For: 5.0 Attachments: LUCENE-6040.patch, LUCENE-6040.patch Use table lookup instead of some broadword manipulations -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-6040) Speedup broadword bit selection
[ https://issues.apache.org/jira/browse/LUCENE-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192253#comment-14192253 ] Paul Elschot commented on LUCENE-6040: -- These array lookups are given in the article of 2013 by Simon Gog and Matthias Petri, 2013, Optimized Succinct Data Structures for Massive Data in Section 6.2, currently available at http://people.eng.unimelb.edu.au/sgog/optimized.pdf . A quote from there: bq. Unfortunately, the development of efficient select operations on 64 -bit integers ( select 64 ) has not been as rapid as for popcnt . There are no direct CPU instructions available to return the position of the i -th set bit. As was noted at http://vigna.di.unimi.it/Sux/select.php , these two lookups have the overhead of java array accesses, so it would probably be wortwhile to use a native version of this, at least until better processor support becomes available. For the patch here, I'd expect that some speedup in Java is still possible. Speedup broadword bit selection --- Key: LUCENE-6040 URL: https://issues.apache.org/jira/browse/LUCENE-6040 Project: Lucene - Core Issue Type: Improvement Components: core/other Reporter: Paul Elschot Priority: Minor Attachments: LUCENE-6040.patch Use table lookup instead of some broadword manipulations -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-6040) Speedup broadword bit selection
[
https://issues.apache.org/jira/browse/LUCENE-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192289#comment-14192289
]
Adrien Grand commented on LUCENE-6040:
--
I just played with the patch and it makes the EliasFanoDocIdSet faster on large
advance indeed. It doesn't seem useful to keep 4 impls, so maybe we should just
remove the current {{select}} impl in master and replace it with
{{selectWithOverflowAndByteLookup}}?
Speedup broadword bit selection
---
Key: LUCENE-6040
URL: https://issues.apache.org/jira/browse/LUCENE-6040
Project: Lucene - Core
Issue Type: Improvement
Components: core/other
Reporter: Paul Elschot
Priority: Minor
Attachments: LUCENE-6040.patch
Use table lookup instead of some broadword manipulations
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-6040) Speedup broadword bit selection
[ https://issues.apache.org/jira/browse/LUCENE-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192356#comment-14192356 ] Paul Elschot commented on LUCENE-6040: -- Replacing the existing implementation is indeed the goal, but after further testing, which you've already done. The initial version of the patch is still here for those curious about the other implementations. The selectWithOverflowAndByteLookup() method has an added precondition that the bit to select must exist. As I recall this should the case because there is always a bitCount() before the select() call. Anyway the existing docidset tests should easily catch this if necessary. Speedup broadword bit selection --- Key: LUCENE-6040 URL: https://issues.apache.org/jira/browse/LUCENE-6040 Project: Lucene - Core Issue Type: Improvement Components: core/other Reporter: Paul Elschot Priority: Minor Attachments: LUCENE-6040.patch Use table lookup instead of some broadword manipulations -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
