[jira] [Commented] (SOLR-6638) Create an off-heap implementation of Solr caches
[ https://issues.apache.org/jira/browse/SOLR-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15395693#comment-15395693 ] Alexander Block commented on SOLR-6638: --- Did anyone try to use MapDB for an off-heap cache implementation? > Create an off-heap implementation of Solr caches > > > Key: SOLR-6638 > URL: https://issues.apache.org/jira/browse/SOLR-6638 > Project: Solr > Issue Type: New Feature >Reporter: Noble Paul > > There are various implementations of off-heap implementations of cache. One > such is using sun.misc.Unsafe .The cache implementations are pluggable in > Solr anyway -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6638) Create an off-heap implementation of Solr caches
[ https://issues.apache.org/jira/browse/SOLR-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178391#comment-14178391 ] Tommaso Teofili commented on SOLR-6638: --- for the record there's a quite old one (based on Solr 3.6.2) in Apache DirectMemory (see http://svn.apache.org/viewvc/directmemory/trunk/integrations/solr/src/main/java/org/apache/directmemory/solr/SolrOffHeapCache.java?view=markup) Create an off-heap implementation of Solr caches Key: SOLR-6638 URL: https://issues.apache.org/jira/browse/SOLR-6638 Project: Solr Issue Type: New Feature Reporter: Noble Paul There are various implementations of off-heap implementations of cache. One such is using sun.misc.Unsafe .The cache implementations are pluggable in Solr anyway -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6638) Create an off-heap implementation of Solr caches
[ https://issues.apache.org/jira/browse/SOLR-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178403#comment-14178403 ] Uwe Schindler commented on SOLR-6638: - Please don't use unsafe! Use ByteBuffer.allocateDirect(). This is enough to serve a cache. In Java 7 and Java 8 the ByteBuffer overhead is minimal (look at the assembler code generated by Hotspot). Create an off-heap implementation of Solr caches Key: SOLR-6638 URL: https://issues.apache.org/jira/browse/SOLR-6638 Project: Solr Issue Type: New Feature Reporter: Noble Paul There are various implementations of off-heap implementations of cache. One such is using sun.misc.Unsafe .The cache implementations are pluggable in Solr anyway -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6638) Create an off-heap implementation of Solr caches
[
https://issues.apache.org/jira/browse/SOLR-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178409#comment-14178409
]
Yonik Seeley commented on SOLR-6638:
For those who will be at Lucene Revolution in a couple of weeks, I have a talk
about this in the internals track:
{quote}
Native Code and Off-Heap Data Structures for Solr
Presented by Yonik Seeley, Heliosearch
Off-heap data structures and native code performance improvements for Apache
Solr are being developed as part of the Heliosearch project. This presentation
will cover the reasons behind these features, implementation details, and
performance impacts. Recently developed features will also be covered.
{quote}
Create an off-heap implementation of Solr caches
Key: SOLR-6638
URL: https://issues.apache.org/jira/browse/SOLR-6638
Project: Solr
Issue Type: New Feature
Reporter: Noble Paul
There are various implementations of off-heap implementations of cache. One
such is using sun.misc.Unsafe .The cache implementations are pluggable in
Solr anyway
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6638) Create an off-heap implementation of Solr caches
[ https://issues.apache.org/jira/browse/SOLR-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178456#comment-14178456 ] Noble Paul commented on SOLR-6638: -- [~thetaphi] , I was going through Cassandra codebase and found them using sun.misc.Unsafe to do malloc/dealloc memory. I will explore ByteBuffer.allocateDirect() . Is there any project using that ? [~ysee...@gmail.com] , sure . I'll look forward to that Create an off-heap implementation of Solr caches Key: SOLR-6638 URL: https://issues.apache.org/jira/browse/SOLR-6638 Project: Solr Issue Type: New Feature Reporter: Noble Paul There are various implementations of off-heap implementations of cache. One such is using sun.misc.Unsafe .The cache implementations are pluggable in Solr anyway -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6638) Create an off-heap implementation of Solr caches
[ https://issues.apache.org/jira/browse/SOLR-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178459#comment-14178459 ] Noble Paul commented on SOLR-6638: -- [~teofili] Is that code relevant in this new age? Create an off-heap implementation of Solr caches Key: SOLR-6638 URL: https://issues.apache.org/jira/browse/SOLR-6638 Project: Solr Issue Type: New Feature Reporter: Noble Paul There are various implementations of off-heap implementations of cache. One such is using sun.misc.Unsafe .The cache implementations are pluggable in Solr anyway -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6638) Create an off-heap implementation of Solr caches
[ https://issues.apache.org/jira/browse/SOLR-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178467#comment-14178467 ] Tommaso Teofili commented on SOLR-6638: --- bq. Is that code relevant in this new age? it would have to be updated to be used with Solr 4.x, but it shouldn't be too hard. If you plan to run some tests/benchmarks I could update that so that you can try (the interesting thing there is also that serialization would be pluggable, e.g. via Kryo or others). Create an off-heap implementation of Solr caches Key: SOLR-6638 URL: https://issues.apache.org/jira/browse/SOLR-6638 Project: Solr Issue Type: New Feature Reporter: Noble Paul There are various implementations of off-heap implementations of cache. One such is using sun.misc.Unsafe .The cache implementations are pluggable in Solr anyway -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6638) Create an off-heap implementation of Solr caches
[ https://issues.apache.org/jira/browse/SOLR-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178784#comment-14178784 ] Shinichiro Abe commented on SOLR-6638: -- FYI, Apache DirectMemory uses ByteBuffer.allocateDirect(). 1 years ago, I tried to upgrade to Solr 4.4. A very small patch is on DIRECTMEMORY-134. Create an off-heap implementation of Solr caches Key: SOLR-6638 URL: https://issues.apache.org/jira/browse/SOLR-6638 Project: Solr Issue Type: New Feature Reporter: Noble Paul There are various implementations of off-heap implementations of cache. One such is using sun.misc.Unsafe .The cache implementations are pluggable in Solr anyway -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
