[jira] Commented: (SOLR-1277) Implement a Solr specific naming service (using Zookeeper)

2009-07-16 Thread Linbin Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12732318#action_12732318
 ] 

Linbin Chen commented on SOLR-1277:
---

good idea and good project



> Implement a Solr specific naming service (using Zookeeper)
> --
>
> Key: SOLR-1277
> URL: https://issues.apache.org/jira/browse/SOLR-1277
> Project: Solr
>  Issue Type: New Feature
>Affects Versions: 1.4
>Reporter: Jason Rutherglen
>Assignee: Grant Ingersoll
>Priority: Minor
> Fix For: 1.5
>
> Attachments: log4j-1.2.15.jar, SOLR-1277.patch, zookeeper-3.2.0.jar
>
>   Original Estimate: 672h
>  Remaining Estimate: 672h
>
> The goal is to give Solr server clusters self-healing attributes
> where if a server fails, indexing and searching don't stop and
> all of the partitions remain searchable. For configuration, the
> ability to centrally deploy a new configuration without servers
> going offline.
> We can start with basic failover and start from there?
> Features:
> * Automatic failover (i.e. when a server fails, clients stop
> trying to index to or search it)
> * Centralized configuration management (i.e. new solrconfig.xml
> or schema.xml propagates to a live Solr cluster)
> * Optionally allow shards of a partition to be moved to another
> server (i.e. if a server gets hot, move the hot segments out to
> cooler servers). Ideally we'd have a way to detect hot segments
> and move them seamlessly. With NRT this becomes somewhat more
> difficult but not impossible?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (SOLR-1197) memcached implement solr cache for queryresultCache

2009-06-19 Thread Linbin Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Linbin Chen updated SOLR-1197:
--

Attachment: SOLR_1197-solr-memcache-0.2.patch

solr sint hashcode conflict cause solr memcached bug

solr-memcached-0.2

solr sint fieldType sint.hashcode conflict very hight above 99%

such as id:44232808 and id:44090533 hashcode conflict, so q=id:44232808 
maybe response id:44090533 doc result. error!

http://code.google.com/p/solr-side/issues/detail?id=2&can=1
solr-memcached-0.2 patch for create memcache key strategy:

QueryResultKey add method

  public String toString() {
  return query.toString();
  }

for MemcachedCache md5(QueryResultKey.toString())

now memcache key strategy = 
md5(keyPrefix+indexVersion+QueryResultKey.hashCode()+md5(QueryResultKey.toString()))

double md5

solr-memcache-0.2.zip 
http://solr-side.googlecode.com/files/solr-memcache-0.2.zip


> memcached implement solr cache for queryresultCache 
> 
>
> Key: SOLR-1197
> URL: https://issues.apache.org/jira/browse/SOLR-1197
> Project: Solr
>  Issue Type: New Feature
>Affects Versions: 1.3
> Environment: multiple slave solr replication environment
>Reporter: Linbin Chen
>Assignee: Noble Paul
> Fix For: 1.5
>
> Attachments: SOLR_1197-solr-memcache-0.2.patch, 
> SOLR_1197-solr-memcache.patch
>
>
> multiple slave create query result together, and slaves can share that.
> implement  memcached cache instead LRUCache
> my implement:
> solr-memcache.zip http://solr-side.googlecode.com/files/solr-memcache.zip 
> object transport by net need Serializable, so need patch solr 1.3, DocSetBase 
> implements Serializable, see 
> http://code.google.com/p/solr-side/issues/detail?id=1&can=1

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Issue Comment Edited: (SOLR-1197) memcached implement solr cache for queryresultCache

2009-06-03 Thread Linbin Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715879#action_12715879
 ] 

Linbin Chen edited comment on SOLR-1197 at 6/3/09 2:42 AM:
---

patch for Solr 1.3 

this patch only DocSetBase  implement Serializable

solr-memcache 

=readme.txt=
 

MemcachedCache instead of solr queryresultCache (default LRUCache)
 

config in solrconfig.xml to use solr-memcache

add newSearcher and firstSearcher Listener, such as:
 




 

use listener only for get index version, to create memcached key

indexVersion is static long field of MemcachedCache.java.
 

//originalKey is QueryResultKey
memcached key = keyPrefix+indexVersion+"-"+originalKey.hashCode() 
 





 

dep jar:

memcached-2.2.jar
spy-2.4.jar
 

solr-memcache.patch for solr 1.3
 

if download and unzip to d:/apache-solr-1.3.0
 

copy patch-build.xml and solr-memcache.patch to (d:/apache-solr-1.3.0)
 


D:\apache-solr-1.3.0>ant -f patch-build.xml -Dpatch.file=solr-memcache.patch
Buildfile: patch-build.xml

apply-patch:
[patch] patching file src/java/org/apache/solr/search/DocSet.java

BUILD SUCCESSFUL
Total time: 0 seconds
 

if exist d:/apache-solr-1.3.0/contrib/solr-memcache, if no exist you can unzip 
solr-memcache.zip to that dir

and dist
 


D:\apache-solr-1.3.0>ant dist
...
 

look D:\apache-solr-1.3.0\dist\apache-solr-memcache-1.3.0.jar

  was (Author: chenlb):
patch for Solr 1.3 

this patch only DocSetBase  implement Serializable
  
> memcached implement solr cache for queryresultCache 
> 
>
> Key: SOLR-1197
> URL: https://issues.apache.org/jira/browse/SOLR-1197
> Project: Solr
>  Issue Type: New Feature
>Affects Versions: 1.3
> Environment: multiple slave solr replication environment
>Reporter: Linbin Chen
> Fix For: 1.4
>
> Attachments: SOLR_1197-solr-memcache.patch
>
>
> multiple slave create query result together, and slaves can share that.
> implement  memcached cache instead LRUCache
> my implement:
> solr-memcache.zip http://solr-side.googlecode.com/files/solr-memcache.zip 
> object transport by net need Serializable, so need patch solr 1.3, DocSetBase 
> implements Serializable, see 
> http://code.google.com/p/solr-side/issues/detail?id=1&can=1

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Issue Comment Edited: (SOLR-1197) memcached implement solr cache for queryresultCache

2009-06-03 Thread Linbin Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715879#action_12715879
 ] 

Linbin Chen edited comment on SOLR-1197 at 6/3/09 2:41 AM:
---

patch for Solr 1.3 

this patch only DocSetBase  implement Serializable

  was (Author: chenlb):
Solr 1.3 

only DocSetBase  implement Serializable
  
> memcached implement solr cache for queryresultCache 
> 
>
> Key: SOLR-1197
> URL: https://issues.apache.org/jira/browse/SOLR-1197
> Project: Solr
>  Issue Type: New Feature
>Affects Versions: 1.3
> Environment: multiple slave solr replication environment
>Reporter: Linbin Chen
> Fix For: 1.4
>
> Attachments: SOLR_1197-solr-memcache.patch
>
>
> multiple slave create query result together, and slaves can share that.
> implement  memcached cache instead LRUCache
> my implement:
> solr-memcache.zip http://solr-side.googlecode.com/files/solr-memcache.zip 
> object transport by net need Serializable, so need patch solr 1.3, DocSetBase 
> implements Serializable, see 
> http://code.google.com/p/solr-side/issues/detail?id=1&can=1

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (SOLR-1197) memcached implement solr cache for queryresultCache

2009-06-03 Thread Linbin Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Linbin Chen updated SOLR-1197:
--

Attachment: SOLR_1197-solr-memcache.patch

Solr 1.3 

only DocSetBase  implement Serializable

> memcached implement solr cache for queryresultCache 
> 
>
> Key: SOLR-1197
> URL: https://issues.apache.org/jira/browse/SOLR-1197
> Project: Solr
>  Issue Type: New Feature
>Affects Versions: 1.3
> Environment: multiple slave solr replication environment
>Reporter: Linbin Chen
> Fix For: 1.4
>
> Attachments: SOLR_1197-solr-memcache.patch
>
>
> multiple slave create query result together, and slaves can share that.
> implement  memcached cache instead LRUCache
> my implement:
> solr-memcache.zip http://solr-side.googlecode.com/files/solr-memcache.zip 
> object transport by net need Serializable, so need patch solr 1.3, DocSetBase 
> implements Serializable, see 
> http://code.google.com/p/solr-side/issues/detail?id=1&can=1

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (SOLR-1197) memcached implement solr cache for queryresultCache

2009-06-03 Thread Linbin Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Linbin Chen updated SOLR-1197:
--

Description: 
multiple slave create query result together, and slaves can share that.

implement  memcached cache instead LRUCache


my implement:

solr-memcache.zip http://solr-side.googlecode.com/files/solr-memcache.zip 

object transport by net need Serializable, so need patch solr 1.3, DocSetBase 
implements Serializable, see 
http://code.google.com/p/solr-side/issues/detail?id=1&can=1




  was:
multiple slave create query result together, and share that slaves.

implement  memcached cache instead LRUCache


my implement:

solr-memcache.zip http://solr-side.googlecode.com/files/solr-memcache.zip 

object transport by net need Serializable, so need patch solr 1.3, DocSetBase 
implements Serializable, see 
http://code.google.com/p/solr-side/issues/detail?id=1&can=1





> memcached implement solr cache for queryresultCache 
> 
>
> Key: SOLR-1197
> URL: https://issues.apache.org/jira/browse/SOLR-1197
> Project: Solr
>  Issue Type: New Feature
>Affects Versions: 1.3
> Environment: multiple slave solr replication environment
>Reporter: Linbin Chen
> Fix For: 1.4
>
>
> multiple slave create query result together, and slaves can share that.
> implement  memcached cache instead LRUCache
> my implement:
> solr-memcache.zip http://solr-side.googlecode.com/files/solr-memcache.zip 
> object transport by net need Serializable, so need patch solr 1.3, DocSetBase 
> implements Serializable, see 
> http://code.google.com/p/solr-side/issues/detail?id=1&can=1

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Created: (SOLR-1197) memcached implement solr cache for queryresultCache

2009-06-03 Thread Linbin Chen (JIRA)
memcached implement solr cache for queryresultCache 


 Key: SOLR-1197
 URL: https://issues.apache.org/jira/browse/SOLR-1197
 Project: Solr
  Issue Type: New Feature
Affects Versions: 1.3
 Environment: multiple slave solr replication environment
Reporter: Linbin Chen
 Fix For: 1.4


multiple slave create query result together, and share that slaves.

implement  memcached cache instead LRUCache


my implement:

solr-memcache.zip http://solr-side.googlecode.com/files/solr-memcache.zip 

object transport by net need Serializable, so need patch solr 1.3, DocSetBase 
implements Serializable, see 
http://code.google.com/p/solr-side/issues/detail?id=1&can=1




-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.