Re: Solr Cloud multiple shards and replicas in one instance freezes

[Mark Miller]

Can you get a stack trace dump?

Sent from my iPhone

On Mar 23, 2012, at 10:38 PM, Jamie Johnson jej2...@gmail.com wrote:

 I run a test setup on my mac where I setup 4 cores 2 of which are
 replicas in a single solr JVM instance.  I recently attempted to move
 this same setup to Ubuntu 10.04.4 LTS but the system seems to just
 lock up.  I am running a local test which essentially adds 100 docs
 and says commit after 10s, after doing this once the solr instance
 just becomes non responsive, what can I look at to try to diagnose
 why?  I've increased the number of open file descriptors for the user
 running solr to 200,000.  Any pointers of where to look would be
 great.

Re: Practical Optimization

[Martin Koch]

Thanks for writing this up. These are good tips.

/Martin

On Fri, Mar 23, 2012 at 9:57 PM, dw5ight dw5i...@gmail.com wrote:

 Hey All-

 we run a  http://carsabi.com car search engine  with Solr and did some
 benchmarking recently after we switched from a hosted service to
 self-hosting. In brief, we went from 800ms complex range queries on a 1.5M
 document corpus to 43ms. The major shifts were switching from EC2 Large to
 EC2 CC8XL which got us down to 282ms (2.82x speed gain due to 2.75x CPU
 speed increase we think), and then down to 43ms when we sharded to 8 cores.
 We tried sharding to 12 and 16 but saw negligible gains after this point.

 Anyway, hope this might be useful to someone - we write up exact stats and
 a
 step by step sharding procedure on our

 http://carsabi.com/car-news/2012/03/23/optimizing-solr-7x-your-search-speed/
 tech blog  if anyone's interested.

 best
 Dwight

 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/Practical-Optimization-tp3852776p3852776.html
 Sent from the Solr - User mailing list archive at Nabble.com.

Re: Field length and scoring

[Erik Fäßler]

Ahh, that's it - I thought of such a thing but couldn't find a proper 
affirmation with Google.

Thank you both for your answers. I guess I will just sort by value length 
myself.

Only one thing: Erick said my examples would both be one token long. But I 
rather think, there are both one value long but three and four tokens long, 
as the NGramAnalyzer splits the values in smaller tokens. And as it can be seen 
from the link given by Ahmet, field lengths of three and four are not 
distinguished - where the reason for my observation lies.

Thanks again and best regards,

Erik


On 24.03.2012, at 00:02, Ahmet Arslan iori...@yahoo.com wrote:

 Also, the field length is enocded in a byte (as I remember).
 So it's
 quite possible that,
 even if the lengths of these fields were 3 and 4 instead of
 both being
 1, the value
 stored for the length norms would be the same number.
 
 Exactly. http://search-lucene.com/m/uGKRu1pvRjw
 

Re: Tags and Folksonomies

[Richard Noble]

Hi

I have not actually done this yet, but will need to do something similar.
We will also be using user tagging, and ratings to influence relevancy for
the searches.

I take it that you want something like if a document has been tagged 8
times with the tag tagvalue
but only 4 times with the tag othervalue then you want to boost rate the
tag tagvalue higher?

The route I plan to go down would be to store the tag value count against
the document, and
use a (possibly custom) function to boost accordingly.

Just a theory at this point, and I am sure that there may be better ways.

Hope it helps

Richard


On Fri, Mar 23, 2012 at 5:44 PM, Nishant Chandra
nishant.chan...@gmail.comwrote:

 Suppose I have content which has title and description. Users can tag
 content
 and search content based on tag, title and description. Tag has more
 weightage.

 Any inputs on how indexing and retrieval will work given there is content
 and tags using Solr? Has anyone implemented search based on collaborative
 tagging?

 Thanks,
 Nishant




-- 
*nix has users, Mac has fans, Windows has victims.

Re: Faceted range based on float within velocity not working properly

[Marcelo Carvalho Fernandes]

Hi all!

I have just solved the problem but I'm not sure if that would be nice to
commit to Solr repository.
How do I go about having this patch approved?

The changed file is VM_global_library.vm and the changed code is
highlighted as yellow in the following..

#macro(range_get_to_value $inval, $gapval)
#if(${gapval.class.name} == java.lang.String)
$inval$gapval##
#elseif(${gapval.class.name} == java.lang.Float || ${inval.class.name} ==
java.lang.Float)
#if(${gapval.class.name} == java.lang.Float)
#set($inval2 = $math.toDouble($inval.replace(.,,)))
#set($gapval2 = $gapval)
#else
#set($inval2 = $inval)
#set($gapval2 = $math.toDouble($gapval2.replace(.,,)))
#end
$math.toDouble($math.add($gapval,$inval2))##
#else
$math.add($inval,$gapval)##
#end
#end

Thanks in advance.


Marcelo Carvalho Fernandes
+55 21 8272-7970
+55 21 2205-2786


On Fri, Mar 23, 2012 at 8:13 AM, Marcelo Carvalho Fernandes 
mcf2...@gmail.com wrote:

 I went deeper in the problem and discovered that...

 $math.toInteger(10.1) returns 101
 $math.toInteger(10,1) returns 10

 Although I'm using Strings in the previous examples, I have a Float
 variable from Solr.

 I'm not sure if it is just a Solr problem, just a Velocity problema or
 somewhere between them.

 May it be something related to my local/regional settings or so? I ask
 that because in BRL (Brazilian Real) the currency format we use is
 something line R$1.234,56.

 Any idea?



 
 Marcelo Carvalho Fernandes
 +55 21 8272-7970
 +55 21 2205-2786


 On Thu, Mar 22, 2012 at 3:14 PM, Marcelo Carvalho Fernandes 
 mcf2...@gmail.com wrote:

 Hi all!

 I'm using Apache Solr 3.5.0 with Tomcat 6.0.32.

 My schema.xml has a price field declared as...

field name=*preco* type=*float* indexed=true stored=true
 required=false /

 My solrconfig.xml has a a velocity RequestHandler (/browser)) that has
 the following facet...

str name=facet.range*preco*/str
int name=f.*preco*.facet.range.start0/int
int name=f.*preco*.facet.range.end100/int
int name=f.*preco*.facet.range.gap10/int

 ...and I'm using the default templates in
 SolrDIR\example\solr\conf\velocity .

 The problem is that each peace of range that is being generated has a
 wrong upper bound. For example, instead of...

  0 -10
 10 - 20
 20 - 30
 30 - 40
 ...

 ...what is being generated is...

  0 - 10
 10 - 110
 20 - 210
 30 - 310
 ...

 I've studied the #display_facet_range macro in VM_global_library.vm and
 it looks like the $math.add is contatenating the two operands insted of
 producing a sum. I  mean, insted of 10+10=20 it returns 110, instead of
 20+10=30 it returns 210.

 Any idea what is the problem?

 Thanks in advance,

 
 Marcelo Carvalho Fernandes
 +55 21 8272-7970
 +55 21 2205-2786

Re: Faceted range based on float within velocity not working properly

[Marcelo Carvalho Fernandes]

Just to let you know that there can't have any spaces in the begining of a
line code. That leads us to...


#macro(range_get_to_value $inval, $gapval)
#if(${gapval.class.name} == java.lang.String)
$inval$gapval##
#elseif(${gapval.class.name} == java.lang.Float || ${inval.class.name} ==
java.lang.Float)
#if(${gapval.class.name} == java.lang.Float)
#set($inval2 = $math.toDouble($inval.replace(.,,)))
#set($gapval2 = $gapval)
#else
#set($inval2 = $inval)
#set($gapval2 = $math.toDouble($gapval2.replace(.,,)))
#end
$math.toDouble($math.add($gapval,$inval2))##
#else
$math.add($inval,$gapval)##
#end
#end


Marcelo Carvalho Fernandes
+55 21 8272-7970
+55 21 2205-2786


On Sat, Mar 24, 2012 at 9:12 AM, Marcelo Carvalho Fernandes 
mcf2...@gmail.com wrote:

 Hi all!

 I have just solved the problem but I'm not sure if that would be nice to
 commit to Solr repository.
 How do I go about having this patch approved?

 The changed file is VM_global_library.vm and the changed code is
 highlighted as yellow in the following..

 #macro(range_get_to_value $inval, $gapval)
 #if(${gapval.class.name} == java.lang.String)
  $inval$gapval##
 #elseif(${gapval.class.name} == java.lang.Float || ${inval.class.name}
 == java.lang.Float)
  #if(${gapval.class.name} == java.lang.Float)
  #set($inval2 = $math.toDouble($inval.replace(.,,)))
  #set($gapval2 = $gapval)
 #else
  #set($inval2 = $inval)
 #set($gapval2 = $math.toDouble($gapval2.replace(.,,)))
  #end
 $math.toDouble($math.add($gapval,$inval2))##
 #else
 $math.add($inval,$gapval)##
 #end
 #end

 Thanks in advance.

 
 Marcelo Carvalho Fernandes
 +55 21 8272-7970
 +55 21 2205-2786


 On Fri, Mar 23, 2012 at 8:13 AM, Marcelo Carvalho Fernandes 
 mcf2...@gmail.com wrote:

 I went deeper in the problem and discovered that...

 $math.toInteger(10.1) returns 101
 $math.toInteger(10,1) returns 10

 Although I'm using Strings in the previous examples, I have a Float
 variable from Solr.

 I'm not sure if it is just a Solr problem, just a Velocity problema or
 somewhere between them.

 May it be something related to my local/regional settings or so? I ask
 that because in BRL (Brazilian Real) the currency format we use is
 something line R$1.234,56.

 Any idea?



 
 Marcelo Carvalho Fernandes
 +55 21 8272-7970
 +55 21 2205-2786


 On Thu, Mar 22, 2012 at 3:14 PM, Marcelo Carvalho Fernandes 
 mcf2...@gmail.com wrote:

 Hi all!

 I'm using Apache Solr 3.5.0 with Tomcat 6.0.32.

 My schema.xml has a price field declared as...

field name=*preco* type=*float* indexed=true stored=true
 required=false /

 My solrconfig.xml has a a velocity RequestHandler (/browser)) that has
 the following facet...

str name=facet.range*preco*/str
int name=f.*preco*.facet.range.start0/int
int name=f.*preco*.facet.range.end100/int
int name=f.*preco*.facet.range.gap10/int

 ...and I'm using the default templates in
 SolrDIR\example\solr\conf\velocity .

 The problem is that each peace of range that is being generated has a
 wrong upper bound. For example, instead of...

  0 -10
 10 - 20
 20 - 30
 30 - 40
 ...

 ...what is being generated is...

  0 - 10
 10 - 110
 20 - 210
 30 - 310
 ...

 I've studied the #display_facet_range macro in VM_global_library.vm and
 it looks like the $math.add is contatenating the two operands insted of
 producing a sum. I  mean, insted of 10+10=20 it returns 110, instead of
 20+10=30 it returns 210.

 Any idea what is the problem?

 Thanks in advance,

 
 Marcelo Carvalho Fernandes
 +55 21 8272-7970
 +55 21 2205-2786

Re: Solr Cloud multiple shards and replicas in one instance freezes

[Jamie Johnson]

There is no stack trace, I can fire things back up and try to get a
thread dump if that's useful.

On Sat, Mar 24, 2012 at 4:07 AM, Mark Miller markrmil...@gmail.com wrote:
 Can you get a stack trace dump?

 Sent from my iPhone

 On Mar 23, 2012, at 10:38 PM, Jamie Johnson jej2...@gmail.com wrote:

 I run a test setup on my mac where I setup 4 cores 2 of which are
 replicas in a single solr JVM instance.  I recently attempted to move
 this same setup to Ubuntu 10.04.4 LTS but the system seems to just
 lock up.  I am running a local test which essentially adds 100 docs
 and says commit after 10s, after doing this once the solr instance
 just becomes non responsive, what can I look at to try to diagnose
 why?  I've increased the number of open file descriptors for the user
 running solr to 200,000.  Any pointers of where to look would be
 great.

Old Google Guava library needs updating (r05)

[Nicholas Ball]

Hey all,

Working on a plugin, which uses the Curator library (ZooKeeper client).
Curator depends on the very latest Google Guava library which unfortunately
clashes with Solr's outdated r05 of Guava.
Think it's safe to say that Solr should be using the very latest Guava
library (11.0.1) too right?
Shall I open up a JIRA issue for someone to update it?

Cheers,
Nick

Re: Trouble Setting Up Development Environment

[Karthick Duraisamy Soundararaj]

I followed your instructions. I got 8 Errors and a bunch of warnings few of
them related to classpath. I also got the following exception when I tried
to run with the jetty ( i have attached the full console output with this
email. I figured solr directory with config files might be missing and
added that in WebContent.

Could be of great help if someone can point me at right direction.

ls WebContent
admin  favicon.ico  index.jsp  solr  WEB-INF


*SEVERE: Error in solrconfig.xml:org.apache.solr.common.SolrException: No
system property or default value specified for solr.test.sys.prop1*
at
org.apache.solr.common.util.DOMUtil.substituteProperty(DOMUtil.java:331)
at
org.apache.solr.common.util.DOMUtil.substituteProperties(DOMUtil.java:290)
at
org.apache.solr.common.util.DOMUtil.substituteProperties(DOMUtil.java:292)
at org.apache.solr.core.Config.init(Config.java:165)
at org.apache.solr.core.SolrConfig.init(SolrConfig.java:131)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:435)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:316)
at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:133)
at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:94)
at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:713)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at runjettyrun.Bootstrap.main(Bootstrap.java:97)


*Here are the 8 errors I got*
*Description
Resource Path

  Location   Type*
core cannot be resolved
dataimport.jsp
 /solr3_5/ssrc/solr/contrib/dataimporthandler/src/webapp/admin
 line 27   JSP Problem
End tag (/html) not closed properly, expected .package.html
/solr3_5/ssrc/lucene/contrib/queryparser/src/java/org/apache/lucene/queryParser/core/config
 line 64HTML Problem
Fragment_info.jsp was not found at expected
path  /solr3_5/ssrc/solr/contrib/
dataimporthandler/src/webapp/admin/_info.jspdataimport.jsp
/solr3_5/ssrc/solr/contrib/dataimporthandler/src/webapp/admin
line 21JSP Problem
Fragment _info.jsp was not found at expected
path /solr3_5/ssrc/solr/contrib/dataimporthandler
/src/webapp/admin/_info.jsp
debug.jsp
/solr3_5/ssrc/solr/contrib/dataimporthandler/src/webapp/admin
line 19JSP Problem
Named template dotdots is not available tabutils.xsl

/solr3_5/ssrc/lucene/src/site/src/documentation/skins/common/xslt/html
  line 41XSL Problem
Named template dotdots is not available tabutils.xsl
/solr3_5/ssrc/solr/site-src/src/documentation/skins/common/xslt/html
  line 41XSL Problem
Unhandled exception type Throwable  ping.jsp
/solr3_5/WebContent/admin
  line 46JSP Problem
Unhandled exception type Throwable  ping.jsp
/solr3_5/ssrc/solr/webapp/web/admin

line 46JSP Problem


*Here are the warnings I got*

 DescriptionResourcePathLocationType
 Classpath entry
 /solr3_5/ssrc/lucene/contrib/benchmark/lib/commons-beanutils-1.7.0.jar will
 not be exported or published. Runtime ClassNotFoundExceptions may result.
 solr3_5P/solr3_5Classpath Dependency Validator Message
 Classpath entry
 /solr3_5/ssrc/lucene/contrib/benchmark/lib/commons-collections-3.1.jar will
 not be exported or published. Runtime ClassNotFoundExceptions may result.
 solr3_5P/solr3_5Classpath Dependency Validator Message
 Classpath entry
 /solr3_5/ssrc/lucene/contrib/benchmark/lib/commons-compress-1.2.jar will
 not be exported or published. Runtime ClassNotFoundExceptions may result.
 solr3_5P/solr3_5Classpath Dependency Validator Message
 Classpath entry
 /solr3_5/ssrc/lucene/contrib/benchmark/lib/commons-digester-1.7.jar will
 not be exported or published. Runtime ClassNotFoundExceptions may result.
 solr3_5P/solr3_5Classpath Dependency Validator Message
 Classpath entry
 

Re: Trouble Setting Up Development Environment

[Karthick Duraisamy Soundararaj]

One minor change is that I used solr 3.5 source code and not the one from
the trunk.

On Sat, Mar 24, 2012 at 4:17 PM, Karthick Duraisamy Soundararaj 
karthick.soundara...@gmail.com wrote:

 I followed your instructions. I got 8 Errors and a bunch of warnings few
 of them related to classpath. I also got the following exception when I
 tried to run with the jetty ( i have attached the full console output with
 this email. I figured solr directory with config files might be missing and
 added that in WebContent.

 Could be of great help if someone can point me at right direction.

 ls WebContent
 admin  favicon.ico  index.jsp  solr  WEB-INF


 *SEVERE: Error in solrconfig.xml:org.apache.solr.common.SolrException: No
 system property or default value specified for solr.test.sys.prop1*
 at
 org.apache.solr.common.util.DOMUtil.substituteProperty(DOMUtil.java:331)
 at
 org.apache.solr.common.util.DOMUtil.substituteProperties(DOMUtil.java:290)
 at
 org.apache.solr.common.util.DOMUtil.substituteProperties(DOMUtil.java:292)
 at org.apache.solr.core.Config.init(Config.java:165)
 at org.apache.solr.core.SolrConfig.init(SolrConfig.java:131)
 at org.apache.solr.core.CoreContainer.create(CoreContainer.java:435)
 at org.apache.solr.core.CoreContainer.load(CoreContainer.java:316)
 at
 org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:133)
 at
 org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:94)
 at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
 at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
 at
 org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:713)
 at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
 at
 org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
 at
 org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
 at
 org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
 at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
 at
 org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
 at org.mortbay.jetty.Server.doStart(Server.java:224)
 at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
 at runjettyrun.Bootstrap.main(Bootstrap.java:97)


 *Here are the 8 errors I got*
 *Description
  Resource
Path

   Location   Type*
 core cannot be resolved
 dataimport.jsp
  /solr3_5/ssrc/solr/contrib/dataimporthandler/src/webapp/admin
  line 27   JSP Problem
 End tag (/html) not closed properly, expected .package.html
 /solr3_5/ssrc/lucene/contrib/queryparser/src/java/org/apache/lucene/queryParser/core/config
  line 64HTML Problem
 Fragment_info.jsp was not found at expected
 path  /solr3_5/ssrc/solr/contrib/
 dataimporthandler/src/webapp/admin/_info.jspdataimport.jsp
 /solr3_5/ssrc/solr/contrib/dataimporthandler/src/webapp/admin
 line 21JSP Problem
 Fragment _info.jsp was not found at expected
 path /solr3_5/ssrc/solr/contrib/dataimporthandler
 /src/webapp/admin/_info.jsp
 debug.jsp
 /solr3_5/ssrc/solr/contrib/dataimporthandler/src/webapp/admin
 line 19JSP Problem
 Named template dotdots is not available tabutils.xsl

 /solr3_5/ssrc/lucene/src/site/src/documentation/skins/common/xslt/html
   line 41XSL Problem
 Named template dotdots is not available tabutils.xsl
 /solr3_5/ssrc/solr/site-src/src/documentation/skins/common/xslt/html
   line 41XSL Problem
 Unhandled exception type Throwable  ping.jsp
 /solr3_5/WebContent/admin
   line 46JSP Problem
 Unhandled exception type Throwable  ping.jsp
 /solr3_5/ssrc/solr/webapp/web/admin

 line 46JSP Problem


 *Here are the warnings I got*

 DescriptionResourcePathLocationType
 Classpath entry
 /solr3_5/ssrc/lucene/contrib/benchmark/lib/commons-beanutils-1.7.0.jar will
 not be exported or published. Runtime ClassNotFoundExceptions may result.
 solr3_5P/solr3_5Classpath Dependency Validator Message
 Classpath entry
 /solr3_5/ssrc/lucene/contrib/benchmark/lib/commons-collections-3.1.jar will
 not be exported or published. Runtime ClassNotFoundExceptions may result.
 solr3_5P/solr3_5Classpath Dependency Validator Message
 Classpath entry
 /solr3_5/ssrc/lucene/contrib/benchmark/lib/commons-compress-1.2.jar will
 not be exported or published. Runtime ClassNotFoundExceptions may result.
 

ant test and contribs

[Lance Norskog]

What do I need to add so that a contrib/project/src/test/ directory
can find the classes in contrib/project/src/java? I've gotten the ant
files to where 'ant test-contrib' works. But 'ant test' fails: it
cannot compile the test classes after building the jars for
contrib/project. Any hints?

-- 
Lance Norskog
goks...@gmail.com

RE: ant test and contribs

[Steven A Rowe]

Hi Lance,

Are you adding a new solr/contrib/project/?  If so, why not use the build.xml 
file from a sibling project?  E.g. try starting from 
solr/contrib/velocity/build.xml - it is very simple and enables all build steps 
by importing solr/contrib/contrib-build.xml.

solr/contrib/contrib-build.xml imports solr/common-build.xml;
solr/common-build.xml imports lucene/contrib/contrib-build.xml;
and lucene/contrib/contrib-build.xml imports lucene/common-build.xml.

Simple!

Steve

-Original Message-
From: Lance Norskog [mailto:goks...@gmail.com] 
Sent: Saturday, March 24, 2012 7:56 PM
To: solr-user
Subject: ant test and contribs

What do I need to add so that a contrib/project/src/test/ directory can find 
the classes in contrib/project/src/java? I've gotten the ant files to where 
'ant test-contrib' works. But 'ant test' fails: it cannot compile the test 
classes after building the jars for contrib/project. Any hints?

--
Lance Norskog
goks...@gmail.com

Microshardding question

[Jamie Johnson]

I have recently been considering using microsharding in our
distribution and wanted to make sure I understand the premise
correctly.  The idea would be to fire up a set of solr instances, each
with a number of cores.  Should those cores become over burdened we'd
fire up another solr instance on another box, add it to this shard in
the collection and solr would replicate the index from the leader.
Now if I wanted to remove the original over burdened core how would I
go ahead and update the clusterstate in zookeeper to no longer
reference the core that I am taking down?  I know that I may not
necessarily need to take it down, but I think there are cases where it
makes sense to do so.  I am assuming having it listed in clusterstate
isn't really a problem since the shard can be accessed from one of the
other solr instances but it would seem a good practice to remove this.
 Does deleting a solr core when running solrcloud remove the entry
from clusterstate?

Re: Microshardding question

[Jamie Johnson]

Seems like I should have just tried it.  Unloading did indeed remove
the core from the clusterstate, so that answers that.

On Sat, Mar 24, 2012 at 10:02 PM, Jamie Johnson jej2...@gmail.com wrote:
 I have recently been considering using microsharding in our
 distribution and wanted to make sure I understand the premise
 correctly.  The idea would be to fire up a set of solr instances, each
 with a number of cores.  Should those cores become over burdened we'd
 fire up another solr instance on another box, add it to this shard in
 the collection and solr would replicate the index from the leader.
 Now if I wanted to remove the original over burdened core how would I
 go ahead and update the clusterstate in zookeeper to no longer
 reference the core that I am taking down?  I know that I may not
 necessarily need to take it down, but I think there are cases where it
 makes sense to do so.  I am assuming having it listed in clusterstate
 isn't really a problem since the shard can be accessed from one of the
 other solr instances but it would seem a good practice to remove this.
  Does deleting a solr core when running solrcloud remove the entry
 from clusterstate?

web gui specify shard and collection when adding a new core

[Jamie Johnson]

Is there a plan to add the ability to specify the shard and
collection when adding a core through the enhanced web gui, is there a
JIRA for this?  If not I'd be more than happy to add the request if
someone can point me to the active JIRA (both 3162 and 2667 are marked
Resolved).

Re: Trouble Setting Up Development Environment

[Li Li]

I forgot to write that I am running it in tomcat 6, not jetty.
you can right click the project - Debug As - Debug on Server - Manually
define a new Server - Apache - Tomcat 6
if you should have configured a tomcat.

On Sun, Mar 25, 2012 at 4:17 AM, Karthick Duraisamy Soundararaj 
karthick.soundara...@gmail.com wrote:

 I followed your instructions. I got 8 Errors and a bunch of warnings few
 of them related to classpath. I also got the following exception when I
 tried to run with the jetty ( i have attached the full console output with
 this email. I figured solr directory with config files might be missing and
 added that in WebContent.

 Could be of great help if someone can point me at right direction.

 ls WebContent
 admin  favicon.ico  index.jsp  solr  WEB-INF


 *SEVERE: Error in solrconfig.xml:org.apache.solr.common.SolrException: No
 system property or default value specified for solr.test.sys.prop1*
 at
 org.apache.solr.common.util.DOMUtil.substituteProperty(DOMUtil.java:331)
 at
 org.apache.solr.common.util.DOMUtil.substituteProperties(DOMUtil.java:290)
 at
 org.apache.solr.common.util.DOMUtil.substituteProperties(DOMUtil.java:292)
 at org.apache.solr.core.Config.init(Config.java:165)
 at org.apache.solr.core.SolrConfig.init(SolrConfig.java:131)
 at org.apache.solr.core.CoreContainer.create(CoreContainer.java:435)
 at org.apache.solr.core.CoreContainer.load(CoreContainer.java:316)
 at
 org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:133)
 at
 org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:94)
 at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
 at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
 at
 org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:713)
 at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
 at
 org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
 at
 org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
 at
 org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
 at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
 at
 org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
 at org.mortbay.jetty.Server.doStart(Server.java:224)
 at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
 at runjettyrun.Bootstrap.main(Bootstrap.java:97)


 *Here are the 8 errors I got*
 *Description
  Resource
Path

   Location   Type*
 core cannot be resolved
 dataimport.jsp
  /solr3_5/ssrc/solr/contrib/dataimporthandler/src/webapp/admin
  line 27   JSP Problem
 End tag (/html) not closed properly, expected .package.html
 /solr3_5/ssrc/lucene/contrib/queryparser/src/java/org/apache/lucene/queryParser/core/config
  line 64HTML Problem
 Fragment_info.jsp was not found at expected
 path  /solr3_5/ssrc/solr/contrib/
 dataimporthandler/src/webapp/admin/_info.jspdataimport.jsp
 /solr3_5/ssrc/solr/contrib/dataimporthandler/src/webapp/admin
 line 21JSP Problem
 Fragment _info.jsp was not found at expected
 path /solr3_5/ssrc/solr/contrib/dataimporthandler
 /src/webapp/admin/_info.jsp
 debug.jsp
 /solr3_5/ssrc/solr/contrib/dataimporthandler/src/webapp/admin
 line 19JSP Problem
 Named template dotdots is not available tabutils.xsl

 /solr3_5/ssrc/lucene/src/site/src/documentation/skins/common/xslt/html
   line 41XSL Problem
 Named template dotdots is not available tabutils.xsl
 /solr3_5/ssrc/solr/site-src/src/documentation/skins/common/xslt/html
   line 41XSL Problem
 Unhandled exception type Throwable  ping.jsp
 /solr3_5/WebContent/admin
   line 46JSP Problem
 Unhandled exception type Throwable  ping.jsp
 /solr3_5/ssrc/solr/webapp/web/admin

 line 46JSP Problem


 *Here are the warnings I got*

 DescriptionResourcePathLocationType
 Classpath entry
 /solr3_5/ssrc/lucene/contrib/benchmark/lib/commons-beanutils-1.7.0.jar will
 not be exported or published. Runtime ClassNotFoundExceptions may result.
 solr3_5P/solr3_5Classpath Dependency Validator Message
 Classpath entry
 /solr3_5/ssrc/lucene/contrib/benchmark/lib/commons-collections-3.1.jar will
 not be exported or published. Runtime ClassNotFoundExceptions may result.
 solr3_5P/solr3_5Classpath Dependency Validator Message
 Classpath entry