Solr missing mandatory uniqueKey field: id or Unknown field

[sthita]

I am using solr 8.1.1

Created core/collection. Then after update schema & solrconfig i am getting
these errors. 
Before adding id field to schema.xml
 
After adding id field on schema.xml 
 

Here are my schema.xml & solrconfig.xml, what is wrong i am doing ?

schema.xml : 






title





solrconfig: 




 
${tests.luceneMatchVersion:LUCENE_CURRENT}
  

  


  ${solr.ulog.dir:}
  

  
${solr.autoCommit.maxTime:15000} 
   false 


  
${solr.autoSoftCommit.maxTime:-1} 
 
   

  

  

  
  /select
  title:*
  
  server-enabled.txt
  

  

  

  

true
 
   



--
Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr went on recovery multiple time.

[sthita]

After changing zookeeper time out from 10sec to 45/50 sec and monitoring for
a long time i can observe servers went on recovery multiple times, but the
Exceptions are some what different : 

 INFO  - 2015-04-22 09:02:47.943;
org.apache.solr.common.cloud.ConnectionManager; Watcher
org.apache.solr.common.cloud.ConnectionManager@6ad2b64e
name:ZooKeeperConnection
Watcher:bot1:2181,bot2:2181,bot3:2181,bot4:2181,bot5:2181 got event
WatchedEvent state:SyncConnected type:None path:null path:null type:None
INFO  - 2015-04-22 09:02:47.944;
org.apache.solr.common.cloud.ConnectionManager; Client is connected to
ZooKeeper
INFO  - 2015-04-22 09:02:47.944;
org.apache.solr.common.cloud.ConnectionManager$1; Connection with ZooKeeper
reestablished.
WARN  - 2015-04-22 09:02:47.944; org.apache.solr.cloud.RecoveryStrategy;
Stopping recovery for
zkNodeName=searcher1.abc:8980_solr_dict_en_shard1_replica4core=dict_en_shard1_replica4
WARN  - 2015-04-22 09:02:47.944; org.apache.solr.cloud.RecoveryStrategy;
Stopping recovery for
zkNodeName=searcher1.abc:8980_solr_dict_cn_shard1_replica2core=dict_cn_shard1_replica2
WARN  - 2015-04-22 09:02:47.944; org.apache.solr.cloud.RecoveryStrategy;
Stopping recovery for
zkNodeName=searcher1.abc:8980_solr_dict_hk_shard1_replica4core=dict_hk_shard1_replica4
WARN  - 2015-04-22 09:02:47.944; org.apache.solr.cloud.RecoveryStrategy;
Stopping recovery for
zkNodeName=searcher1.abc:8980_solr_dict_jp_shard1_replica3core=dict_jp_shard1_replica3
WARN  - 2015-04-22 09:02:47.945; org.apache.solr.cloud.RecoveryStrategy;
Stopping recovery for
zkNodeName=searcher1.abc:8980_solr_dict_vn_shard1_replica3core=dict_vn_shard1_replica3
WARN  - 2015-04-22 09:02:47.945; org.apache.solr.cloud.RecoveryStrategy;
Stopping recovery for
zkNodeName=searcher1.abc:8980_solr_dict_th_shard1_replica3core=dict_th_shard1_replica3
WARN  - 2015-04-22 09:02:47.945; org.apache.solr.cloud.RecoveryStrategy;
Stopping recovery for
zkNodeName=searcher1.abc:8980_solr_dict_nl_shard1_replica2core=dict_nl_shard1_replica2
INFO  - 2015-04-22 09:02:47.945; org.apache.solr.cloud.ZkController;
publishing core=rn0 state=down
INFO  - 2015-04-22 09:02:47.945; org.apache.solr.cloud.ZkController;
numShards not found on descriptor - reading it from system property
INFO  - 2015-04-22 09:02:47.951;
org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
config:maxConnections=128maxConnectionsPerHost=32followRedirects=false


ERROR - 2015-04-22 09:02:48.010; org.apache.solr.common.SolrException;
:org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for /overseer/queue/qn-
at
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:218)
at
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:215)
at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at
org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:215)
at
org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:284)
at
org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:271)
at
org.apache.solr.cloud.ZkController.publish(ZkController.java:1011)
at org.apache.solr.cloud.ZkController.publish(ZkController.java:976)
at
org.apache.solr.handler.admin.CoreAdminHandler$2.run(CoreAdminHandler.java:811)

INFO  - 2015-04-22 09:02:48.010;
org.apache.solr.update.DefaultSolrCoreState; Running recovery - first
canceling any ongoing recovery
INFO  - 2015-04-22 09:02:48.012; org.apache.solr.cloud.RecoveryStrategy;
Starting recovery process.  core=rn0 recoveringAfterStartup=false
INFO  - 2015-04-22 09:02:48.016; org.apache.solr.cloud.ZkController;
publishing core=rn0 state=recovering
INFO  - 2015-04-22 09:02:48.017; org.apache.solr.cloud.ZkController;
numShards not found on descriptor - reading it from system property
INFO  - 2015-04-22 09:02:48.020;
org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
config:maxConnections=128maxConnectionsPerHost=32followRedirects=false




--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-went-on-recovery-multiple-time-tp4196249p4201508.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr went on recovery multiple time.

[sthita]

Hi Bill, My index size is around 48GB and contains around 8 million
documents. 



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-went-on-recovery-multiple-time-tp4196249p4196504.html
Sent from the Solr - User mailing list archive at Nabble.com.

Solr went on recovery multiple time.

[sthita]

Solr server crashes 2-3 times a day .  When i looked into log i can see some
recovery failure. 

I got these errors on my solr log

WARN  - 2015-03-30 16:03:51.137; org.apache.solr.cloud.RecoveryStrategy;
Stopping recovery for zkNodeName=searcher:8980_solr_rn0core=rn0
ERROR - 2015-03-30 16:03:56.121; org.apache.solr.update.UpdateLog; Error
inspecting tlog tlog{file=/solr/rn0/data/tlog/tlog.709
refcount=2}
ERROR - 2015-03-30 16:03:56.121; org.apache.solr.update.UpdateLog; Error
inspecting tlog tlog{file=/solr/rn0/data/tlog/tlog.710
refcount=2}
WARN  - 2015-03-30 16:04:00.242; org.apache.solr.core.SolrCore; [rn0]
PERFORMANCE WARNING: Overlapping onDeckSearchers=2

I googled so many places, suggestions are related to my commit . 

My commit configuration on solrconfig.xml : 


updateHandler class=solr.DirectUpdateHandler2

autoCommit
maxTime60/maxTime
openSearcherfalse/openSearcher
/autoCommit 

updateLog
str name=dir${solr.data.dir:}/str
/updateLog
/updateHandler


Why is it happening ? Any idea/solution will be appreciated. 





--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-went-on-recovery-multiple-time-tp4196249.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr went on recovery multiple time.

[sthita]

Thanks Erick for the reply. These are the configurations.

1.Solr servers count : 4 (1 master , 3 slaves)
2.My initial and maximum memory allocations to each solr servers are :
-Xms5g 
-Xmx6g
3. 5 running zookeepers 
4. My index size in each solr server around: 48GB
5. Every sec merger add/delete 500 docs to/from solr

yes, i checked the the ZK config timeout is 10sec. I will increase the
timeout to 45sec, Hope that will help. 

ZK config : 

# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5







--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-went-on-recovery-multiple-time-tp4196249p4196450.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Unable to setup solr cloud with multiple collections.

[sthita]

Thanks Erick for your reply.
I am trying to create a new core i.e dict_cn , which is totally different in
terms of index data, configs etc from the existing core abc. 
The core is created successfully in my master (i.e mail) and i can do solr
query on this newly created core .
All the config files(Schema.xml and solrconfig.xml) are in mail server and
zookeper helps it for me to share all config files to other collections.
I did the similar setup to other collection , so that newly created core
should be available to all the collections, but it is still showing down.




--
View this message in context: 
http://lucene.472066.n3.nabble.com/Unable-to-setup-solr-cloud-with-multiple-collections-tp4194833p4195078.html
Sent from the Solr - User mailing list archive at Nabble.com.

Unable to setup solr cloud with multiple collections.

[sthita]

I have newly created a new collection and activated the replication for 4
nodes(Including masters). 
After doing the config changes as suggested on 
http://wiki.apache.org/solr/SolrReplication
http://wiki.apache.org/solr/SolrReplication  
The nodes of the newly created collections are down on solr cloud. We are
not able to add or remove any document on newly created core i.e dict_cn in
our case. All the configuration files  look ok on solr cloud

http://lucene.472066.n3.nabble.com/file/n4194833/solr_issue.png 

This is my replication changes on solrconfig.xml

requestHandler name=/replication class=solr.ReplicationHandler
startup=lazy
lst name=master str name=replicateAftercommit/str str
name=replicateAfterstartup/str 
str name=confFilessolrconfig_cn.xml,schema_cn.xml/str /lst 

lst name=slave str name=masterUrlhttp://mail:8983/solr/dict_cn/str 
/lst   

Note: I am using solr 4.4.0, zookeeper-3.4.5

Can anyone help me on this ?



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Unable-to-setup-solr-cloud-with-multiple-collections-tp4194833.html
Sent from the Solr - User mailing list archive at Nabble.com.

Issue while enabling clustering/integrating carrot2 with solr 4.4.0 and tomact under ubuntu

[sthita]

1.My solr.xml

?xml version=1.0 encoding=UTF-8 ?
solr persistent=true sharedLib=/solr/lib
cores defaultCoreName=rn0  hostContext=/solr adminPath=/admin/cores 
hostPort=8980
core schema=schema.xml shard=shard1 instanceDir=rn0/ name=rn0
config=solrconfig.xml collection=rn/   
..
..
  /cores
/solr


2.My solrconfig.xml changes for carrot2 integrate 

searchComponent
class=org.apache.solr.handler.clustering.ClusteringComponent 
enable=${solr.clustering.enabled:false} name=clustering
   lst name=engine
 str name=namedefault/str
 str
name=carrot.algorithmorg.carrot2.clustering.lingo.LingoClusteringAlgorithm/str
 str name=LingoClusteringAlgorithm.desiredClusterCountBase20/str
   /lst
 /searchComponent

requestHandler name=/clustering startup=lazy
enable=${solr.clustering.enabled:false} class=solr.SearchHandler
.
.
.
.
/requestHandler

lib dir=/solr/lib regex=.*\.jar /


3.Copied all the required jars to /solr/lib folder those are
solr-clustering-4.4.0.jar
carrot2-mini-3.6.2.jar
hppc-0.4.1.jar
jackson-core-asl-1.7.4.jar
jackson-mapper-asl-1.7.4.jar
mahout-collections-1.0.jar
mahout-math-0.6.jar
simple-xml-2.6.4.jar

4.created a file named setenv.sh under /usr/share/tomcat/bin/  with
clustering enabled

CATALINA_OPTS = -Dsolr.clustering.enabled=true
 
 5.Restarted tomcat and

I am getting the following  error while starting solr server after
-Dsolr.clustering.enabled=true on CATALINA_OPTS

ERROR org.apache.solr.servlet.SolrDispatchFilter –
null:org.apache.solr.common.SolrException: SolrCore 'rn0' is not available
due to init f
ailure: Error Instantiating SearchComponent,
org.apache.solr.handler.clustering.ClusteringComponent failed to instantiate
org.apache.solr.handler.component.SearchCompon
ent
at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:860)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:251)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:936)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: Error Instantiating
SearchComponent, org.apache.solr.handler.clustering.ClusteringComponent
failed to instantiate org.a
pache.solr.handler.component.SearchComponent
at org.apache.solr.core.SolrCore.(SolrCore.java:835)
at org.apache.solr.core.SolrCore.(SolrCore.java:629)
at
org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:622)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:657)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:364)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:1)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
... 3 more
Caused by: org.apache.solr.common.SolrException: Error Instantiating
SearchComponent, org.apache.solr.handler.clustering.ClusteringComponent
failed to instantiate org.apache.solr.handler.component.SearchComponent
at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:551)
at org.apache.solr.core.SolrCore.createInitInstance(SolrCore.java:586)
at org.apache.solr.core.SolrCore.initPlugins(SolrCore.java:2173)
at org.apache.solr.core.SolrCore.initPlugins(SolrCore.java:2167)
at org.apache.solr.core.SolrCore.initPlugins(SolrCore.java:2200)
at org.apache.solr.core.SolrCore.loadSearchComponents(SolrCore.java:1231)
at org.apache.solr.core.SolrCore.(SolrCore.java:767)
... 11 more
Caused by: java.lang.ClassCastException: class
org.apache.solr.handler.clustering.ClusteringComponent
at java.lang.Class.asSubclass(Class.java:3208)
at

Issue while enabling clustering/integrating carrot2 with solr 4.4.0 and tomact under ubuntu

[sthita]

1.My solr.xml 

?xml version=1.0 encoding=UTF-8 ? 
solr persistent=true sharedLib=/solr/lib
cores defaultCoreName=rn0  hostContext=/solr adminPath=/admin/cores 
hostPort=8980
core schema=schema.xml shard=shard1 instanceDir=rn0/ name=rn0
config=solrconfig.xml collection=rn/
.. 
.. 
  /cores
/solr


2.My solrconfig.xml changes for carrot2 integrate 

searchComponent
class=org.apache.solr.handler.clustering.ClusteringComponent 
enable=${solr.clustering.enabled:false} name=clustering
   lst name=engine
 str name=namedefault/str
 str
name=carrot.algorithmorg.carrot2.clustering.lingo.LingoClusteringAlgorithm/str
 str name=LingoClusteringAlgorithm.desiredClusterCountBase20/str
   /lst
 /searchComponent

requestHandler name=/clustering startup=lazy
enable=${solr.clustering.enabled:false} class=solr.SearchHandler
. 
. 
. 
. 
/requestHandler

lib dir=/solr/lib regex=.*\.jar /


3.Copied all the required jars to /solr/lib folder those are 
solr-clustering-4.4.0.jar 
carrot2-mini-3.6.2.jar 
hppc-0.4.1.jar 
jackson-core-asl-1.7.4.jar 
jackson-mapper-asl-1.7.4.jar 
mahout-collections-1.0.jar 
mahout-math-0.6.jar 
simple-xml-2.6.4.jar 

4.created a file named setenv.sh under /usr/share/tomcat/bin/  with
clustering enabled 

CATALINA_OPTS = -Dsolr.clustering.enabled=true 
  
 5.Restarted tomcat and 

I am getting the following  error while starting solr server after
-Dsolr.clustering.enabled=true on CATALINA_OPTS 

ERROR org.apache.solr.servlet.SolrDispatchFilter –
null:org.apache.solr.common.SolrException: SolrCore 'rn0' is not available
due to init f 
ailure: Error Instantiating SearchComponent,
org.apache.solr.handler.clustering.ClusteringComponent failed to instantiate
org.apache.solr.handler.component.SearchCompon 
ent 
at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:860) 
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:251)
 
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
 
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
 
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
 
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
 
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
 
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171) 
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99) 
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:936) 
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
 
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407) 
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004)
 
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
 
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
 
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
at java.lang.Thread.run(Thread.java:745) 
Caused by: org.apache.solr.common.SolrException: Error Instantiating
SearchComponent, org.apache.solr.handler.clustering.ClusteringComponent
failed to instantiate org.a 
pache.solr.handler.component.SearchComponent 
at org.apache.solr.core.SolrCore.(SolrCore.java:835) 
at org.apache.solr.core.SolrCore.(SolrCore.java:629) 
at
org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:622) 
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:657) 
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:364) 
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:1) 
at java.util.concurrent.FutureTask.run(FutureTask.java:262) 
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) 
at java.util.concurrent.FutureTask.run(FutureTask.java:262) 
... 3 more 
Caused by: org.apache.solr.common.SolrException: Error Instantiating
SearchComponent, org.apache.solr.handler.clustering.ClusteringComponent
failed to instantiate org.apache.solr.handler.component.SearchComponent 
at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:551) 
at org.apache.solr.core.SolrCore.createInitInstance(SolrCore.java:586) 
at org.apache.solr.core.SolrCore.initPlugins(SolrCore.java:2173) 
at org.apache.solr.core.SolrCore.initPlugins(SolrCore.java:2167) 
at org.apache.solr.core.SolrCore.initPlugins(SolrCore.java:2200) 
at org.apache.solr.core.SolrCore.loadSearchComponents(SolrCore.java:1231) 
at org.apache.solr.core.SolrCore.(SolrCore.java:767) 
... 11 more 
Caused by: java.lang.ClassCastException: class
org.apache.solr.handler.clustering.ClusteringComponent 
at