complete cluster shutdown
I have 5 zookeeper and 2 solr machines and after a month or two whole clustre shutdown i dont know why. The logs i get in zookeeper are attached below. otherwise i dont get any error. All this is based on linux VM. 2016-03-11 16:50:18,159 [myid:5] - WARN [SyncThread:5:FileTxnLog@334] - fsync-ing the write ahead log in SyncThread:5 took 7268ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide 2016-03-11 16:50:18,161 [myid:5] - WARN [NIOServerCxn.Factory: 0.0.0.0/0.0.0.0:2185:NIOServerCnxn@357] - caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x4535f00ee370001, likely client has closed socket at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) at java.lang.Thread.run(Thread.java:745) 2016-03-11 16:50:18,163 [myid:5] - INFO [NIOServerCxn.Factory: 0.0.0.0/0.0.0.0:2185:NIOServerCnxn@1007] - Closed socket connection for client /localhost which had sessionid 0x4535f00ee370001 2016-03-11 16:50:18,166 [myid:5] - WARN [NIOServerCxn.Factory: 0.0.0.0/0.0.0.0:2185:NIOServerCnxn@357] - caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x2535ef744dd0005, likely client has closed socket at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) at java.lang.Thread.run(Thread.java:745)
Overseer Queues of zookeeper
how to delete overseer queues of zookeeper
error in initializing solrconfig.xml
i have 2 running solr nodes in my cluster one node hot down. i restarted tomcat server and its throughing exception for initializing solrconfig.xml and didnot recognize collection
Re: how to add new node in sole cloud cluster
i have 2 nodes where one got down and after restarting the server it shows error in initializing solrconfig.xml On Thu, Jan 14, 2016 at 12:45 PM, Zap Org wrote: > in running solr cloud cluster how to add new node without disturbing the > running cluster >
how to add new node in sole cloud cluster
in running solr cloud cluster how to add new node without disturbing the running cluster
Re: Solrcloud for Java 1.6
hello shawn yes it is written in a style readble with java 7 what i have done is, altered the syntax into java 6 and then compile and it is 100% working. if you need, i can send you the jar. On Fri, Jan 8, 2016 at 11:59 AM, Shawn Heisey wrote: > On 1/7/2016 10:59 PM, Zap Org wrote: > > i have solr5.0.0 installed in one machine with JVM specs java 1.7 32GB > RAM > > now from another machine i am sending query request to this machine with > > specs JAVA 1.6 > > so what really happening solr5.0.0 (1.7) is communicating with > > solrj5.0.0(1.6) > > The system with SolrJ 5.0.0 must have a newer Java version installed. > It is simply not possible to run Solr or SolrJ 5.0.0 with Java 6. > > If you attempt to run version 4.8 or later with Java 6, you'll get an > error that looks like this: > > Exception in thread "main" java.lang.UnsupportedClassVersionError: > org/apache/solr/xxx/yyy: Unsupported major.minor version 51.0 > > Here is some information about what the specific major.minor version > number means: > > http://stackoverflow.com/a/11432195 > > Just for giggles, I attempted to compile SolrJ (which is a standalone > module not dependent on the rest of Solr) in the branch_5x checkout with > the build script changed to produce jars compatible with version 1.6. > It would not compile when the target was set to 1.6, because the way the > code is written *requires* Java 7, and has since version 4.8. > > Thanks, > Shawn > >
Re: Solr search and index rate optimization
thanks for replying currently my machine specs are 32 GB RAM 4 core processor windows server 2008 64bit 500 GB HD 16 GB swap memorey now the already running machine with cpu usage not more than 10% already consumed all the RAM and now started to use swap memorey what my guess is my server will chok when swap memorey will end. i am only running solr and ZK instances there any wild idea what is happening and why memorey consumption is too high. all the field cache and query caches are set to 1GB in solrconfig and along with serving queries i am running delta after every 15 minute. On Fri, Jan 8, 2016 at 3:40 PM, Toke Eskildsen wrote: > On Fri, 2016-01-08 at 10:55 +0500, Zap Org wrote: > > i wanted to ask that i need to index after evey 15 min with hard commit > > (real time records) and currently have 5 zookeeper instances and 2 solr > > instances in one machine serving 200 users with 32GB RAM. whereas i > wanted > > to serve more than 10,000 users so what should be my machine specs and > what > > should be my architecture for this much serve rate along with index rate. > > It depends on your system and if we were forced to guess, our guess > would be very loose. > > > Fortunately you do have a running system with real queries: Make a copy > on two similar machines (you will probably need more hardware anyway) > and simulate growing traffic, measuring response times at appropriate > points: 200 users, 500, 1000, 2000 etc. > > If you are very lucky, your current system scales all the way. If not, > you should have enough data to make an educated guess of the amount of > machines you need. You should have at least 3 measuring point to > extrapolate from as scaling is not always linear. > > - Toke Eskildsen, State and University Library, Denmark > > >
Re: Solr search and index rate optimization
hello dear thanks for replying it means 3 ZK instances are more than enough in my case On Fri, Jan 8, 2016 at 10:07 PM, Erick Erickson wrote: > Here's a longer form of Toke's answer: > > https://lucidworks.com/blog/2012/07/23/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/ > > BTW, on the surface, having 5 ZK nodes isn't doing you any real good. > Zookeeper isn't really involved in serving queries or handling > updates, it's purpose is to have the state of the cluster (nodes up, > recovering, down, etc) and notify Solr listeners when that state > changes. There's no good reason to have 5 with a small cluster and by > "small" I mean < 100s of nodes. > > Best, > Erick > > On Fri, Jan 8, 2016 at 2:40 AM, Toke Eskildsen > wrote: > > On Fri, 2016-01-08 at 10:55 +0500, Zap Org wrote: > >> i wanted to ask that i need to index after evey 15 min with hard commit > >> (real time records) and currently have 5 zookeeper instances and 2 solr > >> instances in one machine serving 200 users with 32GB RAM. whereas i > wanted > >> to serve more than 10,000 users so what should be my machine specs and > what > >> should be my architecture for this much serve rate along with index > rate. > > > > It depends on your system and if we were forced to guess, our guess > > would be very loose. > > > > > > Fortunately you do have a running system with real queries: Make a copy > > on two similar machines (you will probably need more hardware anyway) > > and simulate growing traffic, measuring response times at appropriate > > points: 200 users, 500, 1000, 2000 etc. > > > > If you are very lucky, your current system scales all the way. If not, > > you should have enough data to make an educated guess of the amount of > > machines you need. You should have at least 3 measuring point to > > extrapolate from as scaling is not always linear. > > > > - Toke Eskildsen, State and University Library, Denmark > > > > >
Re: Solrcloud for Java 1.6
i have solr5.0.0 installed in one machine with JVM specs java 1.7 32GB RAM now from another machine i am sending query request to this machine with specs JAVA 1.6 so what really happening solr5.0.0 (1.7) is communicating with solrj5.0.0(1.6) provide your architecture detail ill further explain it On Fri, Jan 8, 2016 at 10:54 AM, Aswath Srinivasan (TMS) < aswath.sriniva...@toyota.com> wrote: > Thanks for the responses guys. > > >> i have solrj5 client for 1.7 converted into 1.6 > > Can you please explain this part with little more details? > > Thank you, > Aswath NS > > > -Original Message- > From: Aswath Srinivasan (TMS) [mailto:aswath.sriniva...@toyota.com] > Sent: Thursday, January 07, 2016 9:51 PM > To: solr-user@lucene.apache.org > Subject: RE: Solrcloud for Java 1.6 > > Thanks for the responses guys. > > >> i have solrj5 client for 1.7 converted into 1.6 > > Can you please explain in part with little more details? > > Thank you, > Aswath NS > > -Original Message- > From: Zap Org [mailto:zapor...@gmail.com] > Sent: Thursday, January 07, 2016 9:44 PM > To: solr-user@lucene.apache.org > Subject: Re: Solrcloud for Java 1.6 > > i have solrj5 client for 1.7 converted into 1.6 and solr instances running > with 1.7. I am connecting solrj (1.6) wit solr instances(1.7) on two > different machines > > On Fri, Jan 8, 2016 at 8:26 AM, wrote: > > > Run it on 2 separate boxes > > > > Bill Bell > > Sent from mobile > > > > > > > On Jan 7, 2016, at 3:11 PM, Aswath Srinivasan (TMS) < > > aswath.sriniva...@toyota.com> wrote: > > > > > > Hi fellow developers, > > > > > > I have a situation where the search front-end application is using > > > java > > 1.6. Upgrading Java version is out of the question. > > > > > > Planning to use Solrcloud 5.x version for the search implementation. > > > The > > show stopper here is, solrj for solrcloud needs atleast java1.7 > > > > > > What best can be done to use the latest version of solrcloud and > > > solrj > > for a portal that runs on java 1.6? > > > > > > I was thinking, in solrj, instead of using zookeeper (which also > > > acts as > > the load balancer) I can mention the exact replica's > > http://solr-cloud-HOST:PORT pairs using some kind of round-robin with > > some external load balancer. > > > > > > Any suggestion is highly appreciated. > > > > > > Aswath NS > > > > > >
Solr search and index rate optimization
i wanted to ask that i need to index after evey 15 min with hard commit (real time records) and currently have 5 zookeeper instances and 2 solr instances in one machine serving 200 users with 32GB RAM. whereas i wanted to serve more than 10,000 users so what should be my machine specs and what should be my architecture for this much serve rate along with index rate. my index size is 30GB increases gradually. Thankyou in advance and i am newbee hoping to get response
Re: Solrcloud for Java 1.6
i have solrj5 client for 1.7 converted into 1.6 and solr instances running with 1.7. I am connecting solrj (1.6) wit solr instances(1.7) on two different machines On Fri, Jan 8, 2016 at 8:26 AM, wrote: > Run it on 2 separate boxes > > Bill Bell > Sent from mobile > > > > On Jan 7, 2016, at 3:11 PM, Aswath Srinivasan (TMS) < > aswath.sriniva...@toyota.com> wrote: > > > > Hi fellow developers, > > > > I have a situation where the search front-end application is using java > 1.6. Upgrading Java version is out of the question. > > > > Planning to use Solrcloud 5.x version for the search implementation. The > show stopper here is, solrj for solrcloud needs atleast java1.7 > > > > What best can be done to use the latest version of solrcloud and solrj > for a portal that runs on java 1.6? > > > > I was thinking, in solrj, instead of using zookeeper (which also acts as > the load balancer) I can mention the exact replica's > http://solr-cloud-HOST:PORT pairs using some kind of round-robin with > some external load balancer. > > > > Any suggestion is highly appreciated. > > > > Aswath NS > > >
