Re: Solr cloud production set up

Hi Rajdeep, 1. I assume you had enabled docValues for the facet fields, right? 2. What does your GC logs tell? Do you get freezes and CPU spikes during intervals? 3. Caching will help in querying. I'll need to see a sample query of yours to recommend what you can tweak. On Tue,

Re: Solr cloud production set up

Hi Rajdeep, Unfortunately it's near impossible for anyone here to tell you what parameters to tweak. People might take guesses based on their individual past experience, but ultimately those are just guesses. There are just too many variables affecting Solr performance for anyone to have a good

Re: Solr cloud production set up

Please suggest anyone On Sun, 19 Jan, 2020, 9:43 AM Rajdeep Sahoo, wrote: > Apart from reducing no of facets in the query, is there any other query > params or gc params or heap space or anything else that we need to tweak > for improving search response time. > > On Sun, 19 Jan, 2020, 3:15 AM

Re: Solr cloud production set up

Apart from reducing no of facets in the query, is there any other query params or gc params or heap space or anything else that we need to tweak for improving search response time. On Sun, 19 Jan, 2020, 3:15 AM Erick Erickson, wrote: > Add =timing to the query and it’ll show you the time each

Re: Solr cloud production set up

Add =timing to the query and it’ll show you the time each component takes. > On Jan 18, 2020, at 1:50 PM, Rajdeep Sahoo wrote: > > Thanks for the suggestion, > > Is there any way to get the info which operation or which query params are > increasing the response time. > > > On Sat, 18 Jan,

Re: Solr cloud production set up

Thanks for the suggestion, Is there any way to get the info which operation or which query params are increasing the response time. On Sat, 18 Jan, 2020, 11:59 PM Dave, wrote: > If you’re not getting values, don’t ask for the facet. Facets are > expensive as hell, maybe you should think more

Re: Solr cloud production set up

If you’re not getting values, don’t ask for the facet. Facets are expensive as hell, maybe you should think more about your query’s than your infrastructure, solr cloud won’t help you at all especially if your asking for things you don’t need > On Jan 18, 2020, at 1:25 PM, Rajdeep Sahoo

Re: Solr cloud production set up

We have assigned 16 gb out of 24gb for heap . No other process is running on that node. 200 facets fields are there in the query but we will not be getting the values for each facets for every search. There can be max of 50-60 facets for which we will be getting values. We are using caching,is

Re: Solr cloud production set up

On 1/18/2020 10:09 AM, Rajdeep Sahoo wrote: We are having 2.3 million documents and size is 2.5 gb. 10 core cpu and 24 gb ram . 16 slave nodes. Still some of the queries are taking 50 sec at solr end. As we are using solr 4.6 . Other thing is we are having 200 (avg) facet fields in a

Re: Solr cloud production set up

Although we are having a avg of 200 facet fields in the search request all of them will not be having values in each request. Max of 50-60 facet fields will be having some value. And we are using function query,is it having some performance impact. On Sat, 18 Jan, 2020, 11:10 PM Walter

Re: Solr cloud production set up

For indexing, is the master node CPU around 90%? If not, you aren’t sending requests fast enough or your disk is slow. For querying, 200 facet fields is HUGE. That will take a lot of Java heap memory and will be slow. Each facet fields requires large in-memory arrays and sorting. wunder

Re: Solr cloud production set up

Hi shawn, Thanks for this info, Could you Please address my below query, We are having 2.3 million documents and size is 2.5 gb. With this data do we need solr cloud. 10 core cpu and 24 gb ram . 16 slave nodes. Still some of the queries are taking 50 sec at solr end. As we are using

Re: Solr cloud production set up

On 1/18/2020 9:55 AM, Rajdeep Sahoo wrote: We do parallel indexing in production, What about search performance in solr cloud in comparison with master slave. And what about block join performance in solr cloud. Do we need to increase the infra for solr cloud as we would be

Re: Solr cloud production set up

We are having 2.3 million documents and size is 2.5 gb. 10 core cpu and 24 gb ram . 16 slave nodes. Still some of the queries are taking 50 sec at solr end. As we are using solr 4.6 . Other thing is we are having 200 (avg) facet fields in a query. And 30 searchable fields. Is there any

Re: Solr cloud production set up

Agreed with the above. what’s your idea of “huge”? I have 600 ish gb in one core plus another 250x2 in two more on the same standalone solr instance and it runs more than fine > On Jan 18, 2020, at 11:31 AM, Shawn Heisey wrote: > > On 1/18/2020 1:05 AM, Rajdeep Sahoo wrote: >> Our Index size

Re: Solr cloud production set up

Hi shawn, Thanks for your reply We do parallel indexing in production, What about search performance in solr cloud in comparison with master slave. And what about block join performance in solr cloud. Do we need to increase the infra for solr cloud as we would be maintaining multiple

Re: Solr cloud production set up

On 1/18/2020 1:05 AM, Rajdeep Sahoo wrote: Our Index size is huge and in master slave the full indexing time is almost 24 hrs. In future the no of documents will increase. So,please some one recommend about the no of nodes and configuration like ram and cpu core for solr cloud. Indexing is

Re: Solr cloud production set up

Got your point. If we think about the infra, then in cloud do we need more infra in comparison to master slave. On Sat, 18 Jan, 2020, 2:24 PM Jörn Franke, wrote: > I think you should do your own measurements. This is very document and > processing specific. > You can run a test with a

Re: Solr cloud production set up

I think you should do your own measurements. This is very document and processing specific. You can run a test with a simple setup for let’s say 1 mio document and interpolate from this. It could be also that your ETL is the bottleneck and not Solr. At the same time you can simulate user

Re: Solr cloud production set up

How big? We index 35 million documents in about 6 hours. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Jan 18, 2020, at 12:05 AM, Rajdeep Sahoo > wrote: > > Our Index size is huge and in master slave the full indexing time is almost > 24 hrs. >

Re: Solr cloud production set up

Our Index size is huge and in master slave the full indexing time is almost 24 hrs. In future the no of documents will increase. So,please some one recommend about the no of nodes and configuration like ram and cpu core for solr cloud. On Sat, 18 Jan, 2020, 8:05 AM Walter Underwood, wrote: >

Re: Solr cloud production set up

Why do you want to change to Solr Cloud? Master/slave is a great, stable cluster architecture. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Jan 17, 2020, at 6:19 PM, Rajdeep Sahoo wrote: > > Please reply anyone > > On Sat, 18 Jan, 2020, 12:13

Re: Solr cloud production set up

Please reply anyone On Sat, 18 Jan, 2020, 12:13 AM Rajdeep Sahoo, wrote: > Hi all, > We are using solr cloud 7.7.1 > In a live production environment how many solr cloud server do we need, > Currently ,we are using master slave set up with 16 slave server with > solr 4.6. > In solr cloud do

Solr cloud production set up

Hi all, We are using solr cloud 7.7.1 In a live production environment how many solr cloud server do we need, Currently ,we are using master slave set up with 16 slave server with solr 4.6. In solr cloud do we need to scale it up or 16 server will suffice the purpose.

Best practice to deploy Solr to production

Hi all, I have a Solr index which has been evolving since Solr1.4 and now is in SolrCloud6.6. This cluster is composed of 4 servers, few collections and shards. Since first time I deployed to production in 2009 I am using the same approach to deploy. I think it's probably the time to review and

Re: Deploy Solr to production: best practices

mary objection to running Solr on Windows has little to do with the technology, it's mostly about cost.  You wouldn't want to run production Solr on a client OS like Windows 10.  The server operating systems usually add a significant cost to new hardware deployments. I think that NSSM is

Re: Deploy Solr to production: best practices

I recommend the “Taking Solr to Production” chapter in the official Solr reference guide. That was my first hit for “solr production” in Google. https://lucene.apache.org/solr/guide/6_6/taking-solr-to-production.html <https://lucene.apache.org/solr/guide/6_6/taking-solr-to-production.html&

Re: Deploy Solr to Production: guides, best practices

https://wiki.apache.org/solr/WhyNoWar Also, recent versions just don't build a war _for_ you. If you insist you can build your own war file by bundling up "the right stuff". However, there's no guarantee that you'll be able to do that going forward. I have to confess that I can't guarantee you

Re: Deploy Solr to Production: guides, best practices

Not a Windows user but you should be able to just install it and surf port 8983. Once installed it should show in services https://www.norconex.com/how-to-run-solr5-as-a-service-on-windows/ On 19 October 2017 at 07:18, maximka19 wrote: > Rick Leir-2 wrote > > Maximka >

Re: Deploy Solr to Production: guides, best practices

Rick Leir-2 wrote > Maximka > The app server is bundled in Solr, so you do not install Tomcat or JEtty > separately. > Cheers -- Rick Hi! So, what should I do to host it in Windows Server as service? In production. Thanks -- Sent from:

Re: Deploy Solr to Production: guides, best practices

troduced with Solr. Now I'm having troubles with taking Solr to >Production >under Windows Server. > >As You know, from Solr 5 there is no .WAR-file in package; I couldn't >deploy >Solr 7.1 to Tomcat 9. Didn't found any information, tutorials, guides >relevantly to new versions of

Deploy Solr to production: best practices

Hi everyone! I started learning full-text search engines and chosen Solr. I'm introduced with Solr, but now I'v having troubles to move Solr to production. *1.* Container: from Solr 5 there is now .WAR-file provided in package. I couldn't deploy Solr 7.1 to Tomcat 9. None of existing

Deploy Solr to Production: guides, best practices

Hi everyone! I was looking for full-text search engine and chosen Solr. Quickly introduced with Solr. Now I'm having troubles with taking Solr to Production under Windows Server. As You know, from Solr 5 there is no .WAR-file in package; I couldn't deploy Solr 7.1 to Tomcat 9. Didn't found any

Re: Solr to Production

om: Reth RM [mailto:reth.ik...@gmail.com] > Sent: Sunday, March 27, 2016 12:53 PM > To: solr-user@lucene.apache.org > Subject: Re: Solr to Production > > Is that website deployed on same machine where solr is running? If not, check > whether the port is being blocked due to f

RE: Solr to Production

, Adel Khalifa -Original Message- From: Reth RM [mailto:reth.ik...@gmail.com] Sent: Sunday, March 27, 2016 12:53 PM To: solr-user@lucene.apache.org Subject: Re: Solr to Production Is that website deployed on same machine where solr is running? If not, check whether the port is being

Re: Solr to Production

Is that website deployed on same machine where solr is running? If not, check whether the port is being blocked due to firewall protection. What is the response message that you are receiving? On Sun, Mar 27, 2016 at 3:16 PM, Adel Mohamed Khalifa < a.moha...@saudisoft.com> wrote: > Hello All,

Solr to Production

Hello All, I installed solr server on my Ubuntu and when I use it directly it runs good, but when I use it remotely using my website it doesnot run and I don't know what the reason, can you help me please. Regards, Adel Khalifa

Re: Send solr to Production

On 3/20/2016 5:39 AM, Adel Mohamed Khalifa wrote: > How I need to do or config for sending solr to production. This is an extremely vague question. When you say "config", this could mean the solr config, the core/collection config, the OS config, or possibly even something else.

Send solr to Production

Hello All, How I need to do or config for sending solr to production. Regards, Adel Khalifa

Taking Solr to production

indexing is once per day at around 50,000 documents per day (update & delete combined) This being said I was thinking I would take the Solr to production with, * 2 shards, 1 Leader & 3 Replicas * 2 solr instance per VM * 3 Zookeepers on the same machines as that

Re: Taking Solr to production

<aswath.sriniva...@toyota.com> wrote: >> * Totally about 2.5 million documents to be indexed >> * Documents average size is 512 KB - pdfs and htmls > >> This being said I was thinking I would take the Solr to production with, >> * 2 shar

Re: Taking Solr to production

s average size is 512 KB - pdfs and htmls > > > This being said I was thinking I would take the Solr to production with, > > * 2 shards, 1 Leader & 3 Replicas > > > Do you all think this set up will work? Will this server me 150 QPS? > > It certainly helps tha

Re: Taking Solr to production

Aswath Srinivasan (TMS) <aswath.sriniva...@toyota.com> wrote: > * Totally about 2.5 million documents to be indexed > * Documents average size is 512 KB - pdfs and htmls > This being said I was thinking I would take the Solr to production with, > * 2 sh

RE: Taking Solr to production

cannot thank you enough you guys!! Thank you, Aswath NS -Original Message- From: Jack Krupansky [mailto:jack.krupan...@gmail.com] Sent: Friday, January 22, 2016 3:06 PM To: solr-user@lucene.apache.org Subject: Re: Taking Solr to production "1 Leader & 3 Replicas" SolrCloud

Re: Taking Solr to production

> > Thank you, > Aswath NS > > > -Original Message- > From: Jack Krupansky [mailto:jack.krupan...@gmail.com] > Sent: Friday, January 22, 2016 3:06 PM > To: solr-user@lucene.apache.org > Subject: Re: Taking Solr to production > > "1 Leader & 3 Replica

Re: Indexing Solr in production

October 2015 at 09:35, Zheng Lin Edwin Yeo <edwinye...@gmail.com> > > wrote: > > > >> Hi, > >> > >> What is the best practice to do indexing in Solr for production > system.I'm > >> using Solr 5.3.0. > >> > >> I understand that p

Indexing Solr in production

Hi, What is the best practice to do indexing in Solr for production system.I'm using Solr 5.3.0. I understand that post.jar does not have things like robustness checks and retires, which is important in production, as sometimes certain records might failed during the indexing, and we need to re

Re: Indexing Solr in production

solr in a robust way. [1] https://cwiki.apache.org/confluence/display/solr/Client+APIs Cheers On 13 October 2015 at 09:35, Zheng Lin Edwin Yeo <edwinye...@gmail.com> wrote: > Hi, > > What is the best practice to do indexing in Solr for production system.I'm > using Solr 5.3.0

Re: Indexing Solr in production

ient+APIs > Cheers > > On 13 October 2015 at 09:35, Zheng Lin Edwin Yeo <edwinye...@gmail.com> > wrote: > >> Hi, >> >> What is the best practice to do indexing in Solr for production system.I'm >> using Solr 5.3.0. >> >> I understand

Re: Taking Solr to production with docker

o speak to > my > > > > > devops focussed colleague Chris Bradford that has a great deal of > > > > > experience here. I haven't encountered any issues that would lead > me > > to > > > > > describe it as "not ready for production" > > > > >

Re: Taking Solr to production with docker

> > > > are > > > > > > now hosted on docker (specifically kubernetes) > > > > > > > > > > > > It's worked pretty well. I'd suggest if you're curious to speak > to > > my > > > > > > devops focussed colleagu

Re: Taking Solr to production with docker

p://quepid.com > > > > ) > > > > > are > > > > > > now hosted on docker (specifically kubernetes) > > > > > > > > > > > > It's worked pretty well. I'd suggest if you're curious to speak > to > > my > >

Re: Taking Solr to production with docker

> On 23 Sep 2015, at 15:13, Upayavira wrote: > > I'm wondering if there's anything specific that is needed to run Solr > inside Docker? Is there something you have in mind? There isn't really. See https://hub.docker.com/r/makuk66/docker-solr/

Taking Solr to production with docker

Hi Solr community, I can find many blog posts on how to deploy Solr with docker but I am wondering if Solr/Docker is really ready for production. Has anybody ever ran Solr in production with Docker? Thank you for your feedback, Aurélien

Re: Taking Solr to production with docker

On Wed, Sep 23, 2015, at 02:00 PM, aurelien.mazo...@francelabs.com wrote: > Hi Solr community, > > I can find many blog posts on how to deploy Solr with docker but I am > wondering if Solr/Docker is really ready for production. > Has anybody ever ran Solr in production w

Re: Taking Solr to production with docker

Hi Solr community, > > > > I can find many blog posts on how to deploy Solr with docker but I am > > wondering if Solr/Docker is really ready for production. > > Has anybody ever ran Solr in production with Docker? > > Hi Aurelien, > > I'm wondering if there's a

Re: Taking Solr to production with docker

;> >> >> >> >> On Wed, Sep 23, 2015, at 02:00 PM, aurelien.mazo...@francelabs.com >> >> wrote: >> >> > Hi Solr community, >> >> > >> >> > I can find many blog posts on how to deploy Solr with docker but I am &g

Re: Taking Solr to production with docker

e: >> > Hi Solr community, >> > >> > I can find many blog posts on how to deploy Solr with docker but I am >> > wondering if Solr/Docker is really ready for production. >> > Has anybody ever ran Solr in production with Docker? >> >>

Re: Taking Solr to production with docker

mazo...@francelabs.com > >> wrote: > >> > Hi Solr community, > >> > > >> > I can find many blog posts on how to deploy Solr with docker but I am > >> > wondering if Solr/Docker is really ready for production. > >>

Re: Taking Solr to production with docker

Doug > > > > > > On Wednesday, September 23, 2015, Upayavira <u...@odoko.co.uk> wrote: > > > >> > >> > >> On Wed, Sep 23, 2015, at 02:00 PM, aurelien.mazo...@francelabs.com > >> wrote: > >> > Hi Solr community, >

Re: Taking Solr to production with docker

> Doug > > > > > > > > > > > > On Wednesday, September 23, 2015, Upayavira <u...@odoko.co.uk> wrote: > > > > > > > >> > > > >> > > > >> On Wed, Sep 23, 2015, at 02:00 PM, a

Re: Taking Solr to production with docker

>> > > >> > > >> On Wed, Sep 23, 2015, at 02:00 PM, aurelien.mazo...@francelabs.com > > >> wrote: > > >> > Hi Solr community, > > >> > > > >> > I can find many blog posts on how to deploy Solr with docker but I > am

Re: Taking Solr to production with docker

: > > > > > >> > > >> > > >> On Wed, Sep 23, 2015, at 02:00 PM, aurelien.mazo...@francelabs.com > > >> wrote: > > >> > Hi Solr community, > > >> > > > >> > I can find many blog posts on how to deploy Solr with

Re: Taking Solr to production with docker

ction" > > > > > > > > Doug > > > > > > > > > > > > On Wednesday, September 23, 2015, Upayavira <u...@odoko.co.uk> wrote: > > > > > > > >> > > > >> > > > >> On Wed,

Re: SOLR in Production

AA machine is ok. Maybe SolrCloud is also a good choice for this. -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-in-Production-tp4143496p4146972.html Sent from the Solr - User mailing list archive at Nabble.com.

Tomcat or Jetty to use with solr in production ?

.nabble.com/Tomcat-or-Jetty-to-use-with-solr-in-production-tp4144712.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Tomcat or Jetty to use with solr in production ?

the complexity's with tomcat and jetty in future, as i want to cluster with huge data on solr. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Tomcat-or-Jetty-to-use-with-solr-in-production-tp4144712.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Tomcat or Jetty to use with solr in production ?

-- View this message in context: http://lucene.472066.n3.nabble.com/Tomcat-or-Jetty-to-use-with-solr-in-production-tp4144712.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Tomcat or Jetty to use with solr in production ?

with huge data on solr. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Tomcat-or-Jetty-to-use-with-solr-in-production-tp4144712.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Tomcat or Jetty to use with solr in production ?

the complexity's with tomcat and jetty in future, as i want to cluster with huge data on solr. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Tomcat-or-Jetty-to-use-with-solr-in-production-tp4144712.html Sent from the Solr - User mailing list archive

SOLR in Production

Hi, We are planning to move solr for Production Environment. I like to get some real time experience or checklist to take care. We have 1 instance of Solr with 2 Cores. What should be taken care in case of the solr instance is down? What I have to do , if I have 2 instances, the first one

Re: SOLR in Production

back. On Mon, Jun 23, 2014 at 11:51 PM, EXTERNAL Taminidi Ravi (ETI, Automotive-Service-Solutions) external.ravi.tamin...@us.bosch.com wrote: Hi, We are planning to move solr for Production Environment. I like to get some real time experience or checklist to take care. We have 1 instance

Setting up solr on production server

Hi, I 'm looking for some tips or guidelines to installing solr on the production server. I am currently using jetty in my dev environment. Is it recommended to use tomcat on the production server? Are there are major advantages of using one over another. Thanks J

RE: Setting up solr on production server

on production server Hi, I 'm looking for some tips or guidelines to installing solr on the production server. I am currently using jetty in my dev environment. Is it recommended to use tomcat on the production server? Are there are major advantages of using one over another. Thanks J [Aspire Systems

Re: Setting up solr on production server

On 2/20/2014 10:40 PM, Jay Potharaju wrote: I 'm looking for some tips or guidelines to installing solr on the production server. I am currently using jetty in my dev environment. Is it recommended to use tomcat on the production server? Are there are major advantages of using one over

Solr in production env.

Hello, I almost convinced my boss to use Solr in production for a new project and hopefully for lots of following projects but I'm a bit confused that there is no release available for download. Is Solr still in a beta state, are there solr servers in production. Is it recommendable to use

Re: Solr in production env.

I know about a number of production installations. I even know of a company which mere existence is based partly on Solr. :) There is also a public list of production installations available on the homepage and/or Wiki. Eivind