Re: Re: Config for massive inserts into Solr master

2016-10-09 Thread Reinhard Budenstecher
> > That's considerably larger than you initially indicated. In just one > index, you've got almost 300 million docs taking up well over 200GB. > About half of them have been deleted, but they are still there. Those > deleted docs *DO* affect operation and memory usage. > Yes, that's larger

Re: solr 5 leaving tomcat, will I be the only one fearing about this?

2016-10-09 Thread Shalin Shekhar Mangar
As far as configuration is concerned -- everything Solr specific goes to zookeeper. The solr.xml can also be put into zookeeper. JNDI is not supported -- can you explain why you need it? Can cluster properties solve the problem? or replica properties? Both of those can go into zookeeper.

Re: newSearcher autowarming queries in solrconfig.xml run but does not appear to warm cache

2016-10-09 Thread Dalton Gooding
Erick, I have tried tuning the queries with some limited success. I still get drastic differences between the first time I fire my warming query (after newSearcher ran query) and the second time, or any variant of the query i.e. removing fields or changing parameters, it runs much faster. I am

Re: solr 5 leaving tomcat, will I be the only one fearing about this?

2016-10-09 Thread Aristedes Maniatis
Although I don't like docker, I do make heavy use of saltstack with jails plus ZFS snapshots to shipping virtual machines around. Docker is mostly just a reinvention of BSD/Solaris jails/zones. You might prefer docker's own custom dockerfile language and I prefer python with salt. But

Re: Config for massive inserts into Solr master

2016-10-09 Thread Shawn Heisey
On 10/9/2016 1:59 PM, Reinhard Budenstecher wrote: > Solr 6.2.1 on Debian Jessie, installed with: > Actually, there are three cores and UI gives me following info: > Num Docs:148652589, Max Doc:298367634, Size:219.92 GB Num > Docs:37396140, Max Doc:38926989, Size:28.81 GB Num Docs:8601222Max >

Re: solr 5 leaving tomcat, will I be the only one fearing about this?

2016-10-09 Thread Georg Sorst
If you can, switch to Docker (https://hub.docker.com/_/solr/). It's a pain to get everything going the right way, but once it's running you get a lot of stuff for free: * Deployment, scaling etc. is all taken care of by the Docker ecosystem * Testing is a breeze. Need a clean Solr instance to run

Re: Re: Config for massive inserts into Solr master

2016-10-09 Thread Reinhard Budenstecher
> What version of Solr? How has it been installed and started? > Solr 6.2.1 on Debian Jessie, installed with: apt-get install openjdk-8-jre-headless openjdk-8-jdk-headless wget "http://www.eu.apache.org/dist/lucene/solr/6.2.1/solr-6.2.1.tgz; && tar xvfz solr-*.tgz

Re: Config for massive inserts into Solr master

2016-10-09 Thread Shawn Heisey
On 10/9/2016 12:33 PM, Reinhard Budenstecher wrote: > We have an ETL process which updates product catalog. This produces massive > inserts on MASTER, but there are no reads. Often there are thousands and > hundreds of thousands of records per minute that where inserted. But > sometimes I get a

Config for massive inserts into Solr master

2016-10-09 Thread Reinhard Budenstecher
Hello, I'm not a pro in Solr nor in Java, so please be patient. We have an ecommerce application with 150 millions docs and a size of 140GB in Solr. We are using the following setup: Solr "MASTER": - DELL R530, 1x XEON E5-1650 - 64GB ECC RAM - 4x 480GB SSD as RAID10 on hardware RAID (but no BBU

Re: Real Time Search and External File Fields

2016-10-09 Thread Shawn Heisey
On 10/8/2016 1:18 PM, Mike Lissner wrote: > I want to make sure I understand this properly and document this for > futurepeople that may find this thread. Here's what I interpret your > advice to be: > 0. Slacken my auto soft commit interval to something more like a minute. Yes, I would do this.

Re: configure solr kerberos with tomcat

2016-10-09 Thread Shawn Heisey
On 10/9/2016 2:14 AM, 李爽 wrote: > i wonder how to configre solr kerberos with tomcat, as in the tutorial > it shows the configuration procedure with default jetty server: > https://cwiki.apache.org/confluence/display/solr/Kerberos+Authentication+Plugin Since 5.0, Solr no longer officially

configure solr kerberos with tomcat

2016-10-09 Thread 李爽
hi, i wonder how to configre solr kerberos with tomcat, as in the tutorial it shows the configuration procedure with default jetty server: https://cwiki.apache.org/confluence/display/solr/Kerberos+Authentication+Plugin thanks.