Re: Tuning for 500+ field schemas

2020-03-18 Thread Tim Robertson
> Erick > > On Wed, Mar 18, 2020, 12:04 Edward Ribeiro > wrote: > > > What are your hard and soft commit settings? This can have a large > > impact on the writing throughput. > > > > Best, > > Edward > > > > On Wed, Mar 18, 2020 at 11:43 AM Tim Ro

Re: Tuning for 500+ field schemas

2020-03-18 Thread Tim Robertson
f fields and/or many > rows, this shouldn’t run “for many minutes”, but it’s something to look for. > > When this happens, what is your query response time like? I’m assuming > it’s very slow. > > But these are all shots in the dark, some thread dumps would be where I’d > start. &g

Tuning for 500+ field schemas

2020-03-18 Thread Tim Robertson
Hi all We load Solr (8.4.1) from Spark and are trying to grow the schema with some dynamic fields that will result in around 500-600 indexed fields per doc. Currently, we see ~300 fields/doc work very well into an 8-node Solr cluster with CPU nicely balanced across a cluster and we saturate our n

Re: Indexing 700 docs per second

2016-04-19 Thread Tim Robertson
Hi Mark, We were putting in and updating docs of around 20-25 indexed fields (mainly INTs, but some Strings and multivalue fields) at >1000/sec on far lesser hardware and a total of 600 million docs (batch updates of course) while also serving live queries for a website which had about 30 concurre

Re: Multiple schemas?

2008-03-27 Thread tim robertson
Thanks all, for the answers On Thu, Mar 27, 2008 at 10:04 PM, Yonik Seeley <[EMAIL PROTECTED]> wrote: > On Thu, Mar 27, 2008 at 4:56 PM, Otis Gospodnetic > <[EMAIL PROTECTED]> wrote: > > Or use the JNDI approach that's described on the Wiki. I've used it > with Jetty and it works nicely. Multip

Re: size limitation when adding document?

2008-03-27 Thread tim robertson
Today I added a single 9gig tab file into solr, with the resulting index being 16gig.3 hours to load and is performing mightily fine (jvm -Xmx3G) On Thu, Mar 27, 2008 at 7:08 PM, Yonik Seeley <[EMAIL PROTECTED]> wrote: > On Thu, Mar 27, 2008 at 1:21 PM, Andrew Tan <[EMAIL PROTECTED]> > wrote: >

Multiple schemas?

2008-03-27 Thread tim robertson
Hi, Would I be correct in thinking that for each schema I want, I need a new SOLR instance running? Thanks Tim

Re: What are the limits? Billions of records anyone?

2008-03-25 Thread tim robertson
Thanks Yonik, I will give it a play when I get some time and write back. Tim On Tue, Mar 25, 2008 at 1:21 AM, Yonik Seeley <[EMAIL PROTECTED]> wrote: > On Mon, Mar 24, 2008 at 5:30 PM, tim robertson > <[EMAIL PROTECTED]> wrote: > > Is there any documentation o

What are the limits? Billions of records anyone?

2008-03-24 Thread tim robertson
Hi all, I have just got a SOLR index working for the first time on a few 100,000 records from a custom database dump, and the results are very impressive, both in the speed it indexes (even on my macbook) and the response times. If I want to index "what, where(grid based to 0.1 degree cells), when

Re: missing content stream - simple tab file

2008-03-24 Thread tim robertson
Thanks, You are correct... ' ' around the URL solved it - schoolboy error thanks Tim On Mon, Mar 24, 2008 at 9:48 PM, Chris Hostetter <[EMAIL PROTECTED]> wrote: > > Tim: double check that solr-user mail isn't showing up in your spam > folder, you may need to whitelist it since it identifies i

Fwd: missing content stream - simple tab file

2008-03-24 Thread tim robertson
Ah, for some reason I am not receiving SOLR-user messages even though I am subscribed. If anyone has any ideas, can you please copy me in on the reply? Thanks -- Forwarded message -- From: tim robertson <[EMAIL PROTECTED]> Date: Mon, Mar 24, 2008 at 8:53 PM Subject: m

missing content stream - simple tab file

2008-03-24 Thread tim robertson
Hi all, I am a newbie with SOLR, trying to index a very simple tab delimitted file (using a nightly build from a couple days ago). Any help would be greatly appreciated! My test tab file has only 3 lines: Passer domesticus 1787248 Passer domesticus (Linnaeus, 1758) 694 Passer domesticus (Linnaeus

missing content stream - simple tab file

2008-03-24 Thread tim robertson
Hi all, I am a newbie with SOLR, trying to index a very simple tab delimitted file (using a nightly build from a couple days ago). Any help would be greatly appreciated! My test tab file has only 3 lines: Passer domesticus 1787248 Passer domesticus (Linnaeus, 1758) 694 Passer domesticus (Linnaeus

Re: Newbie CVS problem

2008-03-16 Thread tim robertson
ost.sh in exampledocs also has an example at the end of how to send a > commit command separately. > > -Yonik > > On Sun, Mar 16, 2008 at 6:56 AM, tim robertson > <[EMAIL PROTECTED]> wrote: > > Hi All, > > I have today installed SOLR and am trying to get CSV files

Newbie CVS problem

2008-03-16 Thread tim robertson
Hi All, I have today installed SOLR and am trying to get CSV files indexed but cant seem to get any hits. Using a fresh 1.2 install, I am using the schema shipped and the books.csvin the example. It seems to upload ok: [EMAIL PROTECTED]//Users/timrobertson/dev/apache-solr-nightly/example-tim/ex