Re: Stress Test Solr

[do3do3]

Hi 
I need to compare the result i get from my instance i done with the results
which get from other sites who used solr as a core for search
How can i set solrmeter parameters to can do this comparison??
thanks in advance

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Stress-Test-Solr-tp1016253p2971384.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Mysql vs Postgres DIH

[antonio]

Hi, thanks for interesting.
I solve the problem.
I use concat function in MYsql that converts in some case the fields in
BLOB. So, solr has a strange behavior importing blob field as id!

I find the solution reading the DIH faq in the wiki, exactly:
"Blob values in my table are added to the Solr document as object strings
like B@1f23c5"

Thank's. 
p.s. excuse for my so bad english!
   
Antonio

 

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Mysql-vs-Postgres-DIH-tp2963822p2973515.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: very slow commits and overlapping commits

[Jeff Crump]

I don't have an answer to this but only another question:  I don't think I
can use auto-commit in my application, as I have to "checkpoint" my index
submissions and I don't know of any callback mechanism that would let me
know a commit has happened.  Is there one?

2011/5/21 Erick Erickson 

> Well, committing less offside a possibilty  . Here's what's probably
> happening. When you pass certain thresholds, segments are merged which can
> take quite some time.  His are you triggering commits? If it's external,
> think about using auto commit instead.
>
> Best
> Erick
> On May 20, 2011 6:04 PM, "Bill Au"  wrote:
> > On my Solr 1.4.1 master I am doing commits regularly at a fixed interval.
> I
> > noticed that from time to time commit will take longer than the commit
> > interval, causing commits to overlap. Then things will get worse as
> commit
> > will take longer and longer. Here is the logs for a long commit:
> >
> >
> > [2011-05-18 23:47:30.071] start
> >
>
> commit(optimize=false,waitFlush=false,waitSearcher=false,expungeDeletes=false)
> > [2011-05-18 23:49:48.119] SolrDeletionPolicy.onCommit: commits:num=2
> > [2011-05-18 23:49:48.119]
> >
>
> commit{dir=/var/opt/resin3/5062/solr/data/index,segFN=segments_5cpa,version=1247782702272,generation=249742,filenames=[_4dqu_2g.del,
> > _4e66.tis, _4e3r.tis, _4e59.nrm, _4e68_1.del, _4e4n.prx, _4e4n.fnm,
> > _4e67.fnm, _4e3r.frq, _4e3r.tii, _4e6d.fnm, _4e6c.prx, _4e68.fdx,
> _4e68.nrm,
> > _4e6a.frq, _4e68.fdt, _4dqu.fnm, _4e4n.tii, _4e69.fdx, _4e69.fdt,
> _4e0e.nrm,
> > _4e4n.tis, _4e6e.fnm, _4e3r.prx, _4e66.fnm, _4e3r.nrm, _4e0e.prx,
> _4e4c.fdx,
> > _4dx1.prx, _4e5v.frq, _4e3r.fdt, _4e4c.tis, _4e41_6.del, _4e6b.tis,
> > _4e6b_1.del, _4e4y_3.del, _4e6b.tii, _4e3r.fdx, _4dx1.nrm, _4e4y.frq,
> > _4e4c.fdt, _4e4c.tii, _4e6d.fdt, _4e5k.fnm, _4e41.fnm, _4e69.fnm,
> _4e67.fdt,
> > _4e0e.tii, _4dty_h.del, _4e6b.fnm, _4e0e_h.del, _4e6d.fdx, _4e67.fdx,
> > _4e0e.tis, _4e5v.nrm, _4dx1.fnm, _4e5v.tii, _4dqu.fdt, segments_5cpa,
> > _4e5v.prx, _4dqu.fdx, _4e59.fnm, _4e6d.prx, _4e59_5.del, _4e4c.prx,
> > _4e4c.nrm, _4e5k.prx, _4e66.fdx, _4dty.frq, _4e6c.frq, _4e5v.tis,
> _4e6e.tii,
> > _4e66.fdt, _4e6b.fdx, _4e68.prx, _4e59.fdx, _4e6e.fdt, _4e41.prx,
> _4dx1.tii,
> > _4dx1.fdt, _4e6b.fdt, _4e5v_4.del, _4e4n.fdt, _4e6e.fdx, _4dx1.fdx,
> > _4e41.nrm, _4e4n.fdx, _4e6e.tis, _4e66.tii, _4e4c.fnm, _4e6b.prx,
> _4e67.prx,
> > _4e0e.fnm, _4e4n.nrm, _4e67.nrm, _4e5k.nrm, _4e6a.prx, _4e68.fnm,
> > _4e4c_4.del, _4dx1.tis, _4e6e.nrm, _4e59.tii, _4e68.tis, _4e67.frq,
> > _4e3r.fnm, _4dty.nrm, _4e4y.prx, _4e6e.prx, _4dty.tis, _4e4y.tis,
> _4e6b.nrm,
> > _4e6a.fdt, _4e4n.frq, _4e6d.frq, _4e59.fdt, _4e6a.fdx, _4e6a.fnm,
> _4dqu.tii,
> > _4e41.tii, _4e67_1.del, _4e41.tis, _4dty.fdt, _4e69.tis, _4dqu.frq,
> > _4dty.fdx, _4dx1.frq, _4e6e.frq, _4e66_1.del, _4e69.prx, _4e6d.tii,
> > _4e5k.tii, _4e0e.fdt, _4dqu.tis, _4e6d.tis, _4e69.nrm, _4dqu.prx,
> _4e4y.fnm,
> > _4e67.tis, _4e69_1.del, _4e6d.nrm, _4e6c.tis, _4e0e.fdx, _4e6c.tii,
> > _4dx1_n.del, _4e5v.fnm, _4e5k.tis, _4e59.tis, _4e67.tii, _4dqu.nrm,
> > _4e5k_8.del, _4e6c.fdx, _4e6c.fdt, _4e41.frq, _4e4y.fdx, _4e69.frq,
> > _4e6a.tis, _4dty.prx, _4e66.frq, _4e5k.frq, _4e6a.tii, _4e69.tii,
> _4e6c.nrm,
> > _4dty.fnm, _4e59.prx, _4e59.frq, _4e66.prx, _4e68.frq, _4e5k.fdx,
> _4e4y.tii,
> > _4e6c.fnm, _4e0e.frq, _4e6b.frq, _4e41.fdt, _4e4n_2.del, _4dty.tii,
> > _4e4y.fdt, _4e66.nrm, _4e4c.frq, _4e6a.nrm, _4e5k.fdt, _4e3r_i.del,
> > _4e5v.fdt, _4e4y.nrm, _4e68.tii, _4e5v.fdx, _4e41.fdx]
> > [2011-05-18 23:49:48.119]
> >
>
> commit{dir=/var/opt/resin3/5062/solr/data/index,segFN=segments_5cpb,version=1247782702273,generation=249743,filenames=[_4dqu_2g.del,
> > _4e66.tis, _4e59.nrm, _4e3r.tis, _4e4n.fnm, _4e67.fnm, _4e3r.tii,
> _4e6d.fnm,
> > _4e68.fdx, _4e68.fdt, _4dqu.fnm, _4e4n.tii, _4e69.fdx, _4e69.fdt,
> _4e4n.tis,
> > _4e6e.fnm, _4e0e.prx, _4e4c.tis, _4e5v.frq, _4e4y_3.del, _4e6b_1.del,
> > _4e4c.tii, _4e6f.fnm, _4e5k.fnm, _4e6c_1.del, _4e41.fnm, _4dx1.fnm,
> > _4e5v.nrm, _4e5v.tii, _4e5v.prx, _4e5k.prx, _4e4c.nrm, _4dty.frq,
> _4e66.fdx,
> > _4e5v.tis, _4e66.fdt, _4e6e.tii, _4e59.fdx, _4e6b.fdx, _4e41.prx,
> _4e6b.fdt,
> > _4e41.nrm, _4e6e.tis, _4e4c.fnm, _4e66.tii, _4e6b.prx, _4e0e.fnm,
> _4e5k.nrm,
> > _4e6a.prx, _4e6e.nrm, _4e59.tii, _4e67.frq, _4dty.nrm, _4e4y.tis,
> _4e6a.fdt,
> > _4e6b.nrm, _4e59.fdt, _4e6a.fdx, _4e41.tii, _4e41.tis, _4e67_1.del,
> > _4dty.fdt, _4dty.fdx, _4e69.tis, _4e66_1.del, _4e6e.frq, _4e5k.tii,
> > _4dqu.prx, _4e67.tis, _4e69_1.del, _4e6c.tis, _4e6c.tii, _4e5v.fnm,
> > _4e5k.tis, _4e59.tis, _4e67.tii, _4e6c.fdx, _4e4y.fdx, _4e41.frq,
> _4e6c.fdt,
> > _4dty.prx, _4e66.frq, _4e69.tii, _4e6c.nrm, _4e59.frq, _4e66.prx,
> _4e5k.fdx,
> > _4e68.frq, _4e4y.tii, _4e4n_2.del, _4e41.fdt, _4e6b.frq, _4e4y.fdt,
> > _4e66.nrm, _4e4c.frq, _4e3r_i.del, _4e5k.fdt, _4e4y.nrm, _4e41.fdx,
> > _4e4n.prx, _4e68_1.del, _4e3r.frq, _4e6f.fdt, _4e6f.fdx, _4e6c.prx,
> > _4e68.nrm, _4e6a.frq, _4e0e.nrm, _4e3r.prx, _4e66.fnm, _4e3r.nrm,
> _4

Spatial Solr 3.1: filter by viewport

[Zac Smith]

How would I specify a filter that covered a rectangular viewport? I have 4 
coordinate points for the corners and I want to return everything inside that 
area.
My first naive attempt was this:
q=*:*&fq=coords:[44.119141,-125.948638 TO 47.931066,-111.029205]

At first this seems to work OK, except where the viewport crosses over a point 
where the longitude goes from a positive value to a negative value.

Thanks
Zac

Re: apache-solr-3.1 slow stats component queries

[Chris Hostetter]

: Are there any plans for caching stat results for a certain stat field along
: with the documents that match a filter query ? Any other ideas that could
: help to improve this (hardware/software configuration) ?  Even for a subset
: of 10M entries, the stat search takes on the order of 10 seconds.

I don't know of anyone working on it, and off the top of my head i don't 
remember seeing any jira issues for it, but it certianly seems feasible to 
add optional caching (the StatsComponent could have an optional init param 
naming a user declared cache)

Feel free to open a jira issue.


-Hoss