change solr url

2011-10-31 Thread Ankita Patil
Hey, Is it possible to change the url for solr admin?? What i want is : http://192.168.0.89:8983/solr/private/coreName/admin i want to add /private/ before the coreName. Is that possible? If yes how? Ankita.

Re: Replicating Large Indexes

2011-10-31 Thread Floyd Wu
Hi Jason, I'm very curious about how you build( rebuild ) such a big index efficiently? Sorry that hijack this topic. Floyd 2011/11/1 Jason Biggin : > Wondering if anyone has experience with replicating large indexes.  We have a > Solr deployment with 1 master, 1 master/slave and 5 slaves.  Our

Replicating Large Indexes

2011-10-31 Thread Jason Biggin
Wondering if anyone has experience with replicating large indexes. We have a Solr deployment with 1 master, 1 master/slave and 5 slaves. Our index contains 15+ million articles and is ~55GB in size. Performance is great on all systems. Debian Linux Apache-Tomcat 100GB disk 6GB RAM 2 proc on

Re: RE: Can't find resource 'solrconfig.xml'

2011-10-31 Thread Li Li
set JAVA_OPTS=%JAVA_OPTS% -Dsolr.solr.home=c:\xxx On Mon, Oct 31, 2011 at 9:14 PM, 刘浪 wrote: > Hi Li Li, >I don't know where I should add in catalina.bat. I have know Linux > how to do it, but my OS is windows. >Thank you very much. > > Sincerely, > Amos > > > this is the part o

RE: Can Solr handle large text files?

2011-10-31 Thread Anand.Nigam
Hi, Basically I need to index very large log files. I have modified the ExtractingDocumentLoader to create a new document for every 50 lines (it is made configurable by keeping it as a system property) of the log file being indexed. 'Filename' field for document created from 1 log file is kept

Re: How to do in Linux?

2011-10-31 Thread James Lin
you go to the same folder in linux and run it. How to do in Linux? On Tue, Nov 1, 2011 at 4:49 PM, 刘浪 wrote: > > Hey, > In windows: D:\solr\example\exampledocs>java -Durl= > http://localhost:8080/solr/updata -Dcommimt=yes -jar post.jar > demo-doc*.xml. > How to do in Linux? >

Re: external file filed not loading on commit with /update handler

2011-10-31 Thread abhayd
well I tried and it is working fine. thanks -- View this message in context: http://lucene.472066.n3.nabble.com/external-file-filed-not-loading-on-commit-with-update-handler-tp3468157p3469579.html Sent from the Solr - User mailing list archive at Nabble.com.

IllegalStateException locking up solr during query.

2011-10-31 Thread Phil Scadden
Seems to happen when I ask for more pages of results, but solr essentially stops working. Half an hour later it was working okay. Solr 3.4 on tomcat 5.5.15 Logs look like: (example of one of many...) Any ideas very welcome. 1/11/2011 12:00:14 org.apache.catalina.core.StandardWrapperValve invoke

Re: external file filed not loading on commit with /update handler

2011-10-31 Thread abhayd
hi i think it will work for me.. I m using trunk version. is that the only think i should add to solrconfig.xml? -- View this message in context: http://lucene.472066.n3.nabble.com/external-file-filed-not-loading-on-commit-with-update-handler-tp3468157p3469528.html Sent from the Solr - User

Re: external file filed not loading on commit with /update handler

2011-10-31 Thread Koji Sekiguchi
(11/11/01 0:56), abhayd wrote: hi I have two questions First on commit, external field file does not get loaded in index === http://localhost:8080/solr/core/update?stream.body=%3Ccommit/%3E&wt=json Also it is not clear if external file can

Re: edismax/boost: certain documents should be last

2011-10-31 Thread Paul
(Sorry for so many messages in a row...) For the record, I figured out something that will work, although it is somewhat inelegant. My q parameter is now: (+content:notes -genre:Citation)^20 (+content:notes genre:Citation)^0.01 Can I improve on that? On Mon, Oct 31, 2011 at 5:52 PM, Paul wrote

Re: edismax/boost: certain documents should be last

2011-10-31 Thread Paul
I studied the results with debugQuery, and I understand how the search is working. The two scores for the two terms are added together, so specifying a boost less than one still adds to the score. For instance, in the first result, content:notes has a score of 1.4892359 and genre:Citation^0.01 has

ReplicationHandler with external indexes

2011-10-31 Thread Andrea Gazzarini
Hi all, I have a master/slave architecture synchronized using the built-in ReplicationHandler. As part of recent development we created an extension (a RequestHandler) that (on master), without going deeper in details, creates some "foreign" indexes in the data directory (in the same level of the

Re: how to update specific document (record) of solr

2011-10-31 Thread Erick Erickson
The problem is the write-once nature of the segment files. Once a "commit" occurs, the rule is that segments never are changed. Since the stored data is held in a segment, this just follows from the rule. Fine, she says, why can't you change the rule? I guess you could, but this assumption is buil

Re: How to use an External Database for Fields?

2011-10-31 Thread Erick Erickson
I don't think I'm quite getting this. Instead of going down that low, could you make your own ResponseWriter? That has access to all the information in the doc, and it seems like you could reach out to the DB at that point and get your information merrily adding it to the docs. Or you could have y

Re: how to update specific document (record) of solr

2011-10-31 Thread Andrea Gazzarini
Probably a stupid question...why is not possible to update "stored and not indexed" fields? Andrea On 10/31/11, Erick Erickson wrote: > No, you can't update individual fields. And you probably won't be able > to unless Solr (well, Lucene actually) undergoes some *major* > re-architecture. > > Be

Re: how to update specific document (record) of solr

2011-10-31 Thread Erick Erickson
No, you can't update individual fields. And you probably won't be able to unless Solr (well, Lucene actually) undergoes some *major* re-architecture. Best Erick On Mon, Oct 31, 2011 at 11:19 AM, viruslviv wrote: > As far as I know you can't update specific fields only. You should read your > doc

Re: lucene 4.0 (fuzzy searching)

2011-10-31 Thread Erick Erickson
"Hopefully early next year" according to one of the committers at Apache Eurocon. But that said, I know that there are people running trunk versions of Solr in production, so that *is* a possibility although one that makes people nervous. An alternative *might* be "sounds like" (various soundex f

Re: edismax/boost: certain documents should be last

2011-10-31 Thread Paul
I had been experimenting with bq. I switched to boost like you suggested, and get the following error from solr: "can not use FieldCache on multivalued field: genre" But that sounds like the solution I'd want, if it worked, since it's more flexible than having to reindex. On Mon, Oct 31, 2011 at

Re: large scale indexing issues / single threaded bottleneck

2011-10-31 Thread Kiril Menshikov
Yonik, Adding overwrite=false don't help. XMLLoader don't check this HTTP parameter. Instead it check attribute in XML tag, with the same name. -Kiril -- View this message in context: http://lucene.472066.n3.nabble.com/large-scale-indexing-issues-single-threaded-bottleneck-tp3461815p3468463.ht

Re: Query time help

2011-10-31 Thread darren
Thanks Erick. I'll check that and report any oddities I find. > Something you may have overlooked is that with &debugQuery=on, > way down near the end of the list is a "timing" section, looks like > this: > > > that lists the time each of the components takes to do its thing, > things like highli

Re: Query time help

2011-10-31 Thread Erick Erickson
Something you may have overlooked is that with &debugQuery=on, way down near the end of the list is a "timing" section, looks like this: that lists the time each of the components takes to do its thing, things like highlighting, morelikethis, even the debug component. Sometimes surprises lurk in

How to use an External Database for Fields?

2011-10-31 Thread Draconissa
Hello all. I have a question about using an external database to store just the fields returned during the GET_FIELDS stage. We are using Solr to search an index with a good number of columns. That returns some ids, the scores and some facets. The ids are then passed to a custom DatabaseComponent

external file filed not loading on commit with /update handler

2011-10-31 Thread abhayd
hi I have two questions First on commit, external field file does not get loaded in index === http://localhost:8080/solr/core/update?stream.body=%3Ccommit/%3E&wt=json Also it is not clear if external file can be incremental or every time we

RE: question from a beginner

2011-10-31 Thread Bent Jensen
Yes, that certainly crossed my mind, but I have no idea of how to do that. Would I need to pick a unique keyword from every paragraph and use that for the index? -Original Message- From: Michael Sokolov [mailto:soko...@ifactory.com] Sent: Monday, October 31, 2011 5:20 AM To: solr-user@luc

Re: how to : multicore setup with same config files

2011-10-31 Thread Vadim Kisselmann
it works. it was one wrong placed backslash in my config;) sharing the config/schema files is not a problem. regards vadim 2011/10/31 Vadim Kisselmann > Hi folks, > > i have a small blockade in the configuration of an multicore setup. > i use the latest solr version (4.0) from trunk and the exa

DIH doesn't handle bound namespaces?

2011-10-31 Thread Moore, Gary
I'm trying to import some MODS XML using DIH. The XML uses bound namespacing: http://www.w3.org/2001/XMLSchema-instance"; xmlns:mods="http://www.loc.gov/mods/v3"; xmlns:xlink="http://www.w3.org/1999/xlink"; xmlns="http://www.loc.gov/mods/v3"; xsi:schemaLocation="http://www

Re: how to update specific document (record) of solr

2011-10-31 Thread viruslviv
As far as I know you can't update specific fields only. You should read your document, change some field and put the whole to the index back -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-update-specific-document-record-of-solr-tp3467929p3468077.html Sent from the Solr

lucene 4.0 (fuzzy searching)

2011-10-31 Thread Liz Sommers
Does anybody know when lucene 4.0 will be coming out? I really need the improvements to fuzzy searching. Right now it is taking me a minute or more to do a fuzzy search on my very large index. I need to bring it down. Does anybody have any solutions for this that do not depend on lucene 4.0? T

Re: Uncomplete date expressions

2011-10-31 Thread Erick Erickson
Well, if Solr understood partial dates, how would you then know whether the original was partial or not? It would all look the same when you pulled it out... But Solr is (intentionally) stupid about dates, and requires the (almost) full date format. There are a few zeros you can leave off, but not

Re: Updating a document multi-value field (no dup values) without needed it to be already committed

2011-10-31 Thread Erick Erickson
Before going too far down that path, let's check something. I assume you're storing *all* the fields for each document, right? Because unless you are, you'll lose data if you're reading the document from Solr and then updating it. When you fetch a document from Solr, only the *stored* fields are

Re: edismax/boost: certain documents should be last

2011-10-31 Thread Erik Hatcher
Paul - look at debugQuery=true output to see why scores end up the way they do. Use the explainOther to hone in on a specific document to get it's explanation. The math'll tell you why it's working the way it is. It's more than just likely that some other scoring factors are overweighting thi

Re: edismax/boost: certain documents should be last

2011-10-31 Thread Paul
Thanks Erik. They don't need to absolutely always be the bottom-most -- just not near the top. But that sounds like an easy way to do it, especially since it is a lot easier to reindex now than it used to be. I would like to know why my query had no effect, though. There's obviously something I do

how to update specific document (record) of solr

2011-10-31 Thread vrpar...@gmail.com
hello all, i want to update specific fields of particular document (having uniquekey). how to do it? e.g. suppose one document with following fields, ID--- unique key in solr Name Address Mobile Email i want to update only email field of document which has ID=5 Thanks, Vishal Pa

Re: edismax/boost: certain documents should be last

2011-10-31 Thread Erik Hatcher
Paul (*bows* to the NINES!) - If you literally want Citations always at the bottom regardless of other relevancy, then perhaps consider indexing boolean top_sort as true for everything Citations and false otherwise, then use &sort=top_sort asc,score desc (or do you need to desc top_sort? true

Re:RE: Can't find resource 'solrconfig.xml'

2011-10-31 Thread 刘浪
Hi Li Li, I don't know where I should add in catalina.bat. I have know Linux how to do it, but my OS is windows. Thank you very much. Sincerely, Amos this is the part of catalina.bat: rem Execute Java with the applicable properties if not "%JPDA%" == "" goto doJpda if not "%SE

RE: Can't find resource 'solrconfig.xml'

2011-10-31 Thread Brandon Ramirez
I have found setenv.sh to be very helpful. It's a hook where you can setup environment variables and java options without modifying your catalina.sh script. This makes upgrading a whole lot easier. Brandon Ramirez | Office: 585.214.5413 | Fax: 585.295.4848 Software Engineer II | Element K |

Re: Can't find resource 'solrconfig.xml'

2011-10-31 Thread Li Li
modify catalina.sh(bat) adding java startup params: -Dsolr.solr.home=/your/path On Mon, Oct 31, 2011 at 8:30 PM, 刘浪 wrote: > Hi, > After I start tomcat, I input http://localhost:8080/solr/admin. It > can display. But in the tomcat, I find an exception like "Can't find > resource 'solrconfig

Can't find resource 'solrconfig.xml'

2011-10-31 Thread 刘浪
Hi, After I start tomcat, I input http://localhost:8080/solr/admin. It can display. But in the tomcat, I find an exception like "Can't find resource 'solrconfig.xml' in classpath or 'solr\.\conf/', cwd=D:\Program Files (x86)\apache-tomcat-6.0.33\bin". It occures before "Server start up in

Re: question from a beginner

2011-10-31 Thread Michael Sokolov
You might also consider indexing each paragraph as a separate document if the documents are very large. -Mike On 10/30/2011 11:51 PM, Phil Scadden wrote: Look up highlighting. http://wiki.apache.org/solr/HighlightingParameters Notice: This email and any attachments are confidential. If recei

Re: Always return total number of documents

2011-10-31 Thread Erik Hatcher
there is actually an interesting trick here using facet.query (which would only entail a single filter cache entry): http://127.0.0.1:/solr/collection1/select?q={!tag=main}country:Spain&facet=on&facet.query={!ex=main key=total}*:* [my test data has a country field] Using facet tagging/excl

Re: bbox issue

2011-10-31 Thread Erick Erickson
One of the values of people reading docs for the first time is that they uncover less-than-clear issues. It's even more valuable if they update the docs, so please feel free to! Best Erick On Fri, Oct 28, 2011 at 9:43 AM, Christopher Gross wrote: > Ah!  That all makes sense.  The example on the

Re: Solr Profiling

2011-10-31 Thread Erick Erickson
jConsole has been used. What have you tried? A simple top would give you some info. But 16G of memory out of how much? It's a mistake to starve the OS, so make sure you leave some memory for the OS outside the jvm. This sounds much like a memory issue, here's an excellent article on the issues: h

Re: Always return total number of documents

2011-10-31 Thread Erick Erickson
Why not have your app query admin/stats and cache the numDocs variable and just add it to each page you display? That way you'd only have to call the stats component once. Well, actually, you'd have to periodically call it to catch index updates, but you'd cut down the number of queries. Although

how to : multicore setup with same config files

2011-10-31 Thread Vadim Kisselmann
Hi folks, i have a small blockade in the configuration of an multicore setup. i use the latest solr version (4.0) from trunk and the example (with jetty). single core is running without problems. We assume that i have this structure: /solr-trunk/solr/example/multicore/

Re: [Profiling] How to profile/tune Solr server

2011-10-31 Thread yu shen
No idea so far, try to figure out. Spark 2011/10/31 Jan Høydahl > Hi, > > There are no official tools other than looking at the built-in stats pages > and perhaps using JConsole or similar JVM monitoring tools. Note that > Solr's JMX capabilities may let you hook your enterprise's existing > mo

Re: [Profiling] How to profile/tune Solr server

2011-10-31 Thread Jan Høydahl
Hi, There are no official tools other than looking at the built-in stats pages and perhaps using JConsole or similar JVM monitoring tools. Note that Solr's JMX capabilities may let you hook your enterprise's existing monitoring dashboard up with Solr. Also check out the new monitoring service

Re: case insensitive searches

2011-10-31 Thread Jan Høydahl
Hi, I would recommend starting with the Tutorial at http://lucene.apache.org/solr/tutorial.html and try indexing and searching those documents. All of those use case insensitive searches. Study the example schema.xml and you'll see that we commonly use the LowerCaseTokenFilterFactory instead o

Facet count in grouped results

2011-10-31 Thread Rubinho
Hi, I'm working on a travelwebsite and want create the whole search with Solr. I added grouping on the query, because i want to show a group of trips with the same ID (roundtripgroupcode) only once. A trip has multiple departure days, and i just want to show 1 trip, while in de detail screen, i'l