Re: CoreAdmin for replication STATUS

2009-01-15 Thread Akshay
On Fri, Jan 16, 2009 at 4:57 AM, Jacob Singh wrote: > Hi, > > How do I find out the status of a slave's index? I have the following > scenario: > > 1. Boot up the slave. I give it a core name of boot-$CoreName. > > 2. I call boot-$CoreName/replication?command=snappull > > 3. I check back every

Re: Having no luck with build-in replication and multicore

2009-01-15 Thread Shalin Shekhar Mangar
Hi Jacob, You don't need to call snapshoot on the master. That is only used to create a backup of the index files. You are calling snappull on the master. It is only applicable for the slaves. You don't need to issue these calls yourself at all. The ReplicationHandler is designed to take care of

Re: Solrj + hl.usePhraseHighlighter

2009-01-15 Thread Sachit
Sorry I forgot to detail out the field type "wild_card" definition. -- View this message in context: http://www.nabble.com/Solrj-%2B-hl.usePhraseHighlighter-tp21492830p21492981.html Sent from the Solr - User mailing list

Solrj + hl.usePhraseHighlighter

2009-01-15 Thread Sachit
Hi all, SolrQuery provides all methods related to highlighting with Solrj client such as setHighlight(), setHighlightFragSize(), etc. But I didn’t find any way to set the hl.usePhraseHighlighter = true to the query. However, I can set the same in my solrconfig.xml but my aim is to this attribute

Re: Missing high-scoring results in 1.3

2009-01-15 Thread Yonik Seeley
On Thu, Jan 15, 2009 at 8:01 PM, Chris Hostetter wrote: > : Here is the relevant part of solrconfig. Note that we have added a > : JaroWinkler fuzzy search, so the dismax specs have extra decoration. > > ...can you elaborate on your JaroWinkler customizations? is it possible > that the Query obje

Re: Missing high-scoring results in 1.3

2009-01-15 Thread Chris Hostetter
H ... I'm wondering if the Lucene/Solr version changes are a red herring here ... at first blush all of these symptoms sound like invalid cache hits... : I'm seeing a really weird problem with Solr 1.3. The best match for a : query will not show up with 10 rows, but will show up if I reque

Re: Querying Solr Index for date fields

2009-01-15 Thread Chris Hostetter
: You will have to URL encode the string correctly and supply date in format : Solr expects. Please check this: http://wiki.apache.org/solr/SolrQuerySyntax beyond that, you may also need to worry about lucene query sytnax escaping ...the query parser can see the ":" character and think you are s

New Searcher / Commit / Cache Warming Time

2009-01-15 Thread David Giffin
Hi All, I have been trying to reduce the cpu load and time it takes to put a new snapshot in place on our slave servers. I have tried tweaking many of the system memory, jvm and cache size setting used by Solr. When running a commit from the command line I'm seeing roughly 16 seconds before the co

Re: EmbeddedSolrServer in Single Core

2009-01-15 Thread qp19
Thanks ryan, Works like a charm. This is roughly how I ended up doing. QP SolrConfig solrConfig = new SolrConfig(SOLR_HOME, CONFIG_FILENAME, null); IndexSchema indexSchema = new IndexSchema(solrConfig, SOLR_SCHEMA, null); CoreContainer container = new CoreContainer(new

Re: Does search query return specific result.?

2009-01-15 Thread Chris Hostetter
: I believe the reason is because, Solr returns the document with all of the : "Tag" field's content. : : Now, the question is: Is there a way to make it return only Tag that match : the criteria from the same document? not really .. highlighting with things like the NullFragmenter can probably

Re: Date Range query in Solr

2009-01-15 Thread Chris Hostetter
: I too have a similar question on getting the query results based on : dateRange. I have both startDate and endDate fields in my schema and if I : want to get the query results that fall into two date values for eg: get all : the docs. whose date is between startDate and endDate, then how c

RE: Solr FAQ entry about "Dynamically calculated range facet" topic

2009-01-15 Thread Chris Hostetter
: So did anyone put together a FAQ on this subject? I am also interested in : seeing the different ways to get dynamic faceting to work. in past discussions own of the big pre-reqs for doing anything interesting was generating stats accross the field ... the new StatsComponent can give you the

Re: delta index produces multiple results?

2009-01-15 Thread Chris Hostetter
: Full index is working fine, in schema.xml I implemented a uniqueKey field : (which is of the type 'text'). using "text" as the fieldtype for a uniqueKey is almost never a good idea. it could easily explain the behavior you are seeing. DataImportHandler (and all of hte update handlers) relies

CoreAdmin for replication STATUS

2009-01-15 Thread Jacob Singh
Hi, How do I find out the status of a slave's index? I have the following scenario: 1. Boot up the slave. I give it a core name of boot-$CoreName. 2. I call boot-$CoreName/replication?command=snappull 3. I check back every minute using cron and I want to see if the slave has actually gotten t

Re: Using Solr with an existing Lucene index

2009-01-15 Thread Chris Hostetter
: My first attempt to do this resulted in my Java program throwing a : CorruptIndex exception. It appears as though Solr has somehow modified my : index files in some way which causes the Lucene code to see them as corrupt : (even though I did not, at least intentionally, try to post any documents

Re: Using Lucene index in Solr

2009-01-15 Thread Chris Hostetter
: My data is stored in a database, I want Solr to look up the data in that : database using my existing index. At the moment, I have set the you seem to be confusing two issues : element in my solrconfig to point at my existing index, and checked the : schema on my existing index using Luke

Re: Query about NOT (-) operator

2009-01-15 Thread Chris Hostetter
: But below query does not work : 2. (NOT(IBA60019_l:1) AND NOT(IBA60019_l:0)) AND : businessType:wt.doc.WTDocument boolean queries must have at least one "positive" expression (ie; MUST or SHOULD) in order to match. the solr query parser tries to help with this and if the *outermost* B

Re: Dismax query parser with different field classes

2009-01-15 Thread Chris Hostetter
: I have a small problem with using a boost query, which is that I would like : documents found in the boost query to be returned even if the main query : does not include those results. So what I am effectively looking for is an : OR between the dismax query and the boost query, rather than a req

Re: Solr/Lucene capabilities--Newbie Question

2009-01-15 Thread Grant Ingersoll
On Jan 15, 2009, at 1:53 PM, kgrogan0321 wrote: Hello, I have been tasked with evaluating a few open source tools for implementing an Enterprise search in a new project(Solr/Lucene being one of them). Can anyone help to answer if Solr/Lucene can: 1)Handle field/row level security? Yes.

Re: Questions about UUID type

2009-01-15 Thread Chris Hostetter
1) please don't cc both solr-user and solr-dev ... if you are confused about how something works, or having problems, please just email solr-user. 2) ... : I'm confused by the UUID type comment. It's said that ... : However¡¤ i found that if i don't specify the field and it will report

Re: Delete / filter / hide query results

2009-01-15 Thread Chris Hostetter
: can't be part of a field or something like this. So let's say that the only : way to know if a user has access rights is by calling something like : accessRights(sessionID, docID) where docID is stored in a field. first tip: 'stored' valuves are going to be really inefficient to deal with on e

Re: Help with Solr 1.3 lockups?

2009-01-15 Thread Stephen Weiss
I've been wondering about this one myself - most of the services we have installed work this way, if they crash out for whatever reason they restart automatically (Apache, MySQL, even the OS itself). Failures are detected and corrected by the load balancers and also in some cases by the ma

Re: collectionDistribution vs SolrReplication

2009-01-15 Thread Chris Hostetter
: I would like to know the advantages of moving from: : a master-slave system using CollectionDistribution with all their .sh : scripts : http://wiki.apache.org/solr/CollectionDistribution : to: : use SolrReplication and his solrconfig.xml configuration. : http://wiki.apache.org/solr/SolrReplicati

Re: place log4j.properties

2009-01-15 Thread Marc Sturlese
>Have you tried placing it up in /WEB-INF/classes/? It worked, I was trying to put set it in /WEB-INF/classes/org/apache/solr/servlet wich was wrong Thanks! Matthew Runo wrote: > > Have you tried placing it up in /WEB-INF/classes/? I'd think that'd be > the root of the classpath for solr, an

Re: understanding queryNorm

2009-01-15 Thread Chris Hostetter
:i wanted to understand how the queryNorm is calculated. i did read : similarity documentation of lucene it says it is ... : what would be default q.getBoost() ? ( as i am not giving any value : specifically any where in solr). t.getBoost() is 1 in my case as i am all queries have

Re: Highlighting not working

2009-01-15 Thread Chris Hostetter
The problem here seems to be that SolrJ can't parse the XML response comming back from your solr server ... can you check your servlet container logs and let us know: 1) exactly what URL it says SolrJ is hitting. 2) the response you get when you hit that same url in your browser? : Caused by:

Re: Date Stats support using Solr

2009-01-15 Thread Chris Hostetter
(Still catching up on holiday mail) ... : I was searching for features in Solr which would give me the maximum and : minimum values for various numeric and name fields. I found the Stats : Component (Solr-680) and thanks a ton for that !!! J : Is there a similar component for date fields too? I

Re: Having no luck with build-in replication and multicore

2009-01-15 Thread Jacob Singh
Hi Shalin, Thanks for responding! This used to be a 1.3 index (could that be the issue?) curl 'http://mydomain.com:8080/solr/065f079c24914a4103e2a57178164bbe//replication?command=indexversion' Best, Jacob On Jan 15, 2009 3:32pm, Shalin Shekhar Mangar wrote: > What is the output of /

Re: Is it just me or multicore default is broken? Can't ping

2009-01-15 Thread Julian Davchev
Hi, I am trying with 1.3.0from http://apache.cbox.biz/lucene/solr/1.3.0/apache-solr-1.3.0.tgz which I supposed is stable release. Otis Gospodnetic wrote: > Not sure, I'd have to try it. But you didn't mention which version of Solr > you are using. Nightly build? > > > Otis > -- > Sem

Re: Having no luck with build-in replication and multicore

2009-01-15 Thread Shalin Shekhar Mangar
What is the output of /replication?command=indexversion on the master? On Fri, Jan 16, 2009 at 1:27 AM, Jacob Singh wrote: > Hi folks, > > Here's what I've got going: > > Master Server with the following config: > > >commit >schema.xml,stopwords.txt,elevate.xml > > > >

Re: Request a specifc document

2009-01-15 Thread Erik Hatcher
On Jan 15, 2009, at 3:04 PM, roberto wrote: There is any way to request a document (a field) using the doc id? /select?q=id: Append &fl=field,list to return only the desired fields. it would be very nice if i could use an responsewriter to response the document in an html form? Does someon

Request a specifc document

2009-01-15 Thread roberto
Hello, There is any way to request a document (a field) using the doc id? it would be very nice if i could use an responsewriter to response the document in an html form? Does someone already did it? Thanks, -- "Without love, we are birds with broken wings." Morrie

Re: Help with Solr 1.3 lockups?

2009-01-15 Thread Mark Miller
How much RAM are you giving the JVM? Thats running out of memory loading a FieldCache, which can be a more memory intensive data structure. It pretty much points to the JVM not having enough RAM to do what you want. How many fields do you sort on? How many fields do you facet on? How much RAM d

Having no luck with build-in replication and multicore

2009-01-15 Thread Jacob Singh
Hi folks, Here's what I've got going: Master Server with the following config: commit schema.xml,stopwords.txt,elevate.xml Slave server with the following: http://mydomain:8080/solr/065f079c24914a4103e2a57178164bbe/replication 00:00:20 I

Re: Import data from RSS Feed Question

2009-01-15 Thread Chris Hostetter
: Everything works and is setup correctly, but when I change the 'url' : attribute in the entity declaration to a url on my intranet that requires : basic authentication (username and password), I get a HTTP 401 error when : solr attempts to read the rss feed and update the index. : : Question: i

Solr/Lucene capabilities--Newbie Question

2009-01-15 Thread kgrogan0321
Hello, I have been tasked with evaluating a few open source tools for implementing an Enterprise search in a new project(Solr/Lucene being one of them). Can anyone help to answer if Solr/Lucene can: 1)Handle field/row level security? 2)implement DROOLS rules on a query of multiple records? If

Help with Solr 1.3 lockups?

2009-01-15 Thread Jerome L Quinn
Hi, all. I'm running solr 1.3 inside Tomcat 6.0.18. I'm running a modified query parser, tokenizer, highlighter, and have a CustomScoreQuery for dates. After some amount of time, I see solr stop responding to update requests. When crawling through the logs, I see the following pattern: Jan 12,

Re: place log4j.properties

2009-01-15 Thread Matthew Runo
Have you tried placing it up in /WEB-INF/classes/? I'd think that'd be the root of the classpath for solr, and maybe where it's looking for the file? If you figure it out, could you update the wiki? --Matthew On Jan 14, 2009, at 3:39 AM, Marc Sturlese wrote: Hey there, I have changed the

Re: Unwanted clustering of search results after sorting by score

2009-01-15 Thread Otis Gospodnetic
Axel, Others may have better ideas, but the simplest idea that occurs to me right now is to really just go over the search results and resort them the way you described. However, I don't think this is as scary as it sounds. You don't really have to go through the whole result set - you only n

Re: Searchable and Non Searchable Fields

2009-01-15 Thread Otis Gospodnetic
Con, Sure. You just have to specify the field name when searching: FirstName:George (and not just: George) Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: con > To: solr-user@lucene.apache.org > Sent: Thursday, January 15, 2009 12:20:55

Re: Customizing Solr to handle Leading Wildcard queries

2009-01-15 Thread Otis Gospodnetic
Hi ramuK, I believe you can turn that "on" via the Lucene QueryParser, but of course such searches will be slo(oo)w. You can also index reversed tokens (e.g. *kumar --> rakum*) or you could index n-grams with begin/end delim characters (e.g. kumar -> ^ k u m a r $, *kumar -> "k u m a r $") O

Re: Is it just me or multicore default is broken? Can't ping

2009-01-15 Thread Otis Gospodnetic
Not sure, I'd have to try it. But you didn't mention which version of Solr you are using. Nightly build? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Julian Davchev > To: solr-user@lucene.apache.org > Sent: Thursday, January 15, 2009

Re: Customizing Solr to handle Leading Wildcard queries

2009-01-15 Thread Glen Newton
If we are talking short single term fields (like a file field that has a single term like "foo.pdf") then do what the DBMS b-tree indexes did a long time ago: for every field you want a leading wildcard, insert it in reverse order. So field file:"foo.pdf" is also stored, indexed as reverseField:"f

Is it just me or multicore default is broken? Can't ping

2009-01-15 Thread Julian Davchev
Hi, I am trying to setup multicore solr. So I just download default one with jetty...goto example/ and run java -Dsolr.solr.home=multicore -jar start.jar All looks smooth without errors on startup. Also can can open admin at http://localhost:8983/solr/core1/admin/ But then trying to ping h

RE: Customizing Solr to handle Leading Wildcard queries

2009-01-15 Thread Jana, Kumar Raja
Hi Erik, Thanks for the quick reply. I want to enable leading wildcard query searches in general. The case mentioned in the earlier mail is just one of the many instances I use this feature. -Kumar -Original Message- From: Erik Hatcher [mailto:e...@ehatchersolutions.com] Sent: Thursd

Re: Customizing Solr to handle Leading Wildcard queries

2009-01-15 Thread Erik Hatcher
On Jan 15, 2009, at 8:23 AM, Jana, Kumar Raja wrote: Not being able to perform Leading Wildcard queries is a major handicap. I want to be able to perform searches like *.pdf to fetch all pdf documents from Solr. For this particular case, I recommend indexing the document type as a separate

Customizing Solr to handle Leading Wildcard queries

2009-01-15 Thread Jana, Kumar Raja
Hi, Not being able to perform Leading Wildcard queries is a major handicap. I want to be able to perform searches like *.pdf to fetch all pdf documents from Solr. I have found quite a few threads on this topic and one of the solutions was that this feature can be enabled by adding: parser.

Re: Unwanted clustering of search results after sorting by score

2009-01-15 Thread Axel Tetzlaff
Hi, I'm working on the problem Max described as well. We did try to omit the norms which lead to the phenomenon that products that have a very extensive description were more likely to have a higher score since they contained the word more often. Due to many expands of the SynonymFilter at index-

Re: wildcard with capital letters

2009-01-15 Thread Shalin Shekhar Mangar
On Thu, Jan 15, 2009 at 4:28 PM, pcu wrote: > Why wildcard with at least one capital letters does not work. Prefix queries are not analysed. So the query you are making is of a different case than the tokens in the index. Before sending the query to Solr, you can lowercase it yourself. > > >

Re: Single facet on multiple attributes

2009-01-15 Thread Shalin Shekhar Mangar
On Wed, Jan 14, 2009 at 8:14 PM, prerna07 wrote: > > Hi, > > How can we create single facet on multiple attributes? Do you mean to combine facets from multiple fields into one output? If yes, you can create a copyField of all these fields and facet on that. > > > Thanks, > -- > View this mess

Re: Import data from RSS Feed Question

2009-01-15 Thread Shalin Shekhar Mangar
On Thu, Jan 15, 2009 at 5:55 AM, Burt-Prior wrote: > > Everything works and is setup correctly, but when I change the 'url' > attribute in the entity declaration to a url on my intranet that requires > basic authentication (username and password), I get a HTTP 401 error when > solr attempts to r

wildcard with capital letters

2009-01-15 Thread pcu
Hello, I am working on simple prototype using solr but I did not figure out how to configure solr to give me the right results. for example if I use this field:

Re: Indexing the same data in many records

2009-01-15 Thread philmccarthy
Hi, Adding same document many times is actually the scenario I wanted to test--indexing hits from Apache webserver logs with the source of the referring page. My expectation would be that the majority of hits on a given day would originate from a small number of referrers, so each of these refer