Re: replicated index files have incorrect timestamp

2009-04-22 Thread Jian Han Guo
I am using Mac OS 10.5. I can't access the box right now and this week. I'll do it next week and post the result then. Thanks, Jianhan 2009/4/22 Noble Paul നോബിള്‍ नोब्ळ् > which OS are you using? > > it does not look at the timestamps to decide if the index is in sync . > It looks at the ind

Re: replicated index files have incorrect timestamp

2009-04-22 Thread Noble Paul നോബിള്‍ नोब्ळ्
which OS are you using? it does not look at the timestamps to decide if the index is in sync . It looks at the index version only. BTW can you just hit the master withe url and paste the response here http://:/solr/replication?command=filelist On Thu, Apr 23, 2009 at 11:53 AM, Jian Han Guo wro

Re: Sorting dates with reduced precision

2009-04-22 Thread tarjei
On 04/22/2009 03:20 PM, Ensdorf Ken wrote: Yes, but dates are fairly spesific, say 06:45 Nov. 2 , 2009. What if I want to say "Sort so that withing entries for Nov. 2 , you sort by relevance" for example? Append "/DAY" to the date value you index, for example "1995-12-31T23:59:59Z/DAY" will y

Re: replicated index files have incorrect timestamp

2009-04-22 Thread Jian Han Guo
That's right. The timestamp of files on the slave side are all Dec 31 1969, so it looks the timestamp was not set (and therefore it is zero). The ones on the master side are all correct. Nevertheless, solr seems being able to recognize that master and slave are in sync after replication. Don't kno

Re: replicated index files have incorrect timestamp

2009-04-22 Thread Noble Paul നോബിള്‍ नोब्ळ्
Let me assume that you are using the in-inbuilt replication. The replication ties to set the timestamp of all the files same as that of the files in the master. just cross check. On Thu, Apr 23, 2009 at 6:57 AM, Jian Han Guo wrote: > Hi, > > I am using nightly build on 4/22/2009. Replication wor

Re: Indexing from a DB, corrupt Lucene index

2009-04-22 Thread Noble Paul നോബിള്‍ नोब्ळ्
the fact that there is nothing in the data dir sugests that you are looking at the wrong directory. Just fire a query for *:* and it will tell you if there are indeed documents in the index. The statistics admin page can tell you where the index is created On Thu, Apr 23, 2009 at 12:25 AM, ahammad

Query | Solr conf and data (index) distribution using master slave configuration

2009-04-22 Thread Vicky_Dev
I am working on replicating data from one Solr set on a Linux Box to Second Solr on another Linux box. In order to achieve the same we will use the SolrCollectionDistributionScripts(snapshooter, snappuller etc) and rsync utility. Configurations: 1. Apache Solr 1.3.0 2. Machines : Linux 3. Topolog

Re: Delete from Solr index...

2009-04-22 Thread lupiss
hola de nuevo! es cierto ese comando es el que borra un index, ya lo intenté y sí, así borraré mis registros de prueba de mi proyecto, estaría bien saber como borrarlo desde la aplicación mediante solrj, saludos, gracias :) hello again! this is true is the command that erases an index, and I tri

Re: MLT for sorting results?

2009-04-22 Thread Shrutipriya
true. but in the normal process of search Solr uses parametric fields as filters. so if i do the following search keyword = java team lead ; location (parametric)=delhi, i will not get docs that match the keywords exactly with a different location. -shruti On Thu, Apr 23, 2009 at 3:29 AM, Otis Go

Re: Best way to index without diacritics

2009-04-22 Thread lupiss
hola de nuevo! gracias por la yuda, ya pude solucionar lo de los acentos :D por si a alguien le sirve el tip, todo está en poner en el schema.xml la clase isolatin mas o menos así: hello again! thanks for the help, I could solve it for the accents: D if someone helps the tip, everything is pu

Re: Faceted Dates

2009-04-22 Thread Otis Gospodnetic
I don't have Solr running here to try, but have you tried simply replacing "DAY" with "MONTH"? Who knows, maybe it works! :) Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Raju444us > To: solr-user@lucene.apache.org > Sent: Wednesday, Ap

Re: 1.4 Release Date?

2009-04-22 Thread Otis Gospodnetic
End of June? Yes, I think we will see Solr 1.4 by then. The list of issues waiting to be fixed/added for Solr 1.4 is on the Wiki (links to JIRA). Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Mike Hayes > To: solr-user@lucene.apache.

Re: replicated index files have incorrect timestamp

2009-04-22 Thread Otis Gospodnetic
Hi, I've never seen or heard of this happening. Are you sure nothing is wrong with local date? Are your master and slaves in sync (all running ntpd)? If not, they should be. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Jian Han Gu

replicated index files have incorrect timestamp

2009-04-22 Thread Jian Han Guo
Hi, I am using nightly build on 4/22/2009. Replication works fine, but the files inside index directory on slave side all have old timestamp: Dec 31 1969. Is this a known issue? Thanks, Jianhan

Re: Random sort with seed

2009-04-22 Thread Koji Sekiguchi
Setting random seed name to dynamic field name is the trick. http://lucene.apache.org/solr/api/org/apache/solr/schema/RandomSortField.html Koji hpn br wrote: Hi, When I used only lucene, I implemented a criterion of random sort, I send the seed and I get the same numbers. Use this artific

Re: SOLR-769 clustering

2009-04-22 Thread Grant Ingersoll
On Apr 22, 2009, at 5:03 PM, Stanislaw Osinski wrote: Hi Antonio, So I think the way to go would be to tune the clustering algorithm's stop words / stop label dictionaries to exclude the labels you don't like. I can't guarantee you can get decent clusters with this technique, but it's

Re: Getting idf from solr

2009-04-22 Thread Grant Ingersoll
See http://wiki.apache.org/solr/TermsComponent, which returns the term and it's DF value. On Apr 22, 2009, at 7:47 PM, mirage1987 wrote: Hi, Is there any way one can extract the IDF value from the solr index? Thanx -- View this message in context: http://www.nabble.com/Getting-idf

Re: Customizing solr with my lucene

2009-04-22 Thread mirage1987
Well guys the problem is now solved and evrythin's working perfectly fine.:-) Thankyou all for your help. The problem was indeed with the config files (schema and solrconfig). I rewrote my files from scratch and now everythin's seems to be working. The debug query option was quite helpful in makin

Getting idf from solr

2009-04-22 Thread mirage1987
Hi, Is there any way one can extract the IDF value from the solr index? Thanx -- View this message in context: http://www.nabble.com/Getting-idf-from-solr-tp23180369p23180369.html Sent from the Solr - User mailing list archive at Nabble.com.

1.4 Release Date?

2009-04-22 Thread Mike Hayes
Hi, I'm interested in using solr for a project at work. I'd like to use 1.4 if possible but I'm doubtful that I can sell them on what they perceive as "beta" software. The project is under way and is due to complete at the end of June. Is it likely that 1.4 will be offically release by then, or s

Re: Faceted Dates

2009-04-22 Thread Raju444us
In the example on the wiki that gives the facet counts for date per day.How should the query look like to get date facets by month. http://wiki.apache.org/solr/SimpleFacetParameters Here is the sample query for day level facet counts. http://localhost:8983/solr/select/?q=*:*&rows=0&facet=tru

Re: MLT for sorting results?

2009-04-22 Thread Otis Gospodnetic
What you describe is what normal Solr search does already - you can think of the query as a very small document and the search as a process that tries to find documents in the index that are the most similar to that "query document". Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - N

Get date facet counts per month

2009-04-22 Thread Raju444us
In the example on the wiki at gives the facet counts for date per day.How should the query look like to get date facets by month. http://wiki.apache.org/solr/SimpleFacetParameters#head-068dc96b0dac1cfc7264fe85528d7df5bf391acd Here is the sample query for day level facet counts. http://localho

RE: Highlight question

2009-04-22 Thread Ensdorf Ken
Add the following parameters to the url: hl=true&hl.fl=xhtml http://wiki.apache.org/solr/HighlightingParameters > -Original Message- > From: Bertrand DUMAS-PILHOU [mailto:bdum...@eurocortex.fr] > Sent: Wednesday, April 22, 2009 4:43 PM > To: solr-user@lucene.apache.org > Subject: Highl

Re: SOLR-769 clustering

2009-04-22 Thread Stanislaw Osinski
Hi Antonio, > To answer your question in terms of minimum term is, I am working with > "joke text" very short in length so the clusters are not so meaning full.. I > mean lot of adverbs and nouns, I thought increasing it might give me less > cluster but bit more meaningful (maybe not). Clusteri

Random sort with seed

2009-04-22 Thread hpn br
Hi, When I used only lucene, I implemented a criterion of random sort, I send the seed and I get the same numbers. Use this artifice in the paging, thus I have the same results for the same page with exactly seed. How I do it with solr ? I know that a criterion of ramdom sort exists, b

Highlight question

2009-04-22 Thread Bertrand DUMAS-PILHOU
Hi everybody, I have an schema seems like this in SOLR: title, type:string , indexed not stored body, type:string, stemmed, indexed not stored xhtml, type:string, not indexed, stored When user make an search on field title, body or both, I want to highlight the match string in the xhtml field on

RE: fl parameter

2009-04-22 Thread Harsch, Timothy J. (ARC-SC)[PEROT SYSTEMS]
If I were to add that capability, could I do it simply by registering my own RequestHandler and subclassing StandarRequestHandler? Or would I have to add an enhancement to Solr? -Original Message- From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik Seeley Sent: Wednesday

Get date facet counts per month level

2009-04-22 Thread Raju444us
In the example on the wiki at gives the facet counts for date per day.How should the query look like to get date facets by month. http://wiki.apache.org/solr/SimpleFacetParameters#head-068dc96b0dac1cfc7264fe85528d7df5bf391acd Here is the sample query for day level facet counts. http://localho

Re: Help with relevance failure in Solr 1.3

2009-04-22 Thread Walter Underwood
Sorry to not respond for a week, it got busy here. Here are the URL params for one request: qt=simple facet=true facet.limit=-1 facet.mincount=3 q=type:group AND qt_all:IsCriticallyAcclaimed AND qt_all:InGenreComedy facet.field=qt_toddscoregenres facet.field=qt_genres facet.field=qt_moods [and so

Re: ExtractingRequestHandler and SolrRequestHandler issue

2009-04-22 Thread Peter Wolanin
I had problems with this when trying to set this up with multiple cores - I had to set the shared lib as: in example/solr/solr.xml in order for it to find the jars in example/solr/lib -Peter On Wed, Apr 22, 2009 at 11:43 AM, Grant Ingersoll wrote: > > On Apr 20, 2009, at 12:46 PM, francisco t

Re: Indexing from a DB, corrupt Lucene index

2009-04-22 Thread ahammad
Excuse the error in the title. It should say "missing Lucene index" Cheers ahammad wrote: > > Hello, > > I finally was able to run a full import on an Oracle database. According > to the statistics, it looks like it fetched all the rows from the table. > However, When I go into /data, there i

Indexing from a DB, corrupt Lucene index

2009-04-22 Thread ahammad
Hello, I finally was able to run a full import on an Oracle database. According to the statistics, it looks like it fetched all the rows from the table. However, When I go into /data, there is nothing in there. This is my data-config.xml file:

Re: fl parameter

2009-04-22 Thread Yonik Seeley
On Wed, Apr 22, 2009 at 1:18 PM, Harsch, Timothy J. (ARC-SC)[PEROT SYSTEMS] wrote: > Since SOLR uses variable fields per record it would be useful to not only be > able to specify which fields to return in a query via the fl parameter, but > to also specify which fields to *not* return in the qu

MLT for sorting results?

2009-04-22 Thread Shrutipriya
hi, i was wondering if anyone has used solr MLT ("more like this") for sorting search results i.e. documents that are "most" like the query appear on top and so on. so the query is itself treated like a document and one tries finding docs "similar" to it from the corpus. is there a way to set pre

Re: Multiple instances of solr / jetty each on a different port

2009-04-22 Thread Colin Hammond
Thank you Shalin, that was the cause of the problem. Regards Colin Shalin Shekhar Mangar wrote: On Wed, Apr 22, 2009 at 9:54 PM, Colin Hammond wrote: org.apache.solr.common.SolrException: Error loading class 'solr.FastLRUCache' FastLRUCache is a 1.4 (trunk) feature. Perhaps you a

fl parameter

2009-04-22 Thread Harsch, Timothy J. (ARC-SC)[PEROT SYSTEMS]
Since SOLR uses variable fields per record it would be useful to not only be able to specify which fields to return in a query via the fl parameter, but to also specify which fields to *not* return in the query. Especially if you use dynamic fields as there may be no way to tell ahead of time w

Re: SOLR-769 clustering

2009-04-22 Thread Antonio Eggberg
Thanks Grant and Stanislaw. To answer your question in terms of minimum term is, I am working with "joke text" very short in length so the clusters are not so meaning full.. I mean lot of adverbs and nouns, I thought increasing it might give me less cluster but bit more meaningful (maybe not).

Re: Multiple instances of solr / jetty each on a different port

2009-04-22 Thread Shalin Shekhar Mangar
On Wed, Apr 22, 2009 at 9:54 PM, Colin Hammond wrote: > org.apache.solr.common.SolrException: Error loading class > 'solr.FastLRUCache' > FastLRUCache is a 1.4 (trunk) feature. Perhaps you are using a 1.4 solrconfig.xml with a 1.3 war file? -- Regards, Shalin Shekhar Mangar.

Multiple instances of solr / jetty each on a different port

2009-04-22 Thread Colin Hammond
Hello, I am having some difficulties in getting multiple instances of JVM/jetty/solr working each on a different port but on the same box. Ultimately I am looking to support multiple completely independent solr instances on the same box, each for a different customer. I am using jetty 6.1.3

Re: Customizing solr with my lucene

2009-04-22 Thread Erik Hatcher
I'm not sure what is going on. I don't quite understand what you're doing to Lucene that requires replacing the JAR file, but of course that is quite a red flag for why things aren't working. Of course there is a concern of index compatibility, so be sure you're starting with no index and

Re: working with dynamic fields

2009-04-22 Thread Grant Ingersoll
Yes, I believe so, but why not just try it? You might need/want a unique ID at least, though, which means you will have one non-dynamic field. On Apr 20, 2009, at 12:49 PM, mirage1987 wrote: Hi, Is it possible use a dynamic field name="*" without having to define any other field.

Re: ExtractingRequestHandler and SolrRequestHandler issue

2009-04-22 Thread Grant Ingersoll
On Apr 20, 2009, at 12:46 PM, francisco treacy wrote: Additionally, here's what I've got in example/lib: These need to be in your Solr home lib, not example/lib. I sometimes get confused on this one, too, forgetting that I need to go down a few more directories. The example/lib director

Fwd: ApacheCon

2009-04-22 Thread Grant Ingersoll
Begin forwarded message: We are having a discussion gene...@lucene.apache.org about Lucene related content for ApacheCon. You may want to check it out and see http://wiki.apache.org/jakarta-lucene/LuceneAtApacheConUs2009 -- Grant Ingersoll http://www.lucidimagi

Re: Sorting dates with reduced precision

2009-04-22 Thread Markus Jelsma - Buyways B.V.
my bad, there are indeed some very nice features concerning datefields and processing although they aren't really thorougly documented in the wiki. http://wiki.apache.org/solr/IndexingDates http://lucene.apache.org/solr/api/org/apache/solr/util/DateMathParser.html some additional information for

Re: Sorting dates with reduced precision

2009-04-22 Thread Markus Jelsma - Buyways B.V.
Perhaps i don't see your problem but if you convert the dates to UNIX timestamps, you could use a range query to narrow your results to within a specific date. - Markus Jelsma Buyways B.V. Tel. 050-3118123 Technisch ArchitectFriesestraatweg 215c Fax. 0

RE: Sorting dates with reduced precision

2009-04-22 Thread Ensdorf Ken
> Yes, but dates are fairly spesific, say 06:45 Nov. 2 , 2009. What if I > want to say "Sort so that withing entries for Nov. 2 , you sort by > relevance" for example? > Append "/DAY" to the date value you index, for example "1995-12-31T23:59:59Z/DAY" will yield "1995-12-31" So that all document

Re: Sorting dates with reduced precision

2009-04-22 Thread tarjei
On 04/22/2009 02:57 PM, Markus Jelsma - Buyways B.V. wrote: AFAIK, according to the manual you can add multiple sort instructions: http://wiki.apache.org/solr/CommonQueryParameters#head-9f40612b42721ed9e1979a4a80d68f4f8524e9b4 Yes, but dates are fairly spesific, say 06:45 Nov. 2 , 2009. What if I

Re: Sorting dates with reduced precision

2009-04-22 Thread Markus Jelsma - Buyways B.V.
AFAIK, according to the manual you can add multiple sort instructions: http://wiki.apache.org/solr/CommonQueryParameters#head-9f40612b42721ed9e1979a4a80d68f4f8524e9b4 - Markus Jelsma Buyways B.V. Tel. 050-3118123 Technisch ArchitectFriesestraatweg 215c

Sorting dates with reduced precision

2009-04-22 Thread tarjei
Hi, I got a set of entries where I want to sort them both by the day they were entered into solr(stored as a Solr date) and also by another field. Is this possible or do I have to create a separate field with lower resolution? kind regards, Tarjei

Re: SOLR-769 clustering

2009-04-22 Thread Grant Ingersoll
On Apr 21, 2009, at 3:46 AM, Antonio Eggberg wrote: Hello: I have got the clustering working i.e SOLR-769. I am wondering - why there is a filed called "body", does it have special purpose? multiValued="true"/> That's just used in the test schema and there isn't any need for you to

Re: how to reset the index in solr

2009-04-22 Thread Otis Gospodnetic
You can also delete it with "delete by query" using the following query in the delete command: *:* Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: sagi4 > To: solr-user@lucene.apache.org > Sent: Wednesday, April 22, 2009 7:57:50 AM > Sub

Re: how to reset the index in solr

2009-04-22 Thread Erik Hatcher
you can send in a delete request by query for *:*, that'll remove everything from the index. Erik On Apr 22, 2009, at 7:57 AM, sagi4 wrote: Thanks for your response. I want to clear it basically, it means clearing the index Thank you Sg.. What do you mean? To delete it or to re

Re: how to reset the index in solr

2009-04-22 Thread sagi4
Thanks for your response. I want to clear it basically, it means clearing the index Thank you Sg.. What do you mean? To delete it or to reload it? If you want to delete it just delete ./data/index folder. If you want to reload just reload your server if you can. In case you are using cores

Re: autowarmcount how to check if cache has been warmed up

2009-04-22 Thread sunnyfr
still the same ? Seems done : lookups : 0 hits : 0 hitratio : 0.00 inserts : 0 evictions : 0 size : 5 warmupTime : 20973 cumulative_lookups : 0 cumulative_hits : 0 cumulative_hitratio : 0.00 cumulative_inserts : 0 cumulative_evictions : 0 Apr 22 11:09:29 search-01 jsvc.exec[31908]: Apr 22, 20

Re: autowarmcount how to check if cache has been warmed up

2009-04-22 Thread sunnyfr
yes but let me check again ... but the delta-import was lidle and I think warmup was done is the log .. i will check it again now and let you know. Shalin Shekhar Mangar wrote: > > On Wed, Apr 22, 2009 at 2:05 PM, sunnyfr wrote: > >> >> thanks Shalin, >> >> How come just 5 if my autowarmCoun

Re: autowarmcount how to check if cache has been warmed up

2009-04-22 Thread Shalin Shekhar Mangar
On Wed, Apr 22, 2009 at 2:05 PM, sunnyfr wrote: > > thanks Shalin, > > How come just 5 if my autowarmCount=500 ? > Maybe the cache did not have more than 5 items before the commit? Actually, the cumulative_inserts=0 so I think Solr was just started up? -- Regards, Shalin Shekhar Mangar.

Re: autowarmcount how to check if cache has been warmed up

2009-04-22 Thread sunnyfr
thanks Shalin, How come just 5 if my autowarmCount=500 ? -- View this message in context: http://www.nabble.com/autowarmcount-how-to-check-if-cache-has-been-warmed-up-tp23156612p23172066.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: how to reset the index in solr

2009-04-22 Thread Marc Sturlese
What do you mean? To delete it or to reload it? If you want to delete it just delete ./data/index folder. If you want to reload just reload your server if you can. In case you are using cores you can just reload a core with all it's configuration http://localhost:8080/solr/admin/cores?action=REL

how to reset the index in solr

2009-04-22 Thread Geetha
I need to clearing the index in solr. I would appreciate anyone help -- Best Regards, ** *Geetha S *| System and Software Engineer email: gee...@angleritech.com * Visit us at ICT Expo, HongKong (13th-16th Apr 2009) and Internet World, UK (28-30 Apr 2009)* *