How to integrate sen and lucene-ja in SOLR 3.x
Hi, Can anyone help me on how to integrate sen and lucene-ja.jar in SOLR 3.4 or 3.5 or 3.6 version? Thanks, Shanmugavel -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-integrate-sen-and-lucene-ja-in-SOLR-3-x-tp3953266.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Search for empty string in 1.4.1 vs 3.4
Thank you for the reply Chris.
Please find the sample query which is returning results even though id is
not having any value as in SOLR 1.4.1
http://localhost/solr/online/select/?q=%28%20state%20%29^1.8%20AND%20%20%28%20%28id:%22%22%29%29%20AND%20%20%28%20%28content_type_s:%22Video%22%29^1.5%20%29
PS: id is multivalued=false. Any field with multivalued as false works like
this {returning results on search of } in SOLR 1.4.1. But at the same time
q=id: is not returning any results in SOLR 1.4.1. This problem happens
when there is AND clause with id:
--
View this message in context:
http://lucene.472066.n3.nabble.com/Search-for-empty-string-in-1-4-1-vs-3-4-tp3358444p3375436.html
Sent from the Solr - User mailing list archive at Nabble.com.
Search for empty string in 1.4.1 vs 3.4
Hi, I am using SOLR 1.4.1. When I search for empty string in a string field, q=tag_facet:, it return documents with values in tag_facet. When I use the same query q=tag_facet:, in SOLR 3.4, it is returning only documents with string in tag_facet. SOLR 3.4 works as expected. I just want to know whether it is an issue in SOLR 1.4.1. Please advise. -- View this message in context: http://lucene.472066.n3.nabble.com/Search-for-empty-string-in-1-4-1-vs-3-4-tp3358444p3358444.html Sent from the Solr - User mailing list archive at Nabble.com.
How to convert date/timestamp to long in data-config.xml
SOLR : 1.4.1 There are 1,300,000+ documents in the index. Sorting on a date field with timestamp leads to OutOfMemoryError. So, we are looking for a way to copy the timestamp as a long value to a field and sort based on that field. Can any one help me on how to convert the timestamp to a long value in data-config.xml? Is there any existing transformer? -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-convert-date-timestamp-to-long-in-data-config-xml-tp2907125p2907125.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to find Master Slave are in sync
Markus,
The problem here is if I call the below two URLs immediately after
replication then I am getting both the index versions as same. In my python
script I have added code to swap the online core on master with offline core
on master and online core on slave with offline core on slave, if both the
versions are same. After calling swap, I am getting error in slave's log
like below.
So I am confused why this is happening. Can you please help me on this?
http://master_host:port/solr/replication?command=indexversion
http://slave_host:port/solr/replication?command=details
2011-01-27 07:45:26,713 WARN [org.apache.solr.handler.SnapPuller]
(Thread-59) No content recieved for file: {size=154098810, name=_e3.cfx,
lastmodified=1296132092000}
2011-01-27 07:45:27,396 ERROR [org.apache.solr.handler.ReplicationHandler]
(Thread-59) SnapPull failed
org.apache.solr.common.SolrException: Unable to download _e3.cfx
completely. Downloaded 0!=154098810
at
org.apache.solr.handler.SnapPuller$FileFetcher.cleanup(SnapPuller.java:1026)
at
org.apache.solr.handler.SnapPuller$FileFetcher.fetchFile(SnapPuller.java:906)
at
org.apache.solr.handler.SnapPuller.downloadIndexFiles(SnapPuller.java:541)
at
org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:294)
--
View this message in context:
http://lucene.472066.n3.nabble.com/How-to-find-Master-Slave-are-in-sync-tp2287014p2362679.html
Sent from the Solr - User mailing list archive at Nabble.com.
How to find Master Slave are in sync
How to find Master Slave are in sync? Is there a way apart from checking the index version of master and slave using below two HTTP APIs? http://master_host:port/solr/replication?command=indexversion http://slave_host:port/solr/replication?command=details -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-find-Master-Slave-are-in-sync-tp2287014p2287014.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: schema.xml in other than conf folder
Hi, These two links helped me to solve the problem. https://issues.apache.org/jira/browse/SOLR-1154 http://wiki.apache.org/solr/SolrReplication#enable.2BAC8-disable_master.2BAC8-slave_in_a_node Thanks, SRD -- View this message in context: http://lucene.472066.n3.nabble.com/schema-xml-in-other-than-conf-folder-tp2206587p2241266.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: schema.xml in other than conf folder
Chris, Our solr conf folder is in read-only file system. But the data directory (index) is not in read-only file system. As per our production environment guidelines, the configuration files should be in read-only file system. Thanks, SRD -- View this message in context: http://lucene.472066.n3.nabble.com/schema-xml-in-other-than-conf-folder-tp2206587p2225625.html Sent from the Solr - User mailing list archive at Nabble.com.
schema.xml in other than conf folder
I want to place the schema.xml in a place other than conf folder. Is it possible? This is as part of master and slave configuration. I want to place all the files which will be common between master and slave in a particular location. Can anyone help me on this? -- View this message in context: http://lucene.472066.n3.nabble.com/schema-xml-in-other-than-conf-folder-tp2206587p2206587.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: schema.xml in other than conf folder
Erick, Thanks for your response. Our production environment is a read only file system. It is not allowing to modify or create new files under conf folder at runtime. So copy config through replication is not working for us. Thanks, SRD -- View this message in context: http://lucene.472066.n3.nabble.com/schema-xml-in-other-than-conf-folder-tp2206587p2210108.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Query performance issue while using EdgeNGram
1) Thanks for this update. I have to use 'WhiteSpaceTokenizer' 2) I have to suggest the whole query itself (Say name or title) 3) Could you please let me know if there is a way to find the evicted docs? 4) Yes, we are seeing improvement in the response time if we optimize. But still for some queries QTime is more than 8 secs. It is a 'Blocker' for us. Could you please suggest any to reduce the QTime to 1 secs. -- View this message in context: http://lucene.472066.n3.nabble.com/Query-performance-issue-while-using-EdgeNGram-tp2097056p2130751.html Sent from the Solr - User mailing list archive at Nabble.com.
SOLR 1.4.1 : Indexing DateField time zone problem
I am using SOLR 1.4.1. My SOLR runs in a server which is in EST zone. I am trying to index a date field which is in MySQL as '2007-08-08T05:36:50Z' but while indexing it becomes '2007-08-08T09:36:50Z' where 4 hours got increased. But I want the date as is while indexing, means, after indexing I want the value as '2007-08-08T05:36:50Z' in 'modified_d' field. Can anyone help me on this? field column=post_modified name=modified_d dateTimeFormat=-MM-dd'T'hh:mm:ss'Z' / I searched in this forum and there are discussions on this same problem but on SOLR 1.3, that's why I am posting this query again. -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-1-4-1-Indexing-DateField-time-zone-problem-tp1966118p1966118.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: copyField is not tokenizing the values at index time
Thanks Erick. -- View this message in context: http://lucene.472066.n3.nabble.com/copyField-is-not-tokenizing-the-values-at-index-time-tp1952756p1958946.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Spell-Check Component Functionality
SOLR wiki page is the best place to find that. http://stackoverflow.com/questions/3004823/solr-spellcheck-configuration http://wiki.apache.org/solr/SpellCheckerRequestHandler http://wiki.apache.org/solr/SpellCheckComponent -- View this message in context: http://lucene.472066.n3.nabble.com/Spell-Check-Component-Functionality-tp1923954p1944011.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Meaning of avgTimePerRequest avgRequestsPerSecond in SOLR stats page
Thanks Erick. -- View this message in context: http://lucene.472066.n3.nabble.com/Meaning-of-avgTimePerRequest-avgRequestsPerSecond-in-SOLR-stats-page-tp1922692p1932275.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Meaning of avgTimePerRequest avgRequestsPerSecond in SOLR stats page
Erick, Thanks a lot for explaining about these two fields. Could you please let us know which one we have to look for if we have to monitor the performance? avgTimePerRequest OR avgRequestsPerSecond. Thanks, SRD -- View this message in context: http://lucene.472066.n3.nabble.com/Meaning-of-avgTimePerRequest-avgRequestsPerSecond-in-SOLR-stats-page-tp1922692p1925407.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Spell-Check Component Functionality
Did you configure below one in your default request handler? arr name=last-components strspellcheck/str /arr -- View this message in context: http://lucene.472066.n3.nabble.com/Spell-Check-Component-Functionality-tp1923954p1929124.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: DateFormatTransformer issue with value 0000-00-00T00:00:00Z
Thanks for your reply. I am indexing docs in XML using DIH. I am not using MySQL to import data. -- View this message in context: http://lucene.472066.n3.nabble.com/DateFormatTransformer-issue-with-value--00-00T00-00-00Z-tp1910644p1916712.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: DateFormatTransformer issue with value 0000-00-00T00:00:00Z
I tried this in JAVA where the SOLR runs. Is it problem due to the encoding? Code: GregorianCalendar calendar = new GregorianCalendar(TimeZone.getTimeZone(US/Eastern), Locale.US); System.out.println(calendar.getTime()); calendar.set(0, 0, 0, 0, 0, 0); System.out.println(calendar.getTime()); System.out.println(System property: +System.getProperty(file.encoding)); Output: Thu Nov 18 02:13:00 EST 2010 Wed Dec 31 00:00:00 EST 2 System property: UTF-8 -- View this message in context: http://lucene.472066.n3.nabble.com/DateFormatTransformer-issue-with-value--00-00T00-00-00Z-tp1910644p1922354.html Sent from the Solr - User mailing list archive at Nabble.com.
DateFormatTransformer issue with value 0000-00-00T00:00:00Z
Hi, I am having a field as below in my feed. field name=published_from_dt-00-00T00:00:00Z/field I have configured the field as below in data-config.xml. field column=published_from_dt xpath=/add/doc/fie...@name='published_from_dt'] dateTimeFormat=-MM-dd'T'hh:mm:ss'Z' / But after indexing, the field value becomes like this date name=published_from_dt0002-11-30T00:00:00Z/date I want to have the value as '-00-00T00:00:00Z' after indexing also. Could anyone help on this? PS: I am using solr 1.4.1 -- View this message in context: http://lucene.472066.n3.nabble.com/DateFormatTransformer-issue-with-value--00-00T00-00-00Z-tp1910644p1910644.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Index time boosting is not working with boosting value in document level
Thanks Iorixxx... Boosting is working while using DIH to import XML. Thanks, SRD -- View this message in context: http://lucene.472066.n3.nabble.com/Index-time-boosting-is-not-working-with-boosting-value-in-document-level-tp1649072p1693423.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Index time boosting is not working with boosting value in document level
Thanks a ton Eric and Iorixxx. Since I used DIH to import XML data, boosting was not reflected in score. When I used /update to import XML data, boosting was considered for scoring and able to see the intended data on top 10 results. Could you please let me know how to make boosting value to be reflected in score while using DIH to index XML docs? -- View this message in context: http://lucene.472066.n3.nabble.com/Index-time-boosting-is-not-working-with-boosting-value-in-document-level-tp1649072p1686445.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Index time boosting is not working with boosting value in document level
Eric, Score is not coming properly even after giving boost value in document and field level. Please find the solrconfig.xml, schema.xml, data-config.xml, the feed and the score query. Doc with id 'ABCDEF/L' is boosted and doc with id 'MA147LL/A' is not boosted, but both are returning same score - 0.1942141. Could you please help me to find where I did a mistake? solrconfig.xml config updateHandler class=solr.DirectUpdateHandler2 / requestDispatcher handleSelect=true requestParsers enableRemoteStreaming=false multipartUploadLimitInKB=2048 / /requestDispatcher !-- requestHandler name=standard class=solr.SearchHandler default=true / -- requestHandler name=/dataimport class=org.apache.solr.handler.dataimport.DataImportHandler lst name=defaults str name=configdata-config.xml/str /lst /requestHandler requestHandler name=standard class=solr.StandardRequestHandler default=true / requestHandler name=/update class=solr.XmlUpdateRequestHandler / requestHandler name=/admin/ class=org.apache.solr.handler.admin.AdminHandlers / !-- config for the admin interface -- admin defaultQuerysolr/defaultQuery /admin /config schema.xml schema name=example core zero version=1.1 types fieldtype name=string class=solr.StrField sortMissingLast=true omitNorms=false/ fieldType name=text class=solr.TextField positionIncrementGap=100 omitNorms=false analyzer type=index tokenizer class=solr.StandardTokenizerFactory/ filter class=solr.SynonymFilterFactory synonyms=synonyms.txt ignoreCase=true expand=true/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 generateNumberParts=1 catenateWords=1 catenateNumbers=1 catenateAll=0 splitOnCaseChange=1/ filter class=solr.StopFilterFactory ignoreCase=true words=stopwords.txt/ filter class=solr.LowerCaseFilterFactory/ !-- filter class=solr.EnglishPorterFilterFactory protected=protwords.txt/ -- filter class=solr.RemoveDuplicatesTokenFilterFactory/ /analyzer analyzer type=query tokenizer class=solr.StandardTokenizerFactory/ !--filter class=solr.SynonymFilterFactory synonyms=synonyms.txt ignoreCase=true expand=false/-- filter class=solr.WordDelimiterFilterFactory generateWordParts=1 generateNumberParts=1 catenateWords=0 catenateNumbers=0 catenateAll=0 splitOnCaseChange=1/ filter class=solr.StopFilterFactory ignoreCase=true words=stopwords.txt/ filter class=solr.LowerCaseFilterFactory/ !-- filter class=solr.EnglishPorterFilterFactory protected=protwords.txt/ -- filter class=solr.RemoveDuplicatesTokenFilterFactory/ /analyzer /fieldType /types fields !-- general -- field name=id type=string indexed=true stored=true multiValued=false required=true/ field name=typetype=string indexed=true stored=true multiValued=false / field name=nametype=text indexed=true stored=true multiValued=false omitNorms=false/ field name=core0 type=string indexed=true stored=true multiValued=false / /fields !-- field to use to determine and enforce document uniqueness. -- uniqueKeyid/uniqueKey !-- field for the QueryParser to use when an explicit fieldname is absent -- defaultSearchFieldname/defaultSearchField !-- SolrQueryParser configuration: defaultOperator=AND|OR -- solrQueryParser defaultOperator=OR/ /schema data-config.xml dataConfig dataSource type=HttpDataSource name=http encoding=UTF-8 connectionTimeout=3 readTimeout=6/ dataSource type=FileDataSource name=file encoding=UTF-8 connectionTimeout=3 readTimeout=6/ document entity name=musicplayer dataSource=file url=\home\srd\exampledocs\ipod_other.xml processor=XPathEntityProcessor useSolrAddSchema=false stream=true forEach=/add/doc/ pk=id transformer=DateFormatTransformer field column=id xpath=/add/doc/fie...@name='id'] / field column=name xpath=/add/doc/fie...@name='name'] / /entity /document /dataConfig feed add doc field name=idF8V7067-APL-KIT/field field name=nameBelkin Mobile Power Cord for iPod w/ Dock/field /doc doc field name=idIW-02/field field name=nameiPod amp; iPod Mini USB 2.0 Cable/field /doc doc field name=idMA147LL/A/field field name=nameApple 60 GB iPod with Video Playback Black/field /doc doc boost=17.7 field name=idABCDEF/L/field field name=name boost=7.17Apple 60 GB iPod with Video Playback Black/field /doc /add Query Response http://localhost:8080/solr/core0/select/?q=ipodversion=2.2start=0rows=10indent=onfl=score response lst name=responseHeader int name=status0/int int name=QTime15/int /lst result name=response numFound=4 start=0 maxScore=0.27466023 doc float name=score0.27466023/float str name=idIW-02/str str name=nameiPod iPod Mini USB 2.0 Cable/str /doc doc float name=score0.24276763/float str name=idF8V7067-APL-KIT/str str name=nameBelkin Mobile Power Cord for iPod w/
Re: SOLR 1.4.1 to SOLR 1.3 issues (backward compatability issue)
Thank you Otis. It solved the problem. -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-1-4-1-to-SOLR-1-3-issues-backward-compatability-issue-tp1649789p1664057.html Sent from the Solr - User mailing list archive at Nabble.com.
Index time boosting is not working with boosting value in document level
We are having 10 documents (all 10 documents with name_s=john) with boosting value 10.0 in doc level out of 100 documents. DataImportHandler is used to index the documents in xml. We gave omitNorms=false in a field called text and having schema.xml configured as below. Default query field is text, when i use q=john at query time the documents which are having boosting is not coming in first 10 results. However the max score for the query q=john is coming as 2.621 Could anyone help on this issue? fields field name=text type=text indexed=true stored=false multiValued=true omitNorms=false/ dynamicField name=*_t type=textindexed=true stored=true multiValued=true/ dynamicField name=*_s type=string indexed=true stored=true multiValued=true/ /fields copyField source=name_s dest=name_t/ copyField source=*_t dest=text/ -- View this message in context: http://lucene.472066.n3.nabble.com/Index-time-boosting-is-not-working-with-boosting-value-in-document-level-tp1649072p1649072.html Sent from the Solr - User mailing list archive at Nabble.com.
SOLR 1.4.1 to SOLR 1.3 issues (backward compatability issue)
When I tried to roll back from SOLR 1.4.1 to SOLR 1.3, I am unable to view the admin page alone rest of the functionality are fine. I removed the index folder before reverting back to SOLR 1.3. Does any one have answer for this? -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-1-4-1-to-SOLR-1-3-issues-backward-compatability-issue-tp1649789p1649789.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SOLR 1.4.1 to SOLR 1.3 issues (backward compatability issue)
Thank you Otis. I will try these steps. Yes, it is not about indexing issue. Index and search functionality are working fine. Only admin page is not accessible. There is a process in our company to look for the roll back option while moving any changes to LIVE/Production. As part of that we found this issue. Thanks, SRD -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-1-4-1-to-SOLR-1-3-issues-backward-compatability-issue-tp1649789p1663704.html Sent from the Solr - User mailing list archive at Nabble.com.
