Re: Filtering results based on a set of values for a field

2011-08-18 Thread Tomas Zerolo
On Thu, Aug 18, 2011 at 02:32:48PM -0400, Erick Erickson wrote: > Hmmm, I'm still not getting it... > > You have one or more lists. These lists change once a month or so. Are > you trying > to include or exclude the documents in these lists? In our specific case to include *only* the documents ha

Boost documents based on the number of their fields

2011-08-18 Thread SR
Hi there, My documents have a title, a textual description and might have an image, and a video. During the querying process, I search across the textual fields of the documents (title and description). In order to sort the documents that match with my query, I'd like to give a boost to those

Re: hl.useFastVectorHighlighter, fragmentsBuilder and HighlightingParameters

2011-08-18 Thread Koji Sekiguchi
(11/08/19 4:14), Alexei Martchenko wrote: Hi Koji thanks for the reply. My is defined directly in. SOLR 3.3 warns me is a deprecated form do you think it is in the wrong place? Hi Alexei, Yes, it is incorrect. What deprecate is that tag just under directly. After 3.1, it needs to be

Re: get update record from database using DIH

2011-08-18 Thread Alexandre Sompheng
Hi guys, i try the delta import, i got logs saying that it found delta data to update. But it seems that the index is not updated. Amy guess why this happens ? Did i miss something? I'm on solr 3.3 with no patch. Thanks On 18 août 2011, at 18:10, Dali wrote: Hello Take a look at the delta impo

RE: Stable Linux Release

2011-08-18 Thread Cupbearer
Just for posterity sake: I was correct in that it had to do with the fsockopen() function in php. However, the issue was in SELinux and not in any of my other configuration. Even when I tried to disable SELinux to test if it was a firewall issue apparently whatever was set in the Boolean’s ge

Re: overhead of empty, unused fields

2011-08-18 Thread Markus Jelsma
No problem. A document without a value for some field simply doesn't have an entry in the inverted index. > hi all, > > What are the cost of unused field types? > > Our application supports multiple languages. We envision separate > Lucene/Solr fields (and field types) per language (conten_en,

overhead of empty, unused fields

2011-08-18 Thread Will Milspec
hi all, What are the cost of unused field types? Our application supports multiple languages. We envision separate Lucene/Solr fields (and field types) per language (conten_en, content_fr, content_zh_CN,etc). We thought of a few optons: a) auto-generating the 'multilingual' portion of the schema

Re: Update field value in the document based on value of another field in the document

2011-08-18 Thread simon
An UpdateRequestProcessor would do the trick. Look at the (rather minimal) documentation and code example in http://wiki.apache.org/solr/UpdateRequestProcessor -Simon On Thu, Aug 18, 2011 at 4:15 PM, bhawna singh wrote: > Hi All, > I have a requirement to update a certain field value depending

RE: Solr spellcheck and multiple collations

2011-08-18 Thread Herman Kiefus
Nice catch, I was sending maxCollations with a capital M. -Original Message- From: Dyer, James [mailto:james.d...@ingrambook.com] Sent: Wednesday, August 17, 2011 6:10 PM To: solr-user@lucene.apache.org Subject: RE: Solr spellcheck and multiple collations I quickly went through what you'

Re: suggester issues

2011-08-18 Thread William Oberman
I tried this: package com.civicscience; import java.util.ArrayList; import java.util.Collection; import java.util.Collections; import org.apache.lucene.analysis.Token; import org.apache.solr.spelling.QueryConverter; /**

Re: Synonym and Whitespaces and optional TokenizerFactory

2011-08-18 Thread Ravi Solr
If you have multi-word synonyms you could use - tokenizerFactory="solr.KeywordTokenizerFactory" - in the SynonymFilterFactory filter factory declaration. This assumes that your tokenizer for that field allows for keeping the phrases as a single token (achieved by using solr.KeywordTokenizerFactory

Update field value in the document based on value of another field in the document

2011-08-18 Thread bhawna singh
Hi All, I have a requirement to update a certain field value depending on the field value of another field. To elaborate- I have a field called 'popularity' and a field called 'URL'. I need to assign popularity value depending on the domain (URL) ( I have the popularity and domain mapping in a text

Re: Synonym and Whitespaces and optional TokenizerFactory

2011-08-18 Thread Ravi Solr
If you have multi-word synonyms you could use - tokenizerFactory="solr.KeywordTokenizerFactory" - in the SynonymFilterFactory filter factory declaration. This assumes that your tokenizer for that field allows for keeping the phrases as a single token (achieved by using solr.KeywordTokenizerFactory

Re: IndexTank technology...

2011-08-18 Thread Cupbearer
btw, i was told by Matt Weber who's the wordpress plugin/solr developer that I've been talking to that this was a solr search that I could maybe use for my WordPress Multisite search functionality. After reading through it all it was missing something that I needed, but according to him it is Solr

RE: Stable Linux Release

2011-08-18 Thread Cupbearer
Since this doesn’t seem to be something that the community is interested in answering could they at least point me to some sort of documentation somewhere or the appropriate forum to ask this question? Or is everyone just compiling php from source if they have made it this far and decided to us

Re: Synonym and Whitespaces and optional TokenizerFactory

2011-08-18 Thread Markus Jelsma
How about escaping white\ space? cheers > Hmmm, why doesn't the multi word synonym syntax in your > synonym.txt handle this case? Or am I missing something > totally? > > Best > Erick > > On Wed, Aug 17, 2011 at 10:02 PM, Will Milspec wrote: > > Hi all, > > > > This may be obvious. My quest

Re: Synonym and Whitespaces and optional TokenizerFactory

2011-08-18 Thread Erick Erickson
Hmmm, why doesn't the multi word synonym syntax in your synonym.txt handle this case? Or am I missing something totally? Best Erick On Wed, Aug 17, 2011 at 10:02 PM, Will Milspec wrote: > Hi all, > > This may be obvious. My question pertains to use of tokenizerFactory > together with SynonymFilt

Re: hl.useFastVectorHighlighter, fragmentsBuilder and HighlightingParameters

2011-08-18 Thread Alexei Martchenko
Hi Koji thanks for the reply. My is defined directly in . SOLR 3.3 warns me is a deprecated form do you think it is in the wrong place? 2011/8/17 Koji Sekiguchi > Alexei, > > From the log, I think Solr couldn't find colored fragmentsBuilder defined > in solrconfig.xml. > Can you check the

Re: Stable Linux Release

2011-08-18 Thread Glen Newton
Please take this discussion off list. Thanks, Glen On Thu, Aug 18, 2011 at 3:02 PM, Gora Mohanty wrote: > On Fri, Aug 19, 2011 at 12:15 AM, Cupbearer wrote: >> What are the Prerequite libraries required to get Solr to work in Php.   >> Php.net has libxml2 and libcurlx I think (off the top of my

Re: Stable Linux Release

2011-08-18 Thread Gora Mohanty
On Fri, Aug 19, 2011 at 12:15 AM, Cupbearer wrote: > What are the Prerequite libraries required to get Solr to work in Php.   > Php.net has libxml2 and libcurlx I think (off the top of my head)  I have > those installed correctly and I can get to my Solr/admin page from a browser > just fine and

RE: Stable Linux Release

2011-08-18 Thread Cupbearer
What are the Prerequite libraries required to get Solr to work in Php. Php.net has libxml2 and libcurlx I think (off the top of my head) I have those installed correctly and I can get to my Solr/admin page from a browser just fine and ping and all of those things just fine from within the brow

Re: Stable Linux Release

2011-08-18 Thread Gora Mohanty
On Thu, Aug 18, 2011 at 11:48 PM, Cupbearer wrote: > I’m not sure where a better place would be.  The problems I seem to be having > revolve around having the right prerequisites installed in my Apache and Php > installs to get this done.  I’m unsure that a Generic Linux forum would know > and

Re: suggester issues

2011-08-18 Thread Alexei Martchenko
It can be done, I did that with shingles, but it's not the way it's meant to be. The main problem with suggester is that we want compound words and we never get them. I try to get "internet explorer" but when i enter in the second word, "internet e" the suggester never finds "explorer". 2011/8/18

Re: Filtering results based on a set of values for a field

2011-08-18 Thread Erick Erickson
Hmmm, I'm still not getting it... You have one or more lists. These lists change once a month or so. Are you trying to include or exclude the documents in these lists? And do the authors you want to include or exclude change on a per-query basis or would you be all set if you just had a filter tha

Re: Stable Linux Release

2011-08-18 Thread Markus Jelsma
Gora is right, this is not the right place for Linux or PHP questions for whatever distro. Solr will run happily on ANY Linux box with a bit of RAM, diskspace and CPU time and a Java 5 JVM and a servlet container. So far you haven't asked any Solr specific question or problem description. > I t

Re: suggester issues

2011-08-18 Thread oberman_cs
I was trying to deal with the exact same issue, with the exact same results. Is there really no way to feed a phrase into the suggester (spellchecker) without it splitting the input phrase into words? -- View this message in context: http://lucene.472066.n3.nabble.com/suggester-issues-tp3262718p

RE: Stable Linux Release

2011-08-18 Thread Cupbearer
I’m not sure where a better place would be. The problems I seem to be having revolve around having the right prerequisites installed in my Apache and Php installs to get this done. I’m unsure that a Generic Linux forum would know and understand the Solr prerequisites better than the Solr commu

Re: Solr Accent Insensitive and sensitive search

2011-08-18 Thread Erick Erickson
Well, we can't tell. Because you haven't identified the field you are working with. So, we need two additional pieces of information: the query you use that works the query you use that doesn't work And attach &debugQuery=on to both of them and post the results back please. But looking at the a

Re: ClassNotFoundException when trying to make spellcheck JaraWinkler working

2011-08-18 Thread Alexei Martchenko
Good knowledge for everybody, those little mistakes like spaces, typos and lack of commas makes lose so many time. thanks for posting this. 2011/8/18 Mike Mander > Solution found. > The original solr-config.xml jarowinkler definition had some line breaks. > If i write the difinition in one line

RE: Full sentence spellcheck

2011-08-18 Thread Dyer, James
If you use "spellcheck.q", you also still need to specify "q" for the queryhandler, otherwise you'll get an NPE. Not sure that's your problem but its one thing to check. James Dyer E-Commerce Systems Ingram Content Group (615) 213-4311 -Original Message- From: Valentin [mailto:igorlac

Re: XSLT Exception

2011-08-18 Thread Christopher Gross
Ah, that makes sense. I'm still confused as to why Solr 1.4 would let that go, then. Thanks! -- Chris On Thu, Aug 18, 2011 at 12:39 PM, Jaeger, Jay - DOT wrote: > I am not an XSLT expert, but believe that in XSLT, "not" is a function, > rather than an operator. > > http://www.w3.org/TR/xpat

RE: XSLT Exception

2011-08-18 Thread Jaeger, Jay - DOT
I am not an XSLT expert, but believe that in XSLT, "not" is a function, rather than an operator. http://www.w3.org/TR/xpath-functions/#func-not So, not(contains)) rather than not contains() should presumably do the trick. -Original Message- From: Christopher Gross [mailto:cog

Re: without usage of full-import command and delta-import command

2011-08-18 Thread Gora Mohanty
On Thu, Aug 18, 2011 at 5:42 PM, vighnesh wrote: > is it possible to get the new record from a updataed table using solr without > executiing full-import and delta-import commands? It is not clear why you are imposing this restriction. > when i can make change in solr query i need to get that ne

Re: magento-solr integration

2011-08-18 Thread Gora Mohanty
On Wed, Aug 17, 2011 at 8:38 PM, Harsha Vardhan Muthyala wrote: > Hi, > > Not sure if this is right forum to ask a question regarding installation. > But the admin page on solr screen pointed to this address. > > We have followed the installation procedure mentioned at > http://www.summasolutions

RE: Solr Copyfields

2011-08-18 Thread Jaeger, Jay - DOT
I would suggest #3, unless you have some very unusual performance requirements. It has the advantage of isolating your index environment requirements from the database. -Original Message- From: Nicholas Fellows [mailto:n...@djdownload.com] Sent: Thursday, August 18, 2011 8:40 AM To:

Re: solr integration with jquery client page?

2011-08-18 Thread Gora Mohanty
On Thu, Aug 18, 2011 at 12:14 PM, nagarjuna wrote: > hi every body... >   i queried following solr query > http://localhost:8080/solr/db/select/?q=test&version=2.2&start=0&rows=10&indent=on&fl=keywords&omitHeader=true > http://localhost:8080/solr/db/select/?q=test&version=2.2&start=0&rows=10&inden

without usage of full-import command and delta-import command

2011-08-18 Thread vighnesh
is it possible to get the new record from a updataed table using solr without executiing full-import and delta-import commands? when i can make change in solr query i need to get that newly inserted record from a databse. http://localhost:8983/solr/db/select/?q=test&version=2.2&start=0&rows=10&in

Re: get update record from database using DIH

2011-08-18 Thread Dali
Hello Take a look at the delta import example : http://wiki.apache.org/solr/DataImportHandler http://wiki.apache.org/solr/DataImportHandler Regards -- View this message in context: http://lucene.472066.n3.nabble.com/get-update-record-from-database-using-DIH-tp3264126p3264393.html Sent from the

Re: DataImportHandler under Tomcat

2011-08-18 Thread Dali
It's likely to be a problem of version. I turned out to solr 3.3.0 and it works fine :) -- View this message in context: http://lucene.472066.n3.nabble.com/DataImportHandler-under-Tomcat-tp3264142p3264239.html Sent from the Solr - User mailing list archive at Nabble.com.

DataImportHandler under Tomcat

2011-08-18 Thread Dali
Hello everybody, I'm using solr 1.4.1 under tomcat 6.0.32 and i well configured (data-config.xml, solrconfig.xml and schema.xml) as described in the wiki to index data from mysql database. But when i access dataimport console, i'm getting a screen divided in two parts: -One at the left side displ

RE: Synonym and Whitespaces and optional TokenizerFactory

2011-08-18 Thread Jaeger, Jay - DOT
You could presumably do it with solr.PatternTokenizerFactory with the pattern set to .* as your Or, maybe, if Solr allows it, you don't use any tokenizer at all? Or, maybe you could use solr.WhitespaceTokenizerFactory, allowing it to split up the words, along with solr.WordDelimiterFilterFacto

get update record from database using DIH

2011-08-18 Thread vighnesh
hi everyone let me know about how to get update record from database using solr without executing full-import command. thanks in advance vighnesh -- View this message in context: http://lucene.472066.n3.nabble.com/get-update-record-from-database-using-DIH-tp3264126p3264126.html Sent f

When are you planning to release SolrCloud feature with ZooKeeper?

2011-08-18 Thread Way Cool
Hi, guys, When are you planning to release the SolrCloud feature with ZooKeeper currently in trunk? The new admin interface looks great. Great job. Thanks, YH

Re: lucene 3 and merge/optimize

2011-08-18 Thread olivier sallou
answer to myself, to be checked... I used policy.setMaxMergeDocs(10), limiting to small number of filesat least for merge. I gonna test. 2011/8/18 olivier sallou > Hi, > after an upgrade to solr/lucene 3, I tried to change the code to remove > deprecated functions Though new MergePoli

Full sentence spellcheck

2011-08-18 Thread Valentin
I'm trying to configure a spellchecker to autocomplete full sentences from my query. I've already been able to get this results: /"american israel" : -> "american something" -> "israel something"/ But i want : /"american israel" : -> "american israel something"/ This is my solrconfig.xml : /

Re: Query does not work when changing param order

2011-08-18 Thread Juan Manuel Alvarez
Sorry it took me so long to answer, but that issue turned into low priority and I resume it today. Adding a filter query for each tag worked great! Thank you! =o) Juan M. On Thu, Jul 7, 2011 at 7:10 PM, Juan Grande wrote: > Hi Juan! > > I think your problem is that in the second case the FieldQ

Re: Exact Match using Copy Fields

2011-08-18 Thread Juan Grande
Hi, are you sure you're using dismax query parser? Make sure you have the parameter "defType=dismax" in your request. *Juan* On Thu, Aug 18, 2011 at 11:22 AM, jyn7 wrote: > Hi, > > I am trying to achieve an exact match search on a text field. I am using a > copy field and copying it to a stri

Re: Periodic search in date field

2011-08-18 Thread Gora Mohanty
On Wed, Aug 17, 2011 at 1:07 PM, slaava wrote: > Thanks for quick reply! > > Yes, this is my backup solution. But I prefer some one-query approach - > there could be many results so I want use SolrQuery.start() and > SolrQuery.rows() and show persons in table with paging. Was suggesting just one

lucene 3 and merge/optimize

2011-08-18 Thread olivier sallou
Hi, after an upgrade to solr/lucene 3, I tried to change the code to remove deprecated functions Though new MergePolicy etc... are not really clear. I have now issues with the merge and optimize functions. I have a command line application (Java/Lucene api) that merge multiple indexes in a s

Re: Content recommendation using solr?

2011-08-18 Thread Omri Cohen
check out OutBrain

Exact Match using Copy Fields

2011-08-18 Thread jyn7
Hi, I am trying to achieve an exact match search on a text field. I am using a copy field and copying it to a string and using that for the search. and now I want to do an exact match on the imprint field and am trying to search using the below, and the results are not limited to im

Content recommendation using solr?

2011-08-18 Thread Arcadius Ahouansou
Hello. I'm doing some research regarding the usage of Solr for implementing content recommendation engines. Initially, I was looking at http://wiki.apache.org/solr/MoreLikeThis Then, it turned out that most implementations are based on a combination of Mahout, Solr and Hadoop. Please, are you

Solr read timeout

2011-08-18 Thread Tod
I'm using perl to indirectly call the solr ExtractingRequestHandler to stream remote documents into a solr index instance. Every 100 URL's I process I do a commit. I've got about 30K documents to be indexed. I'm using a stock, out of the box version of solr 1.4.1 with the necessary schema ch

Solr Copyfields

2011-08-18 Thread Nicholas Fellows
Hi I have a question regarding CopyFields in Solr As far as i can tell there are several ways to do the same thing 1) create an alias in the SQL Query and Delta Queries 2) specify multiple fields in the db-data-config.xml having different "names" for the same column 3) use the copyField directive

Re: Return records based on aggregate functions?

2011-08-18 Thread Daniel Skiles
It's actually an analyzed String. I figured that out after the first test run. On Thu, Aug 18, 2011 at 9:00 AM, Erick Erickson wrote: > Side comment: Is your content field really a "string" value in your > schema.xml? that's an un-analyzed type and unless you're > always searching for *exactly*

Re: Return records based on aggregate functions?

2011-08-18 Thread Erick Erickson
Side comment: Is your content field really a "string" value in your schema.xml? that's an un-analyzed type and unless you're always searching for *exactly* the full contents of the field, you'll have problems Best Erick On Wed, Aug 17, 2011 at 2:20 PM, Daniel Skiles wrote: > I've recently st

Re: Periodic search in date field

2011-08-18 Thread slaava
Very inspirating, great thanks! Idea with indexing last number of year is very good and covers current requirements. But one day there could be requirement for (as you said) 3-years anniversaries. So I do this: Index: For every required X-year anniversary there will be field "year_mod_X" with "YE

Re: Filtering results based on a set of values for a field

2011-08-18 Thread Tomas Zerolo
On Thu, Aug 18, 2011 at 08:36:08AM -0400, Erick Erickson wrote: > How does this list of authors get selected? The reason I'm asking is > I'm wondering > if you can "define the problem away". In other words, I'm wondering if this > is an XY problem (http://people.apache.org/~hossman/#xyproblem). :-

XSLT Exception

2011-08-18 Thread Christopher Gross
I'm using Solr 3.3, trying to run an XSLT translation on the results of a query. The xsl file worked just fine for Solr 1.4.1, but I'm having trouble with the newer version. The root cause is: javax.xml.transform.TransformerException: Extra illegal tokens: 'contains', '(', '$', 'posted', ',', ''0

Re: suggester issues

2011-08-18 Thread O. Klein
The problem lies in the suggester like the spellchecker, tokenizing on whitespace. So while shingles might give you nice suggestions, the behaviour of the Suggester makes it unusable. Besides that, I never succeeded in getting the suggester to show more collations then one. Normal spellchecker on

Re: Loggly support

2011-08-18 Thread Mark Miller
Hey Bill - try the syslog appender: http://logging.apache.org/log4j/1.2/apidocs/org/apache/log4j/net/SyslogAppender.html http://wiki.loggly.com/log4j On Aug 14, 2011, at 10:08 PM, Bill Bell wrote: > How do you setup log4j to work with Loggly for SOLR logs? > > Anyone have this set up? > > Bill

Re: Filtering results based on a set of values for a field

2011-08-18 Thread Erick Erickson
How does this list of authors get selected? The reason I'm asking is I'm wondering if you can "define the problem away". In other words, I'm wondering if this is an XY problem (http://people.apache.org/~hossman/#xyproblem). I can't imagine you expect a user to specify up to 2k authors, so there mu

Re: Solr Join in 3.3.x

2011-08-18 Thread Michael McCandless
Unfortunately Solr's join impl hasn't been backported to 3.x, as far as I know. You might want to look at ElasticSearch; it has a join implementation already or use Solr 4.0. Mike McCandless http://blog.mikemccandless.com On Wed, Aug 17, 2011 at 7:40 PM, Cameron Hurst wrote: > Hello all, >

Re: Periodic search in date field

2011-08-18 Thread Erick Erickson
Hmmm, doing this with date ranges would be a possibility, although that would be some really ugly filter queries... What would happen if you indexed a separate field that was just the last digit of the year, plus separate fields for year day and month? This assumes that 1, 5 and 10 are the only ra

Re: Solr Accent Insensitive and sensitive search

2011-08-18 Thread Denis WSRosa
Hi! Thank you for your response! here is my full schema:

Re: suggester issues

2011-08-18 Thread Kuba Krzemień
What happens if you set spellcheck.maxCollations to more than 1? -- From: "Alexei Martchenko" Sent: Wednesday, August 17, 2011 11:01 PM To: Subject: Re: suggester issues I've been indexing and reindexing stuff here with Shingles. I don't believe