Re: Exporting to CSV

2011-03-29 Thread Estrada Groups
Check out the trunk version of Solr and build that. Those mods are in there for sure. I think the version in trunk is 4.0 but that discussion should be on a different thread ;-) Adam On Mar 29, 2011, at 11:35 PM, Charles Wardell wrote: > Hi Koji, > > Do you mean that adding &wt=csv to my h

Re: Exporting to CSV

2011-03-29 Thread Charles Wardell
Hi Koji, Do you mean that adding &wt=csv to my http request will give me a csv? The only downloads that I see on the SOLR site is for 1.4.x Is there a 3.1 beta? On Mar 29, 2011, at 10:32 PM, Koji Sekiguchi wrote: > (11/03/30 10:59), Charles Wardell wrote: >> Is there an easy way to get queried

Re: Exporting to CSV

2011-03-29 Thread Koji Sekiguchi
(11/03/30 10:59), Charles Wardell wrote: Is there an easy way to get queried data exported from solr in a csv format? Hoping there is a handler or library for this. Charlie, Solr 3.1, will be released shortly, has csv response writer which is implicitly defined. Try &wt=csv request parameter.

Exporting to CSV

2011-03-29 Thread Charles Wardell
Is there an easy way to get queried data exported from solr in a csv format? Hoping there is a handler or library for this. Regards, charlie

Re: Fwd: machine tags, copy fields and pattern tokenizers

2011-03-29 Thread sukhdev
Hi, Was you able to solve machine tag problem in solr. Actually I am also looking if machine tags can be stored as index in solr and search in efficient way. Regards -- View this message in context: http://lucene.472066.n3.nabble.com/Fwd-machine-tags-copy-fields-and-pattern-tokenizers-tp50649

Re: catch_all field versus multiple OR Boolean query

2011-03-29 Thread Erick Erickson
It's not so much the Boolean as it is different field characteristics. The length of a field factors into the score, and a boolean query that goes against the individual fields will certainly score differently than putting all the fields in a catch-all which is, obviously, longer. Have you looked

Re: Matching on a multi valued field

2011-03-29 Thread Juan Pablo Mora
>> A multiValued field >> is actually a single field with all data separated with positionIncrement. >> Try setting that value high enough and use a PhraseQuery. That is true but you cannot do things like: q="bar* foo*"~10 with default query search. and if you use dismax you will have the same

catch_all field versus multiple OR Boolean query

2011-03-29 Thread Savvas-Andreas Moysidis
Hello, Currently in our index we have multiple fields and a catch_all field. When users select all search options we specify the catch_all field as the field to search on. This has worked very well for our needs but a question was recently raised within our team regarding the difference between

Re: Challenges of bundling Solr out-of-box

2011-03-29 Thread Markus Jelsma
Hi, You're right, there are new technical challenges for customers that don't have the experience in-house. Some customers have personnel you can teach how to monitor and maintain an installation. Others just take a service level agreement or just let it run forever without issues, if the envir

Re: Matching on a multi valued field

2011-03-29 Thread Markus Jelsma
orly, all replies came in while sending =) > Hi, > > Your filter query is looking for a match of "man's friend" in a single > field. Regardless of analysis of the common_names field, all terms are > present in the common_names field of both documents. A multiValued field > is actually a single fi

Re: Matching on a multi valued field

2011-03-29 Thread Markus Jelsma
Hi, Your filter query is looking for a match of "man's friend" in a single field. Regardless of analysis of the common_names field, all terms are present in the common_names field of both documents. A multiValued field is actually a single field with all data separated with positionIncrement. T

Re: Matching on a multi valued field

2011-03-29 Thread Savvas-Andreas Moysidis
my bad..just realised your problem.. :D On 29 March 2011 22:07, Savvas-Andreas Moysidis < savvas.andreas.moysi...@googlemail.com> wrote: > I assume you are using the Standard Handler? > In that case wouldn't something like: > "q=common_names:(man's friend)&q.op=AND" work? > > On 29 March 2011 21:

Re: Matching on a multi valued field

2011-03-29 Thread Erick Erickson
Two things need to be done. First, define positionIncrementGap (see http://wiki.apache.org/solr/SchemaXml) for the field. Then use phrase searches with the slop less than what you've defined for positionIncrementGap. Of course you'll have to have a positionIncrementGap larger than the number of t

Re: Matching on a multi valued field

2011-03-29 Thread Savvas-Andreas Moysidis
I assume you are using the Standard Handler? In that case wouldn't something like: "q=common_names:(man's friend)&q.op=AND" work? On 29 March 2011 21:57, Brian Lamb wrote: > Hi all, > > I have a field set up like this: > > stored="true" required="false" /> > > And I have some records: > > RECOR

Re: Matching on a multi valued field

2011-03-29 Thread Jonathan Rochkind
As far as I know, there's no support in Solr for "all words must match in the same value of a multi-valued field". I agree it would be useful in some cases. As long as you don't need to do an _actual_ phrase search, you can kind of fake it by using a phrase query, with the query slop set so hi

Matching on a multi valued field

2011-03-29 Thread Brian Lamb
Hi all, I have a field set up like this: And I have some records: RECORD1 man's best friend pooch RECORD2 man's worst enemy friend to no one Now if I do a search such as: http://localhost:8983/solr/search/?q=*:*&fq={!q.op=AND df=common_names}man's friend Both records are returne

RE: Javabin->JSon

2011-03-29 Thread Tim Gilbert
Markus is right, this isn't the list for Java questions, but you can look into Jackson. Jackson is a java binder that can convert java pojos into json. http://jackson.codehaus.org/ I use it in Spring MVC to convert my output to json. Tim -Original Message- From: paulohess [mailto:paulo

Re: Javabin->JSon

2011-03-29 Thread paulohess
you are not helping -- View this message in context: http://lucene.472066.n3.nabble.com/Javabin-JSon-tp2750066p2750461.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: DIH with XML question.

2011-03-29 Thread Erick Erickson
Set the multiValued="true" attribute on the field definition. Note it is case sensitive. See: http://wiki.apache.org/solr/SchemaXml Best Erick On Tue, Mar 29, 2011 at 3:58 PM, Marcelo Iturbe wrote: > Hello, > I have an XML with multiple nodes with the same name. > > In the data-config.xml docum

Re: DIH with XML question.

2011-03-29 Thread neha
make sure the field "email" is multivalued in schema.xml file Neha -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-with-XML-question-tp2750288p2750416.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: String field

2011-03-29 Thread Brian Lamb
The full import wasn't spitting out any errors on the web page but in looking at the logs, there were errors. Correcting those errors solved that issue. Thanks, Brian Lamb On Tue, Mar 29, 2011 at 2:44 PM, Erick Erickson wrote: > try the schema browser from the admin page to be sure the fields >

DIH with XML question.

2011-03-29 Thread Marcelo Iturbe
Hello, I have an XML with multiple nodes with the same name. In the data-config.xml document, I have set up: But this only feeds the last email address into Solr (in the case bellow, mv...@yahoo.org appears in Solr). The XML for each entity is as follows: http://www.go

Re: Concatenate multivalued DIH fields

2011-03-29 Thread neha
Thank you for ur reply, but is there more documentation on Script Transformer?? I am newbie to Solr DIH. Can I send two rows as parameters to the script transformer function. Also what is the syntax to call the script transformer in the DIH field?? The documentation is not very clear about it. Tha

Re: Javabin->JSon

2011-03-29 Thread Markus Jelsma
You've asked this twice now. This is a Java specific question and unless someone feels like answering i'd try googling somewhere else. > Hi guys, > > I have a Javabin object and I need to convert that to a JSon object. How ? > pls help? > I am using solrj (client) that doesn't support JSON so (

Javabin->JSon

2011-03-29 Thread paulohess
Hi guys, I have a Javabin object and I need to convert that to a JSon object. How ? pls help? I am using solrj (client) that doesn't support JSON so (wt=json) won't convert it to JSon. thanks Paulo -- View this message in context: http://lucene.472066.n3.nabble.com/Javabin-JSon-tp2750066p27500

Re: Concatenate multivalued DIH fields

2011-03-29 Thread Markus Jelsma
Haven't tried your use case but i believe DIH's ScriptTransformer can do the trick. It seems to operate on rows so you can fetch both fields and add a concatenated field. http://wiki.apache.org/solr/DataImportHandler#ScriptTransformer > I have two multivalued DIH fields "fname" and "lname". I w

Concatenate multivalued DIH fields

2011-03-29 Thread neha
I have two multivalued DIH fields "fname" and "lname". I want to concatenate each of the fname and lname pairs to get a third multivalued DIH field "name". I tried this : But the result is : [Lars L., Helle K., Thomas A., Jes] [Thomsen, Iversen, Brinck, Olesen], instead of Lars L. Thomsen

Re: String field

2011-03-29 Thread Erick Erickson
try the schema browser from the admin page to be sure the fields you *think* are in the index really are. Did you do a commit after indexing? Did you re-index after the schema changes? Are you 100% sure that, if you did re-index, the new fields were in the docs submitted? Best Erick On Tue, Mar 2

Re: 2 index within the same Solr server ?

2011-03-29 Thread Rahul Warawdekar
Please refer http://wiki.apache.org/solr/MultipleIndexes On 3/29/11, Amel Fraisse wrote: > Hello every body, > > Is it possible to create 2 index within the same Solr server ? > > Thank you. > > Amel. > -- Thanks and Regards Rahul A. Warawdekar

Re: FW: no results searching for stadium seating chairs

2011-03-29 Thread Jonathan Rochkind
It seems unlikely you are going to find something that stems everything exactly how you want it, and nothing how you don't want it. This is very domain dependent, as you've discovered. I doubt there's even such a thing as the way everyone doing a 'retail product title search' would want it, it'

Re: 2 index within the same Solr server ?

2011-03-29 Thread litan1...@gmail.com
Yes, you can use multicore to create 2nd index from 1st index Sent from my iPhone On Mar 29, 2011, at 6:01, Amel Fraisse wrote: > Hello every body, > > Is it possible to create 2 index within the same Solr server ? > > Thank you. > > Amel.

RE: FW: no results searching for stadium seating chairs

2011-03-29 Thread Robert Petersen
For retail product title search, would there be a better stemmer to use? We wanted a less aggressive stemmer, but I would expect the term seating to stem. I have found several other words which end in ing and do not get stemmed. Amongst our product lines are four million books with all kinds

Re: FW: no results searching for stadium seating chairs

2011-03-29 Thread Yonik Seeley
On Tue, Mar 29, 2011 at 1:17 PM, Robert Petersen wrote: > Very interestingly, LucidKStemFilterFactory is stemming ‘ing’s differently > for different words.  The word ‘seating’ doesn't lose the 'ing' but the word > ‘counseling’ does!  Can anyone explain the difference here?  protwords.txt is > e

FW: no results searching for stadium seating chairs

2011-03-29 Thread Robert Petersen
Very interestingly, LucidKStemFilterFactory is stemming ‘ing’s differently for different words. The word ‘seating’ doesn't lose the 'ing' but the word ‘counseling’ does! Can anyone explain the difference here? protwords.txt is empty btw. com.lucidimagination.solrworks.analysis.LucidKSt

Re: String field

2011-03-29 Thread Scott Gonyea
First, make sure your request handler is set to spit out everything. I take it you did, but I hate to assume. Second, I suggest indexing your data twice. One as tokenized-text, the other as a string. It'll save you from howling at the moon in anguish... Unless you really only do care about pure

Why do .nfs* files still exist after opening a new searcher?

2011-03-29 Thread flin
I'm running a Solr (1.3) slave machine over NFS. The problem is, whenever I updated the index directory from the newest snapshot, and try to use bin/commit or bin/readercycle to open a new searcher, the temporary .nfs* files do not get cleared. I thought that the new searcher should read the new s

String field

2011-03-29 Thread Brian Lamb
Hi all, I'm a little confused about the string field. I read somewhere that if I want to do an exact match, I should use an exact match. So I made a few modifications to my schema file: And did a full import but when I do a search and return all fields, only id is showing up. The only differ

Re: [WKT] Spatial Searching

2011-03-29 Thread Walter Underwood
On Mar 29, 2011, at 8:12 AM, Mattmann, Chris A (388J) wrote: >> >> RE SIS... I wonder how the expertise on that project compares to that of >> JTS's Martin Davis -- an expert, and the library has been in use for 10 >> years. > > Time will tell. I'd favor the Apache model where instead of name

Re: [WKT] Spatial Searching

2011-03-29 Thread Mattmann, Chris A (388J)
> > It's not saying specifically we can't compile against LGPL, it's ambiguously > saying "include". I take that to mean the result of the build -- e.g. class > and jar files, which may not include LGPL. This uncertainty was was enough to make it a non starter for us. > RE SIS... I wonder h

Conditional Scoring (was: Re: DisMaxQueryParser: Unknown function min in FunctionQuery)

2011-03-29 Thread Robert Gründler
sorry, didn't see that. So, as also the relevance functions are only available in solr > 4.0 (http://wiki.apache.org/solr/FunctionQuery#Relevance_Functions), i'm not sure if i can solve our requirement in one query ( i thought i could use a function query for this). Here's our Problem: We h

Re: Wanted: a directory of quick-and-(not too)dirty analyzers for multi-language RDF.

2011-03-29 Thread fr . jurain
Hi Solrists, thank you for your kind responses. Grant, François, I'll keep your advice in mind & your links in store; they may be useful in one of my use cases, even though I doubt they might in the primary one. As RDF litterals, my documents are affixed with language tags @en, @fr, @ja &c,

Re: DisMaxQueryParser: Unknown function min in FunctionQuery

2011-03-29 Thread Erik Hatcher
On Mar 29, 2011, at 10:01 , Robert Gründler wrote: > Hi all, > > i'm trying to implement a FunctionQuery using the "bf" parameter of the > DisMaxQueryParser, however, i'm getting an exception: > > "Unknown function min in FunctionQuery('min(1,2)', pos=4)" > > The request that causes the error

Long list of shards breaks solrj query

2011-03-29 Thread JohnRodey
So I have a simple class that builds a SolrQuery and sets the "shards" param. I have a really long list of shards, over 250. My search seems to work until I get my shard list up to a certain length. As soon as I add one more shard I get: org.apache.commons.httpclient.HttpMethodDirector executeWi

[infomercial] Lucene Refcard at DZone

2011-03-29 Thread Erik Hatcher
I've written an "Understanding Lucene" refcard that has just been published at DZone. See here for details: http://www.lucidimagination.com/blog/2011/03/28/understanding-lucene-by-erik-hatcher-free-dzone-refcard-now-available/ If you're new to Lucene or Solr, this refcard will be a nice gro

DisMaxQueryParser: Unknown function min in FunctionQuery

2011-03-29 Thread Robert Gründler
Hi all, i'm trying to implement a FunctionQuery using the "bf" parameter of the DisMaxQueryParser, however, i'm getting an exception: "Unknown function min in FunctionQuery('min(1,2)', pos=4)" The request that causes the error looks like this: http://localhost:2345/solr/main/select?qt=dismax

Re: how to start GarbageCollector

2011-03-29 Thread stockii
okay, i installed an monitor, jconsole and jvisualvm. how can i see with this, where my probem is ? what data are needed ? :/ - --- System One Server, 12 GB RAM, 2 Solr Instances, 7 Cores, 1 Core with 31 Million Documents

Re: Solrcore.properties

2011-03-29 Thread Ezequiel Calderara
Just for the record, in case anymore is having trouble, the masterUrl should be: http://url:port/solr/replication (don't forget the /replication/ part!) On Tue, Mar 29, 2011 at 9:44 AM, Ezequiel Calderara wrote: > I think that i found the problem: > The contents of the solrcore.properties were: >

Re: [WKT] Spatial Searching

2011-03-29 Thread Ryan McKinley
> Does anyone know of a patch or even when this functionality might be included > in to Solr4.0? I need to query for polygons ;-) check: http://code.google.com/p/lucene-spatial-playground/ This is my sketch / soon-to-be-proposal for what I think lucene spatial should look like. It includes a WK

Re: 2 index within the same Solr server ?

2011-03-29 Thread Markus Jelsma
http://wiki.apache.org/solr/CoreAdmin > Hello every body, > > Is it possible to create 2 index within the same Solr server ? > > Thank you. > > Amel.

2 index within the same Solr server ?

2011-03-29 Thread Amel Fraisse
Hello every body, Is it possible to create 2 index within the same Solr server ? Thank you. Amel.

RE: [WKT] Spatial Searching

2011-03-29 Thread Smiley, David W.
Thanks for the links Chris. I think my approach in SOLR-2155 complies with those rules. The only part that concerns me wether this is true is the rule regarding the default action of a build script: YOU MUST NOT distribute build scripts or documentation within an Apache product with the purpos

Re: how to start GarbageCollector

2011-03-29 Thread Markus Jelsma
Unix tools won't show heap usage statistics. Please use tools that come with your JVM such as jps, jtop, jstat or setup monitoring over JMX to get a good picture. All aside, RAM is most likely not your problem. > i run an full-import via DIH, 35 Million Documents, i dont restart solr. my > cron

Re: Solrcore.properties

2011-03-29 Thread Ezequiel Calderara
I think that i found the problem: The contents of the solrcore.properties were: > #solrcore.properties > data.dir=D:\Solr\data\solr\ > enable.master=false > enable.slave=true > masterUrl=http://url:8787/solr/ > pollInterval=00:00:60 > I found a folder in the D:\ called: SolrDatasolrenable.master=f

Re: how to start GarbageCollector

2011-03-29 Thread stockii
i run an full-import via DIH, 35 Million Documents, i dont restart solr. my cronjob start automaticly an delta. if i restart solr, delta obtain in ~10 seconds ... "free -m" show me how many RAM is beeing used and with "top". the server is only for solr, so no other processes are using my RAM. --

Re: how to start GarbageCollector

2011-03-29 Thread Markus Jelsma
I seriously doubt heap usage is actually your problem. Usually a garbage collector is running, if it (somehow) doesn't you will definately run out of memory some time. Where did you check memory usage? > Hello, > > my problem is, that after a full-import solr reserved all of my RAM and my >

Re: how to start GarbageCollector

2011-03-29 Thread Erick Erickson
I doubt this is your issue, the garbage collector will run automatically at need. What happens if you do a full import, stop and restart your Solr server and then try the delta? If the delta takes an hour then it has nothing to do with garbage collection. What are you importing from? I'd suspect

how to start GarbageCollector

2011-03-29 Thread stockii
Hello, my problem is, that after a full-import solr reserved all of my RAM and my delta-imports need about 1 hour for less than 5000 small documents. How can i start GarbageCollector to get the RAM back ? - --- System One

Re: Error while performing facet search across shards..

2011-03-29 Thread Yonik Seeley
On Tue, Mar 29, 2011 at 3:55 AM, rajini maski wrote: >             An error while performing facet across shards..The following is > the query: > > http://localhost:8090/InstantOne/select?/&indent=on > &shards=localhost:8090/InstantOne,localhost:8091/InstantTwo > ,localhost:8093/InstantThree&q=fil

Re: copyField at search time / multi-language support

2011-03-29 Thread Erick Erickson
This may not be all that helpful, but have you looked at edismax? https://issues.apache.org/jira/browse/SOLR-1553 It allows the full Solr query syntax while preserving the goodness of dismax. This is standard equipment on 3.1, which is being released even as we speak, and I also know it's being u

Re: Solrcore.properties

2011-03-29 Thread Ezequiel Calderara
Hi Jayendra, this is the content of the files: In the Master: + SolrConfig.xml : http://pastebin.com/JhvwMTdd In the Slave: + solrconfig.xml: http://pastebin.com/XPuwAkmW + solrcore.properties: http://pastebin.com/6HZhQG8z I don't know which other files do you need or could be involved in this.

Re: Cant retrieve data

2011-03-29 Thread Erick Erickson
Your documents aren't getting in your index. Did you follow up on Gora's comment that you weren't selecting an ID? IDs are NOT generated by Solr, you need to supply them as part of your document. Second, look in your Solr logs, or just look at the screen where you started Solr when you index. I b

Re: RamBufferSize and AutoCommit

2011-03-29 Thread Isan Fulia
Hi Eric , I m actually getting out of memory error. As I told earlier my rambuffersize is default(32mb).What could be the reasons for getting this error. Can u please share ur views. On 28 March 2011 17:55, Erick Erickson wrote: > Also note that making RAMBufferSize too big isn't useful. Lucid

Re: Highlighting problem

2011-03-29 Thread Stefan Matheis
Stefan, this is a duplicate post for http://lucene.472066.n3.nabble.com/Highlighting-Problem-td2746022.html no? if see, please stick w/ one of them Regards Stefan On Tue, Mar 29, 2011 at 10:30 AM, Stefan Mueller wrote: > dear solr users, > > my data looks like this: > > j]s(dh)fjk [hf]sjkadh as

Re: copyField at search time / multi-language support

2011-03-29 Thread lboutros
Tom, to solve this kind of problem, if I understand it well, you could extend the query parser to support something like meta-fields. I'm currently developing a QueryParser Plugin to support a specific syntax. The support of meta-fields to search on different fields (multiple languages) is one of

Highlighting problem

2011-03-29 Thread Stefan Mueller
dear solr users, my data looks like this: j]s(dh)fjk [hf]sjkadh asdj(kfh) [skdjfh aslkfjhalwe uigfrhj bsd bsdfga sjfg asdlfj. if I want to query for the first "word", the following queries must match: j]s(dh)fjk j]s(dh)fjk j]sdhfjk jsdhfjk dhf So the matching should ignore some characters lik

Error while performing facet search across shards..

2011-03-29 Thread rajini maski
An error while performing facet across shards..The following is the query: http://localhost:8090/InstantOne/select?/&indent=on &shards=localhost:8090/InstantOne,localhost:8091/InstantTwo ,localhost:8093/InstantThree&q=filenumber:10&facet=on&facet.field=studyId No studyId fields are b

Re: Fields not being indexed?

2011-03-29 Thread Stefan Matheis
Charles, On Tue, Mar 29, 2011 at 3:32 AM, Charles Wardell wrote: > > > name="guid">http://twitter.com/AshleyxArsenic/statuses/52164920388763648 > > did you see the difference between the first and the following two definitions? actually it's really well-formed (they are treated as textnode,

RE: Highlighting Problem

2011-03-29 Thread Pierre GOSSE
Look like special chars are filtered at index time and not replaced by space that would keep correct offset of terms. Can you paste here the definition of the fieldtype in your shema.xml ? Pierre -Message d'origine- De : pottw...@freenet.de [mailto:pottw...@freenet.de] Envoyé : lundi