RE: Error in Importing from Oracle

2009-04-02 Thread Radha C.
Thanks guys, I used pure java driver. That works. -Original Message- From: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] Sent: Friday, April 03, 2009 8:59 AM To: solr-user@lucene.apache.org Subject: Re: Error in Importing from Oracle put your native dll/iso file in the LD_LI

Re: Composite POJO support

2009-04-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Fri, Apr 3, 2009 at 11:28 AM, Praveen Kumar Jayaram wrote: > > > Thanks for the reply Noble Paul. > In my application I will be having multiple types of object and the number > of properties in each object will vary. > So I have made them as FieldType and defined in schema.xml also The POJO is

Re: How do I combine WhitespaceTokenizerFactory and EdgeNGramTokenizerFactory?

2009-04-02 Thread Praveen Kumar Jayaram
Thanks for the suggestion Otis. This works. Otis Gospodnetic wrote: > > > Hi, > > Try defining 2 separate fields and using copyField. > > > Otis > -- > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > > > - Original Message >> From: Praveen Kumar Jayaram >> To: so

Re: Composite POJO support

2009-04-02 Thread Praveen Kumar Jayaram
Thanks for the reply Noble Paul. In my application I will be having multiple types of object and the number of properties in each object will vary. So I have made them as FieldType and defined in schema.xml also How do I store the POJO without declaring it as a FieldType? Solr needs to recogniz

Re: Oracle Clob column with DIH does not turn to String

2009-04-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
yeah, ant dist will give you the .war file you may need . just drop it in and you are set to go. or if you can hook up a debugger to a running Solr that is the easiest --Noble On Fri, Apr 3, 2009 at 9:35 AM, ashokc wrote: > > That would require me to recompile (with ant/maven scripts?) the source

crazy parentheses

2009-04-02 Thread Dean Missikowski (Consultant), CLSA
I've got a problem that's driving me crazy with parentheses. I'm using a recent nightly Solr 1.4 My index includes these three docs. doc #1 has title: "saints & sinners" doc #2 has title: "(saints and sinners)" doc #3 has title: "( saints & sinners )" doc #4 has title: "(saints & si

Re: Oracle Clob column with DIH does not turn to String

2009-04-02 Thread ashokc
That would require me to recompile (with ant/maven scripts?) the source and replace the jar for DIH, right? I can try - for the first time. - ashok Noble Paul നോബിള്‍ नोब्ळ् wrote: > > This looks strange. Apparently the Transformer did not get applied. Is > it possible for you to debug ClobTran

Re: Oracle Clob column with DIH does not turn to String

2009-04-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
This looks strange. Apparently the Transformer did not get applied. Is it possible for you to debug ClobTransformer adding(System.out.println into ClobTransformer may help) On Fri, Apr 3, 2009 at 6:04 AM, ashokc wrote: > > Correcting my earlier post. It lost some lines some how. > > Hi, > > I hav

Re: Error in Importing from Oracle

2009-04-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
put your native dll/iso file in the LD_LIBRARY_PATH and start Solr with that. Or the best solution is to use a pure java driver On Thu, Apr 2, 2009 at 8:13 PM, Shalin Shekhar Mangar wrote: > On Thu, Apr 2, 2009 at 6:57 PM, Radha C. wrote: >> Hello List, >> >> I am trying to do full import from

Re: Oracle Clob column with DIH does not turn to String

2009-04-02 Thread ashokc
Correcting my earlier post. It lost some lines some how. Hi, I have set up to import some oracle clob columns with DIH. I am using the latest nightly release. My config says, But it does not seem to turn this clob into a String. The search results show: 1.8670129 oracle.s

Oracle Clob column with DIH does not turn to String

2009-04-02 Thread ashokc
Hi, I have set up to import some oracle clob columns with DIH. I am using the latest nightly release. My config says, But it does not seem to turn this clob into a String. The search results show: 1.8670129 oracle.sql.c...@aed3a5 4486 Any pointers on why I do not get t

Re: Remote Access To Schema Data

2009-04-02 Thread Jeff Newburn
Fastest way I know of to get the schema is using the luke browser. http://localhost/solr/admin/luke It returns in xml and has tons of info you probably aren't interested it. However, it does contain information like fields and type. -- Jeff Newburn Software Engineer, Zappos.com jnewb...@zappos.co

Re: java.lang.ClassCastException: java.lang.Long using Solrj

2009-04-02 Thread vivek sar
Thanks Noble. That helped - turned out there was field name mismatch in my bean. 2009/4/1 Noble Paul നോബിള്‍ नोब्ळ् : > The classcast exception is misleading. It happens because the response > itself was some error response. > > debug it by setting the XmlResponseParser > http://wiki.apache.org/s

Re: Runtime exception when adding documents using solrj

2009-04-02 Thread vivek sar
) If I want to search for a word in all the cores. 3) How would I search on multiple cores on multiple machines? Single core I'm able to search like, http://localhost:8080/solr/20090402/select?q=*:* Thanks, -vivek -- Just in case if this might be helpful to others who mig

Re: newSearcher doesn't fire

2009-04-02 Thread Kevin Osborn
Found the issue. This was old code that I finally got around to enabling. Somebody put a slash at the end of my XML element. From: Yonik Seeley To: solr-user@lucene.apache.org Sent: Thursday, April 2, 2009 2:32:37 PM Subject: Re: newSearcher doesn't fire I ju

Re: newSearcher doesn't fire

2009-04-02 Thread Yonik Seeley
I just tried with the standard example in solr trunk... seems like it's still working fine when I issue a commit: Apr 2, 2009 5:30:19 PM org.apache.solr.core.QuerySenderListener newSearcher INFO: QuerySenderListener sending requests to searc...@1702c48 main Apr 2, 2009 5:30:19 PM org.apache.solr.c

Remote Access To Schema Data

2009-04-02 Thread Fink, Clayton R.
Hi: I want to get a list of the fields and field types for an index deployed on a Solr server (over HTTP or embedded). I can't see any obvious way to do this as a client. This is part of the use case for an app we are working on where all field information for an index is available and we can

newSearcher doesn't fire

2009-04-02 Thread Kevin Osborn
I am trying to figure this out. I have a firstSearcher and a newSearcher event. They are almost identical. Upon startup, I see all the firstSearcher events in my log. I also see log events for Added SolrEventListener for both firstSearcher and newSearcher. Next, I push out a new index. I see th

Re: Unexpected search results

2009-04-02 Thread Erick Erickson
Sure, given that the default operator is OR you'd expect it to widen as you add more terms. On Thu, Apr 2, 2009 at 3:57 PM, muness wrote: > > Laurent, > > My bad, I should have used the exact query results I was getting, rather > than a made up example. Here are those results: > > $ curl ht

RE: Unexpected search results

2009-04-02 Thread muness
Laurent, My bad, I should have used the exact query results I was getting, rather than a made up example. Here are those results: $ curl http://localhost:8982/solr/select/?q=otto --silent | xmlstarlet fo | grep numFound $ curl http://localhost:8982/solr/select/?q=otto%20added --silent | xmls

Facets drill down

2009-04-02 Thread revas
Hi, I typically issue a facetdrill down query thus q=somequery and Facetfield:facetval . Is there any issues with the above approach as opposed to &fq=facetfield:value in terms of memory consumption and the use of cache. Regards Suajatha

Re: Slow startup of solr-nightly

2009-04-02 Thread Yonik Seeley
On Thu, Apr 2, 2009 at 6:56 AM, Jarek Zgoda wrote: > I'm testing solr-nightly (2009-04-02) and I noticed very long instance > startup time compared to 1.3 (4 minutes to 20 seconds). The machine is > pretty common 2 core AMD64 with 4GB RAM. > > Is this normal or should I be worried? Definitely not

RE: Unexpected search results

2009-04-02 Thread Vauthrin, Laurent
Are the queries only returning 10 results? (in the result element -> ) By default, I believe Solr will only return the first ten results it finds which may explain the results. -Original Message- From: solr-user-return-20409-laurent.vauthrin=disney@lucene.apache.org [mailto:solr-user-

Unexpected search results

2009-04-02 Thread muness
When search through solr, a user noticed some unintuitive results to a query. I am having trouble figuring out if this is the expected result or not. Here's an example: * Using the query "otto" returns 10 results * Using the query "otto added" returns 10 results The weird part is that the res

Search on all fields and know in which field was the match

2009-04-02 Thread Rui Carneiro
Hi all, I am brand new with Solr and i have a pretty big problem to solve. I need to index some e-mails (from Dovecot) and their attachments. The index's structure i was thinking is: Note: Only the last 2 fields are relevant to this problem. W

Re: How do I combine WhitespaceTokenizerFactory and EdgeNGramTokenizerFactory?

2009-04-02 Thread Otis Gospodnetic
Hi, Try defining 2 separate fields and using copyField. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Praveen Kumar Jayaram > To: solr-user@lucene.apache.org > Sent: Thursday, April 2, 2009 2:02:55 AM > Subject: How do I combine Whites

Re: Error in Importing from Oracle

2009-04-02 Thread Shalin Shekhar Mangar
On Thu, Apr 2, 2009 at 6:57 PM, Radha C. wrote: > Hello List, > > I am trying to do full import from remote oracle server. I am getting the > below error, > > Can anyone please help me what configuration I am missing?  Thanks in > advance. > > Apr 2, 2009 6:46:39 PM org.apache.solr.handler.dataimp

Re: spectrum of Lucene queries in solr?

2009-04-02 Thread Paul Libbrecht
Sorry, I just realized I can use SolrIndexSearcher.search(Query, Hit)... that was my question basically. paul Le 02-avr.-09 à 03:31, Erik Hatcher a écrit : Paul, I'm not sure I understand what you're looking for exactly. Solr supports Lucene's QueryParser by default for /select?q=... so

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

2009-04-02 Thread Grant Ingersoll
On Apr 2, 2009, at 9:23 AM, Fergus McMenemie wrote: Grant, I should note, however, that the speed difference you are seeing may not be as pronounced as it appears. If I recall during ApacheCon, I commented on how long it takes to shutdown your Solr instance when exiting it. That time it t

Error in Importing from Oracle

2009-04-02 Thread Radha C.
Hello List, I am trying to do full import from remote oracle server. I am getting the below error, Can anyone please help me what configuration I am missing? Thanks in advance. Apr 2, 2009 6:46:39 PM org.apache.solr.handler.dataimport.DataImporter doFullImport SEVERE: Full Import failed org

Re: multicore

2009-04-02 Thread Erik Hatcher
On Apr 2, 2009, at 8:47 AM, Akshay wrote: On Thu, Apr 2, 2009 at 5:58 PM, Neha Bhardwaj < neha_bhard...@persistent.co.in> wrote: Hi, I want to index through commond line How to do that? You can use curl, http://wiki.apache.org/solr/UpdateXmlMessages?highlight=%28curl%29#head-c614ba822059ae

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

2009-04-02 Thread Fergus McMenemie
Grant, >I should note, however, that the speed difference you are seeing may >not be as pronounced as it appears. If I recall during ApacheCon, I >commented on how long it takes to shutdown your Solr instance when >exiting it. That time it takes is in fact Solr doing the work that >was

Re: JVM best tune? help ... solr1.4

2009-04-02 Thread sunnyfr
This is my conf : http://www.nabble.com/file/p22847570/solrconfig.xml solrconfig.xml And this is my delta import: */20 * * * * /usr/bin/wget -q --output-document=/home/video_import.txt http:/master.com:8180/solr/video/dataimport?command=delta-import&optimize=false -- View this message in c

Re: JVM best tune? help ... solr1.4

2009-04-02 Thread sunnyfr
I don't optimize at all. my delta-import&optimize=false I didn't turnd on optimize, I think it merges segment alone, because size increase too quickly? Noble Paul നോബിള്‍ नोब्ळ् wrote: > > it is not a good idea to optimize the index everytime you commit. That > is why your downloads are takin

Re: JVM best tune? help ... solr1.4

2009-04-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
it is not a good idea to optimize the index everytime you commit. That is why your downloads are taking so long 2009/4/2 Johanna Mortemousque : > I've so many update, almost 2 000 every 20mn, that lucene merge my index > folder, > so everytime my slave replicate its a new index folder merged so ev

Re: multicore

2009-04-02 Thread Akshay
On Thu, Apr 2, 2009 at 5:58 PM, Neha Bhardwaj < neha_bhard...@persistent.co.in> wrote: > Hi, > I want to index through commond line > How to do that? You can use curl, http://wiki.apache.org/solr/UpdateXmlMessages?highlight=%28curl%29#head-c614ba822059ae20dde5698290caeb851534c9de > > > > -

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

2009-04-02 Thread Grant Ingersoll
On Apr 2, 2009, at 4:02 AM, Fergus McMenemie wrote: Grant, Hmmm, the big difference is made by &overwrite=false. But, can you explain why &overwrite=false makes such a difference. I am starting off with an empty index and I have checked the content there are no duplicates in the uniqueKey field

RE: multicore

2009-04-02 Thread Neha Bhardwaj
Hi, I want to index through commond line How to do that? -Original Message- From: Erik Hatcher [mailto:e...@ehatchersolutions.com] Sent: Thursday, April 02, 2009 5:42 PM To: solr-user@lucene.apache.org Subject: Re: multicore On Apr 2, 2009, at 6:32 AM, Neha Bhardwaj wrote: > Also how

Re: JVM best tune? help ... solr1.4

2009-04-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
http://people.apache.org/~hossman/#threadhijack On Thu, Apr 2, 2009 at 5:47 PM, sunnyfr wrote: > > I think about the slave. > When I start in multi thread 20 request second my cpu is very bad. > I'm sure I don't manage properly my gc. I've 8G per slave it should be fine. > > I wonder, I shouldn't

Re: JVM best tune? help ... solr1.4

2009-04-02 Thread sunnyfr
I think about the slave. When I start in multi thread 20 request second my cpu is very bad. I'm sure I don't manage properly my gc. I've 8G per slave it should be fine. I wonder, I shouldn't put 7G to xmx jvm, I don't know, but slave is as well a little problem during replication from the master.

Re: JVM best tune? help ... solr1.4

2009-04-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
If you are looking at the QTime on the master it is likely to be skewed by ReplicationHandler becaus ethe files are downloaded using a request. On a slave it should not be a problem. I guess we must not add the qtimes of ReplicationHandler --Noble On Thu, Apr 2, 2009 at 5:34 PM, sunnyfr wrote: >

Re: multicore

2009-04-02 Thread Erik Hatcher
On Apr 2, 2009, at 6:32 AM, Neha Bhardwaj wrote: Also how to index data in particular core. Say.. we have core0 and core1 in multicore. How can I specify that on which core iwant to index data. You index into http://loalhost:8983/solr/core0/update or http://loalhost:8983/solr/core1/update

JVM best tune? help ... solr1.4

2009-04-02 Thread sunnyfr
Hi, Just applied replication by requestHandler. And since this the Qtime went mad and can reach long time 9068 Without this replication Qtime can be around 1sec. I've 14Mdocs stores for 11G. so not a lot of data stores. I've servers with 8G and tomcat use 7G. I'm updating every 30mn which is ab

Re: Composite POJO support

2009-04-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
why is the POJO extending FieldType? it does not have to. composite types are not supported.because Solr cannot support that. But the field can be a List or array. On Thu, Apr 2, 2009 at 5:00 PM, Praveen Kumar Jayaram wrote: > > Could someone give suggestions for this issue? > > > Praveen Kumar

Re: How do I combine WhitespaceTokenizerFactory and EdgeNGramTokenizerFactory?

2009-04-02 Thread Praveen Kumar Jayaram
Is there a way to achieve this requiremnt? Please give your valuable comments. Praveen Kumar Jayaram wrote: > > Hi folks, > > I am trying to use features of WhitespaceTokenizerFactory and > EdgeNGramTokenizerFactory. > My requirement is to search a String using substring and inword concepts.

Re: Composite POJO support

2009-04-02 Thread Praveen Kumar Jayaram
Could someone give suggestions for this issue? Praveen Kumar Jayaram wrote: > > Hi > > I am trying to have a complex POJO type in Solr 1.3 > i.e Object inside object. > > Below is a sample Field created, > > public class TestType extends FieldType{ > @Field > private String requestor

Slow startup of solr-nightly

2009-04-02 Thread Jarek Zgoda
I'm testing solr-nightly (2009-04-02) and I noticed very long instance startup time compared to 1.3 (4 minutes to 20 seconds). The machine is pretty common 2 core AMD64 with 4GB RAM. Is this normal or should I be worried? -- We read Knuth so you don't have to. - Tim Peters Jarek Zgoda, R&D,

Using ExtractingRequestHandler to index a large PDF

2009-04-02 Thread Fergus McMenemie
Hello, Sorry if this is a FAQ; I suspect it could be. But how do I work around the following:- INFO: [] webapp=/apache-solr-1.4-dev path=/update/extract params={ext.def.fl=text&ext.literal.id=factbook/reference_maps/pdf/oceania.pdf} status=0 QTime=318 Apr 2, 2009 11:17:46 AM org.apache.solr.c

RE: FW: multicore

2009-04-02 Thread Neha Bhardwaj
Hi, Thanks a lot ... But still I am not very clear with creating multiple cores. I read the document(wiki)but was not able to understand it properly. Also how to index data in particular core. Say.. we have core0 and core1 in multicore. How can I specify that on which core iwant to index data. Ki

Re: autowarm static queries

2009-04-02 Thread sunnyfr
Ok so It doesn't seems to work after a replication, my first request on my slave is always very long and next one very quick ??? do I have to set something else ? solr 0 100 anything id desc fast_warm 0 100

Re: autowarm static queries

2009-04-02 Thread Shalin Shekhar Mangar
On Thu, Apr 2, 2009 at 2:13 PM, sunnyfr wrote: > > Hi Hoss, > > Do I need autowarming > 0 to have newSearcher and firstSearcher fired? > > Thanks a lot, > Did you mean autowarmCount > 0? No, firstSearcher and newSearcher are always executed if specified. The autowarmCount can be anything, it doe

Re: Problem using ExtractingRequestHandler with tomcat

2009-04-02 Thread Erik Hatcher
On Apr 2, 2009, at 4:55 AM, Fergus McMenemie wrote: Thanks. Copying all those jar files to my solr/lib directory was the trick. But why do I have to do this; is it by design or because ExtractingRequestHandler is yet to be fully incorporated into Solr? It's fully integrated into the example as

Re: Problem using ExtractingRequestHandler with tomcat

2009-04-02 Thread Fergus McMenemie
>On Apr 2, 2009, at 4:26 AM, Fergus McMenemie wrote: >> I cant get ExtractingRequestHandler to work with tomcat. Using the >> latest version from svn and then a "make clean dist" and copying the >> war file to a clean tomcat does not work. > >make?! :) Oops! > >try "ant example" to see if that ge

Re: autowarm static queries

2009-04-02 Thread sunnyfr
Hi Hoss, Do I need autowarming > 0 to have newSearcher and firstSearcher fired? Thanks a lot, hossman wrote: > > > : Subject: autowarm static queries > > A minor followup about terminology: > > "auto-warming" describes what Solr does when it opens a new cache, and > seeds it with key/val

Re: Problem using ExtractingRequestHandler with tomcat

2009-04-02 Thread Erik Hatcher
On Apr 2, 2009, at 4:26 AM, Fergus McMenemie wrote: I cant get ExtractingRequestHandler to work with tomcat. Using the latest version from svn and then a "make clean dist" and copying the war file to a clean tomcat does not work. make?! :) try "ant example" to see if that gets it working - i

Problem using ExtractingRequestHandler with tomcat

2009-04-02 Thread Fergus McMenemie
Hello all, I cant get ExtractingRequestHandler to work with tomcat. Using the latest version from svn and then a "make clean dist" and copying the war file to a clean tomcat does not work. Adding the following to solconfig.xml ands restarting tomcat i get > class="org.apache.solr.handler.extr

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

2009-04-02 Thread Fergus McMenemie
>On Apr 1, 2009, at 9:39 AM, Fergus McMenemie wrote: > >> Grant, >> >> Redoing the work with your patch applied does not seem to > >> >> make a difference! Is this the expected result? > >No, I didn't expect Solr 1095 to fix the problem. Overwrite = false + >1095, does, however, AFAICT by your la