: do you know how can I do with my schema to some fields dont be necessary?
: because in some cases it will be null and sometimes not..
You can say required="false" on fields in your schema.xml -- but that
won't change your situation (required="false" is actually the default).
The problem here
Hi,
I thought having around a TB of data to search is when katta should come
into picture.
Thanks a lot, can you please point me to or elaborate more on how to manage
increasing index. Any standard strategies?
Did you reindex after changing the schema?
On Aug 3, 2010, at 7:35 PM, Justin Lolofie wrote:
Hi Erik, thank you for replying. So, turning on debugQuery shows
information about how the query is processed- is there a way to see
how things are stored internally in the index?
My query is "ABC12".
What I'm doing now is just adding the documents to the other core each night
and deleting old documents from the other core when I'm finished. Is there
a better way?
On Tue, Aug 3, 2010 at 4:38 PM, Max Lynch wrote:
> Is it possible to duplicate a core? I want to have one core contain only
> do
Thanks Hoss, the problem was transient, I believe that my index had
become corrupted (changed the schema but hadn't fully deleted all
documents that had been using the previous version of the schema), my
fault.
Chris Hostetter wrote:
Honestly: if you have a really small cardinality for these numeric
values (ie: small enough to return every value on every request) perhaps
you should use faceting to find the min/max values (with facet.mincount=1)
instead of starts?
Thanks for the tips and info.
I
Yes, they are on a common file server, and I've been sharing the same index
directory between the Solr JVMs. But I seem to be hitting a wall when
attempting
to use just one instance for changing the index.
With Solr replication disabled, I stream updates to the one instance, and this
process h
Frederico Azeiteiro wrote:
But it is unusual to use both leading and trailing * operator. Why are
you doing this?
Yes I know, but I have a few queries that need this. I'll try the
"ReversedWildcardFilterFactory".
ReverseWildcardFilter will help leading wildcard, but will not h
OK thanks Paul.
I just committed another (hopefully, last!) fix, so if you get a
chance can you try that (just "svn up")? Thanks, and, sorry,
Mike
On Tue, Aug 3, 2010 at 12:40 PM, Paul Dlug wrote:
> Just reporting back, no issues on the latest branch3x build with your
> revert of the optimizat
Hi all,
I've got a situation where the key result from an initial search
request (let's say for "dog") is the list of values from a faceted
field, sorted by hit count.
For the top 10 of these faceted field values, I need to get the top
hit for the target request ("dog") restricted to that
Are these files on a common file server? If you want to share them
that way, it actually does work just to give them all the same index
directory, as long as only one of them changes it.
On Tue, Aug 3, 2010 at 4:38 PM, Kelly Taylor wrote:
> Is there a way to share index files amongst my multiple
This is the 'index' part of the analyser.jsp page. You can ask how the
text is indexed as well as how it is turned into a query.
On Tue, Aug 3, 2010 at 4:35 PM, Justin Lolofie wrote:
> Hi Erik, thank you for replying. So, turning on debugQuery shows
> information about how the query is processed-
Is there a way to share index files amongst my multiple Solr web-apps, by
configuring only one of the JVMs as an indexer, and the remaining, as read-only
searchers?
I'd like to configure in such a way that on startup of the read-only searchers,
missing cores/indexes are not created, and updates
I'm using Solr Java replication with multiple master cores ("at_bat" &
"on_deck"), and a single slave core ("at_bat")
The "at_bat" cores of the master and slave are used for processing search
requests, and the "on_deck" core is used for complete index rebuilds. Once a
rebuild is complete, the
Hi Erik, thank you for replying. So, turning on debugQuery shows
information about how the query is processed- is there a way to see
how things are stored internally in the index?
My query is "ABC12". There is a document who's "title" field is
"ABC12". However, I can only get it to match if I sear
yep...
do you know how can I do with my schema to some fields dont be necessary?
because in some cases it will be null and sometimes not..
but very thanks, now indexed ok with no errors
tks
On Tue, Aug 3, 2010 at 8:05 PM, Chris Hostetter wrote:
> : The files are attached.
>
> From the files y
: The files are attached.
>From the files you sent...
...as i said before...
: > > > >>> According to that error message, you are attempting to index a date
: > > > >>> field with a value that is an empty string,
: > > > >>>
: > > > >>> Ie...
: > > > >>>
: > > > >>>
: > > > >>>
: > > > >>>
Can we see the rest of your document and your schema? Lots of people
index dates, so my first guess is that some innocent change and/or typo
is causing your problems, but there's no way to check without you posting
the complete information.
Best
Erick
On Tue, Aug 3, 2010 at 4:31 PM, Claudio Devec
Is it possible to duplicate a core? I want to have one core contain only
documents within a certain date range (ex: 3 days old), and one core with
all documents that have ever been in the first core. The small core is then
replicated to other servers which do "real-time" processing on it, but the
Hi,
I use Nutch and Solr to crawl a few thousand sites. I would like to
limit my queries to recently changed documents. I use Nutch' index-more
plugin which stores the Last-Modified HTTP response header in the index
as a Long value.
I would like to use a query like this to limit the results
Well that does take care of some cases.
How about if we still want a hit on a tag to contribute to the weight
though?
There would be 2 options. One is the one I described in the original post,
which is to grab the highest score of a set of ids.
The other would be to somehow control the scores
The analysis tool is merely that, but during querying there is also a
query parser involved. Adding debugQuery=true to your request will
give you the parsed query in the response offering insight into what
might be going on. Could be lots of things, like not querying the
fields you think
Hello,
I have found the analysis tool in the admin page to be very useful in
understanding my schema. I've made changes to my schema so that a
particular case I'm looking at matches properly. I restarted solr,
deleted the document from the index, and added it again. But still,
when I do a query, t
Hi guys...
I already changed from : to . and nothing happens, the problem is the solr
ignores the content of the date, but if it is an incorrecty format, solr
shows this
tks
On Tue, Aug 3, 2010 at 5:05 PM, Walter Underwood wrote:
> That is because it is an illegal ISO 8601 datetime. The seconds
That is because it is an illegal ISO 8601 datetime. The seconds portion should
be "35.999", not "35:999".
wunder
On Aug 3, 2010, at 12:55 PM, Michael Griffiths wrote:
> I'd guess the DIH is not extracting the date correctly.
>
> Either way, Solr is not retrieving the date.
>
> -Original M
I'd guess the DIH is not extracting the date correctly.
Either way, Solr is not retrieving the date.
-Original Message-
From: Claudio Devecchi [mailto:cdevec...@gmail.com]
Sent: Tuesday, August 03, 2010 3:45 PM
To: solr-user@lucene.apache.org
Subject: Re: Error indexing "date"
Somebody
Somebody have an idea?
My fields are not null and solr apparently thinks that they are
On Tue, Aug 3, 2010 at 2:55 PM, Claudio Devecchi wrote:
> My field is not empty, I have the date on the field and the error happens,
> the type to put on schema.xml is date? or have any other?
>
>
>
>
> On Tue
On Tue, Aug 3, 2010 at 3:16 PM, oleg.gnatovskiy wrote:
>
> Sorry guess I messed up my example query. The query should look like this:
>
> name:pizza AND id:(10 OR 20 OR 30)
>
> Thus if I do name:pizza^10 AND id:(10 OR 20 OR 30)^0 wouldn't a document
> that has all the ids (10,20, and 30) still com
Sorry guess I messed up my example query. The query should look like this:
name:pizza AND id:(10 OR 20 OR 30)
Thus if I do name:pizza^10 AND id:(10 OR 20 OR 30)^0 wouldn't a document
that has all the ids (10,20, and 30) still come up higher then a document
that has just one?
--
View this messa
On Tue, Aug 3, 2010 at 2:42 PM, oleg.gnatovskiy wrote:
>
> Oh sorry guys, I didn't correctly submit my original post to the mailing
> list. The original message was this:
> "
> Hello all. We are having some trouble with queries similar to the type shown
> below:
>
> name: pizza OR (id:10 OR id:20
Oh sorry guys, I didn't correctly submit my original post to the mailing
list. The original message was this:
"
Hello all. We are having some trouble with queries similar to the type shown
below:
name: pizza OR (id:10 OR id:20 OR id:30) (id is a multi-valued field)
With the above query, we will
I checked the explain query.
What happens is that the sums of all the hits on ID are added up. Is there a
way to only grab the first score?
Thanks.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Scoring-on-multi-valued-fields-tp1017624p1020150.html
Sent from the Solr - Use
Ok thanks again :)
I'm right here now:
http://velocity.apache.org/tools/devel/index.html#Download
What should I download?
--
View this message in context:
http://lucene.472066.n3.nabble.com/Indexing-data-on-MSSQL-failed-Caused-by-org-apache-solr-common-SolrException-Error-loading-class-com-tp1
Well, first of all I'd suggest installing Velocity, and using that as your test
querying interface...
But try ?fq=feature:Cafe
-Original Message-
From: PeterKerk [mailto:vettepa...@hotmail.com]
Sent: Tuesday, August 03, 2010 1:38 PM
To: solr-user@lucene.apache.org
Subject: RE: Indexing
My field is not empty, I have the date on the field and the error happens,
the type to put on schema.xml is date? or have any other?
On Tue, Aug 3, 2010 at 2:38 PM, Chris Hostetter wrote:
>
> : On my xml file the date is on this format:* 2010-07-31T13:37:35:999Z*
>
> : Jul 28, 2010 11:40:44 PM
: On my xml file the date is on this format:* 2010-07-31T13:37:35:999Z*
: Jul 28, 2010 11:40:44 PM org.apache.solr.common.SolrException log
: *SEVERE: org.apache.solr.common.SolrException: Invalid Date String:''*
According to that error message, you are attempting to index a date field
Awesome! You did it!
Turned out, I had to change the casing of this line:
to:
Now the resultset is like this:
−
0
16
−
on
0
*:*
2.2
10
−
−
−
Gemeentehuis
−
Tuin
Cafe
1
2010-08-03T17:31:21.562Z
Gemeentehuis Nijmegen
−
−
Gemeentehuis
−
Tuin
Cafe
Danszaal
2
2010-08-03T17:31:21.5
Hi Michael,
My xml have it:
2010-07-31T13:37:35.999Z
And in my schema.xml I have it:
Tks!
On Tue, Aug 3, 2010 at 12:19 PM, Michael Griffiths wrote:
> What's your XML data look like (for the data)?
>
> Looks like it's not the same date format Solr accepts.
>
> -Original Message-
> From
Looks like {$location.ID} isn't being pull out correctly. I'd suggest playing
around (e.g. with capitalization). Still, I can't say I know why it's failing.
-Original Message-
From: PeterKerk [mailto:vettepa...@hotmail.com]
Sent: Tuesday, August 03, 2010 12:48 PM
To: solr-user@lucene.apa
Unfortunately, Lucene's QueryParser pre-splits all incoming text on
whitespace, which means your search-time analyzer never has a chance
to detect the multi-word synonym. Ie, your analyzer is invoked twice.
Once with "exercise" and once with "dvds".
We need to fix that... but it's not exactly cl
Hi,
This happens because your tokenizer will generate seperate tokens for `exercise
dvds`, so the SynonymFilter will try to find declared synonyms for `exercise`
and `dvds` separately. It's behavior is documented [1] on the wiki.
[1]:
http://wiki.apache.org/solr/AnalyzersTokenizersTokenF
Hi,
You are correct that locationid is an integer.
I have changed it to:
But then I get the error:
Incorrect syntax near '='
Even though that statement does work in mgmt studio
SEVERE: Full Import failed
org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to
execute
query:
Just reporting back, no issues on the latest branch3x build with your
revert of the optimization.
--Paul
On Tue, Aug 3, 2010 at 9:22 AM, Paul Dlug wrote:
> Sure, I'm reindexing now, I'll let you know how it goes.
>
>
> --Paul
>
> On Tue, Aug 3, 2010 at 9:05 AM, Michael McCandless
> wrote:
>> U
Hmm. I bet your location query is all wrong.
Take this:
query="select themeid from location_themes where locationid='${location.ID}'"
I'm pretty sure that locationid is not a string (since it's extracted as an int
below), which means your SQL query will be trying to match an int against a
stri
I'm having trouble getting multi word synonyms to work. As an example I have
the following synonym;
exercise dvds => fitness
When I search for exercise dvds I want to return all docs in the index which
contain the keyword fitness. I've read the wiki about
solr.SynonymFilterFactory which recommen
I had a look at this URL:
http://localhost:8983/solr/db/admin/dataimport.jsp?handler=/dataimport
There I see the data-config.xml on the left side and the full data import
result on the right.
The response is:
−
0
234
−
−
wedding-data-config.xml
full-import
debug
−
−
−
1
−
Gemeentehuis
Just checking -
Did you verify the data was being extracted with the DIH UI?
http://localhost:8983/solr/admin/dataimport.jsp
-Original Message-
From: PeterKerk [mailto:vettepa...@hotmail.com]
Sent: Tuesday, August 03, 2010 11:28 AM
To: solr-user@lucene.apache.org
Subject: RE: Indexing
Ok, that works...
But it only confirms that the extra data to be indexed I have defined in my
data-config does not seem to be indexed.
What can I do to debug this? Because nothing special is logged in my cygwin
window!
I have even simplified the data-config further to this:
What's your XML data look like (for the data)?
Looks like it's not the same date format Solr accepts.
-Original Message-
From: Claudio Devecchi [mailto:cdevec...@gmail.com]
Sent: Tuesday, August 03, 2010 11:16 AM
To: solr-user@lucene.apache.org
Subject: Error indexing "date"
Hi everybod
Hi everybody,
I'm having a error to index a xml file.
I have configured my schema xml with all field names I needed, and created a
xml with these fields, but in field wich I use some date I receive the
following error:
On my schema.xml the fields that I need date I configured it with *
type="date
Hello Mr.Hostetter,
Thank you very much for the clarification. I do
remember that when I first deployed the solr code from trunk on a test
server I couldnt open the index (careted via 1.4) even via the solr admin
page, It kept giving me corrupted index EOF kind of except
Sorry; I should have linked you to the self-executable .jar with no
dependencies (so double-clicking runs):
http://code.google.com/p/luke/downloads/detail?name=lukeall-1.0.1.jar&can=2&q=
Once you open it, you can "open" the index folder in your solr/data hierarchy.
-Original Message-
F
Ok, downloaded luke, but how do I run it? Tried googling it, but no luck...do
I need to put in in some folder?
And is there anything with regard to the casing of the columns?
For example, I now have
"select FEATUREID "
and
in my data-config
However, my DB columns are all in lower casing...i
Hi,
I'm trying to extend the writer used by solrj
(org.apache.solr.response.BinaryResponseWriter), i have declared it in
solrconfig.xml like this
I see that it is initialized, but when i try to set the 'wt' param to
'myWriter'
solrQuery.setParam("wt","myWriter"), nothing happen, it's still usi
I can't see an obvious error, I'm afraid.
Check the index with Luke:
http://code.google.com/p/luke/
... take particular note of the terms that are actually indexed, and what
values each document has. You can also perform searches/etc; it's a useful
tool.
If the data isn't there, there's some
Instructions on importing csv file with post.jar, to a custom URL:
Had some problems finding this information - on forums - so decided to post
this.
STEP #1: Import file
java -Durl=http://localhost:8983/solr/clients_ib/update/csv -Dcommit=no -jar
post.jar data.csv
STEP #2: Commit
java -D
User friendly i meant that the xml is raw and not user friendly for reading.
So i wondered what is the best approach for showing the results in a more
readable way. I got replied to this post but your comments were also
valuable. Thanks.
Cheers
Hando
--
View this message in context:
http://luc
What do you mean by "user friendly"? If you want an actual end user
search interface, it now comes out of the box on both the trunk and
3_x branch. Fire up the example, index the example data, and go to /
browse
That UI is generated using the Velocity response writer. You can get
Solr
Sure, I'm reindexing now, I'll let you know how it goes.
--Paul
On Tue, Aug 3, 2010 at 9:05 AM, Michael McCandless
wrote:
> Ugh... I think there may still be a bug lurking.
>
> Karl is also still having problems, much further into his indexing process.
>
> I'm hunting it now!!
>
> For the time
Thanks man this helped.
Hando
--
View this message in context:
http://lucene.472066.n3.nabble.com/Parsing-xml-of-the-search-results-tp1019017p1019064.html
Sent from the Solr - User mailing list archive at Nabble.com.
You can use appends for any additional fq paramters, which would be appended
to the ones passed @ query time.
Check out the sample solrconfig.xml with the solr.
inStock:true
Regards,
Jayendra
On Tue, Aug 3, 2010 at 8:25 AM, Robert Neve wrote:
> Hi,
>
> I have in my solr co
Ugh... I think there may still be a bug lurking.
Karl is also still having problems, much further into his indexing process.
I'm hunting it now!!
For the time being, I just disabled (committed to trunk & 3x) the
optimization that's causing the bug. Can you update to 3x head (or
trunk head), rem
You can use xsl. http://wiki.apache.org/solr/XsltResponseWriter
Robert
- Original Message -
From: Hando420
Sent: 03/08/10 02:59 PM
To: solr-user@lucene.apache.org
Subject: Parsing xml of the search results
The default style of search results is raw xml. If i want to make it more user
f
The default style of search results is raw xml. If i want to make it more
user friendly do i have to add stylesheet to the xml search response tags.
Thanks.
Hando
--
View this message in context:
http://lucene.472066.n3.nabble.com/Parsing-xml-of-the-search-results-tp1019017p1019017.html
Sent fr
Thanks, I updated to the latest version with the fix but I'm now
getting another error when optimizing the index (or when searching
certain fields). It mentions "unknown compression method" but I'm not
using compressed fields at all.
SEVERE: java.io.IOException: background merge hit exception:
_a:
Have you looked at the relevance scores? I would speculate elevate
matches would have constant, high score.
On 8/3/10, Vishal.Arora wrote:
>
> Suppose i have elevate.xml file and i elevate the ID :- Artist:11650 and
> Artist:510 when i search for corgan
> this is elevate File
>
>
Hi,
I have in my solr config file the code below to create a default for fq which
works great. The problem I have is if I want to use a custom fq this one gets
overwritten. Is there a way I can have it keep this fq and other custom ones?
Basically this field sets if the person is to show up or
Thanks for the quick reply :)
Here it is:
We'd need to see your schema.xml file for that; it's probably something in your
field types.
-Original Message-
From: PeterKerk [mailto:vettepa...@hotmail.com]
Sent: Tuesday, August 03, 2010 7:49 AM
To: solr-user@lucene.apache.org
Subject: Re: Indexing data on MSSQL failed: Caused by:
o
Thanks these links were useful. Managed to figured out what i needed.
Cheers
Hando
--
View this message in context:
http://lucene.472066.n3.nabble.com/Quering-the-database-tp1015636p1018896.html
Sent from the Solr - User mailing list archive at Nabble.com.
Suppose i have elevate.xml file and i elevate the ID :- Artist:11650 and
Artist:510 when i search for corgan
this is elevate File
Is
Hooray, im a bit further now...
Turned out that both SQL2005 and 2008 were running, where 2005 was listening
on port 1433. I disabled that services, enabled the 2008 service and now I
can connect and the command
http://localhost:8983/solr/db/dataimport?command=full-import is successfull.
But no
Hi,
how could I have the highlighting component return only the terms that
were matched, without any surrounding text ?
Hi all!
please help - how can I calculate queryresultcache size (how much RAM should
be dedicated for that). I have 1,5 index size, 4 mio docs.
QueryResultWindowSize is 20.
Could I use "expire" property on the documents in this cache?
regards,
Stanislaw
No. With Solr is really flexible and allows for a lot of complex querying
out-of-the-box.
Really the Wiki is your best friend here.
http://wiki.apache.org/solr/
perhaps start with:
1. http://lucene.apache.org/solr/tutorial.html
2. http://wiki.apache.org/solr/SolrQuerySyntax
3. http://wiki.apache.o
75 matches
Mail list logo
