Re: Spellcheck

[tamanjit.bin...@yahoo.co.in]

Hi if you have not figyured it out as yet, this might help::

Issues with *schema.xml*

 

here the type should actually be textSpell (fieldType that you have defined
earlier)


 Also I would suggest that you use a seperate RequestHandler for your
queries. You alreasy have spellCheckCompRH defined in the solrconfig.xml, to
which you can make the changes and add your 

 So really your fist query should be like:


http://localhost:8983/solr/spellCheckCompRH/?q=*:*&&version=2.2&start=0&rows=10&indent=on&spellcheck=true&spellcheck.build=true&spellcheck.dictionary=textSpell





--
View this message in context: 
http://lucene.472066.n3.nabble.com/Spellcheck-tp3315994p3318854.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: synonyms.txt: different results on admin and on site..

[deniz]

well yea you are right... i realised that lack of detail issue here... so
here it comes... 








 

 
 
 
 
 
 
 


This is from my schema.xml and basically i have a synonyms.txt file which
contains

deniz,denis,denise


After posting here, I have checked some stuff that I have faced before,
while trying to add accented letters to the system... so it seems like same
or similar stuff... so...

As i want to support partial matches, the search string is modified on php
side. if user enters deniz, it is sent to solr as deniz*

when i check on solr admin, i was able to make searches with 
deniz,denise,denis and they all return correct results, but when i put the
wildcard, i get nothing...

so with the above settings;

deniz
denise
denis
works smoothly

deniz*
denise*
denis*
returns nothing...


should i implement some kinda analyzer or tokenizer or any kinda component
to overtime this thing? 










Rob Casson wrote:
> 
> you should probably post your schema.xml and some parts of your
> synonyms.txt.  it could be differences between your index and query
> analysis chains, synonym expansion errors, etc, but folks will likely
> need more details to help you out.
> 
> cheers,
> rob
> 
> On Wed, Sep 7, 2011 at 9:46 PM, deniz 
> wrote:
>> could it be related with analysis issue about synonyms once again?
>>
>>
>>
>> -
>> Zeki ama calismiyor... Calissa yapar...
>> --
>> View this message in context:
>> http://lucene.472066.n3.nabble.com/synonyms-txt-different-results-on-admin-and-on-site-tp3318338p3318464.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
> 


-
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: 
http://lucene.472066.n3.nabble.com/synonyms-txt-different-results-on-admin-and-on-site-tp3318338p3318503.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: synonyms.txt: different results on admin and on site..

[Rob Casson]

you should probably post your schema.xml and some parts of your
synonyms.txt.  it could be differences between your index and query
analysis chains, synonym expansion errors, etc, but folks will likely
need more details to help you out.

cheers,
rob

On Wed, Sep 7, 2011 at 9:46 PM, deniz  wrote:
> could it be related with analysis issue about synonyms once again?
>
>
>
> -
> Zeki ama calismiyor... Calissa yapar...
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/synonyms-txt-different-results-on-admin-and-on-site-tp3318338p3318464.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: synonyms.txt: different results on admin and on site..

[deniz]

could it be related with analysis issue about synonyms once again? 



-
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: 
http://lucene.472066.n3.nabble.com/synonyms-txt-different-results-on-admin-and-on-site-tp3318338p3318464.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Cloud - is replication really a feature on the trunk?

[Yury Kats]

On 9/7/2011 3:18 PM, Pulkit Singhal wrote:
> Hello,
> 
> I'm working off the trunk and the following wiki link:
> http://wiki.apache.org/solr/SolrCloud
> 
> The wiki link has a section that seeks to quickly familiarize a user
> with replication in SolrCloud - "Example B: Simple two shard cluster
> with shard replicas"
> 
> But after going through it, I have to wonder if this is truly
> replication? 

Not really. Replication is not set up in the example.
The example use "replicas" as "copies", to demonstrate high search
availability.

> Because if it is truly replication then somewhere along
> the line, the following properties must have been set
> programmatically:
> replicateAfter, confFiles, masterUrl, pollInterval
> Can someone tell me: Where exactly in the code is this happening?

Nowhere.

If you want replication, you need to set all the properties you listed
in solrconfig.xml.

I've done it recently, see 
http://lucene.472066.n3.nabble.com/Replication-setup-with-SolrCloud-Zk-td2952602.html

synonyms.txt: different results on admin and on site..

[deniz]

hi all...

i have checked the list about the issue in the title, but couldnt find any
related info... so my problem is:

i change sysnonyms.txt and then reload the core without restarting the
server. new synonyms works smoothly if i use admin interface of solr,
however when i use the site which is written in php, i got nothing when i
use one of the synonyms that i have added.

any ideas why this is happening?

-
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: 
http://lucene.472066.n3.nabble.com/synonyms-txt-different-results-on-admin-and-on-site-tp3318338p3318338.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Sorting groups by numFound group size

[bobsolr]

Hi Martijn,

Thanks for the reply. Unfortunately I can't reference the group size using a
function or by specifying a schema field, although I use those methods to
sort docs within a group. Do you know if sort by group size is
available/planned for a future release of solr(maybe 4.0)? if so, it might
be worth a shot do get a trunk version to try that. btw, I'm using 3.3 now.

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Sorting-groups-by-numFound-group-size-tp3315740p3318060.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud and TermsComponent

[Jamie Johnson]

I have a snapshot of trunk from some time ago, I'll check the latest
code thanks for the reply

On Wed, Sep 7, 2011 at 3:39 PM, Mark Miller  wrote:
>
> On Sep 7, 2011, at 2:48 PM, Jamie Johnson wrote:
>
>> I took a quick look at TermsComponent and noticed that it works with
>> distributed queries but it doesn't seem to work with distrib=true.
>> Am I missing something, have there been any updates to this to get
>> this to work with SolrCloud?
>
>
> Are you using trunk? I seem to remember a bug from a long time ago on the 
> SolrCloud branch with this...if that's it, should be fixed though.
>
>
> - Mark Miller
> lucidimagination.com
> 2011.lucene-eurocon.org | Oct 17-20 | Barcelona
>
>
>
>
>
>
>
>
>
>
>

grouping by alpha-numeric field

[alxsss]

 

 Hello,

I try to group by a field with type string. In the results I see groupValues as 
parts of the group field.

Any ideas how to fix this.

Thanks.
Alex.

Re: SolrCloud and TermsComponent

[Mark Miller]

On Sep 7, 2011, at 2:48 PM, Jamie Johnson wrote:

> I took a quick look at TermsComponent and noticed that it works with
> distributed queries but it doesn't seem to work with distrib=true.
> Am I missing something, have there been any updates to this to get
> this to work with SolrCloud?


Are you using trunk? I seem to remember a bug from a long time ago on the 
SolrCloud branch with this...if that's it, should be fixed though.


- Mark Miller
lucidimagination.com
2011.lucene-eurocon.org | Oct 17-20 | Barcelona

Solr Cloud - is replication really a feature on the trunk?

[Pulkit Singhal]

Hello,

I'm working off the trunk and the following wiki link:
http://wiki.apache.org/solr/SolrCloud

The wiki link has a section that seeks to quickly familiarize a user
with replication in SolrCloud - "Example B: Simple two shard cluster
with shard replicas"

But after going through it, I have to wonder if this is truly
replication? Because if it is truly replication then somewhere along
the line, the following properties must have been set
programmatically:
replicateAfter, confFiles, masterUrl, pollInterval
Can someone tell me: Where exactly in the code is this happening?

I've been looking through some older threads where I see stuff like:
[Jan Høydahl]: Question: Is ReplicationHandler ZK-aware yet?
[Mark Miller]: As I think you now know, not yet ;)

Not sure if the comments above really fit-in with my question but it
certainly isn't encouraging.

SolrCloud does an excellent job of super-simplifying the sharding
process, so I'm hoping that can anyone tell me what needs to happen to
make it do the same for replication? I'm willing to get my hands dirty
and contribute to the trunk if someone can provide high-level
mentoring/guidance around the already existing SolrCloud code.

Re: Sorting groups by numFound group size

[Martijn v Groningen]

Sorting groups by numfound isn't possible. You can sort groups by specifying
a function or a field (from your schema) in the sort parameter.
The numFound isn't a field so that is why you can't sort on it.

Martijn

On 7 September 2011 08:17, bobsolr  wrote:

> Hi,
>
> I'm using this sample query to group the result set by category:
>
> q=test&group=true&group.field=category
>
> This works as expected and I get this sample response:
>
> "response":
> {"numFound":1,"start":0,"docs":[
>  {
>   ...
>  }
> {"numFound":6,"start":0,"docs":[
>  {
>   ...
>  }
> {"numFound":3,"start":0,"docs":[
>  {
>   ...
>  }
>
> However, I can't find a way to specify the sort order of the groups by
> number of docs each group has ("numFound field). I think the "sort" param
> has something to do with it, but I don't know how to use it.
>
> Any help will be greatly appreciated!
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Sorting-groups-by-numFound-group-size-tp3315740p3315740.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>



-- 
Met vriendelijke groet,

Martijn van Groningen

SolrCloud and TermsComponent

[Jamie Johnson]

I took a quick look at TermsComponent and noticed that it works with
distributed queries but it doesn't seem to work with distrib=true.
Am I missing something, have there been any updates to this to get
this to work with SolrCloud?

Sorting groups by numFound group size

[bobsolr]

Hi,

I'm using this sample query to group the result set by category:

q=test&group=true&group.field=category

This works as expected and I get this sample response:

"response":
{"numFound":1,"start":0,"docs":[
  {
   ...
  }
{"numFound":6,"start":0,"docs":[
  {
   ...
  }
{"numFound":3,"start":0,"docs":[
  {
   ...
  }

However, I can't find a way to specify the sort order of the groups by
number of docs each group has ("numFound field). I think the "sort" param
has something to do with it, but I don't know how to use it.

Any help will be greatly appreciated!

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Sorting-groups-by-numFound-group-size-tp3315740p3315740.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Spellcheck

[Gora Mohanty]

On Wed, Sep 7, 2011 at 3:47 PM, Danicela nutch  wrote:
> I just tried to start the data from scratch, I deleted Nutch segments and 
> solr/data/index files, but it changed nothing. Maybe I should delete other 
> elements ?
[...]

Hi,

Following up from your message on the Nutch list.
If q=*:* is showing you empty  elements,
no fields are getting indexed.

One suspicious thing that I just noticed is:


If your spell-checked fieldType is named "textSpell", the type here
should be "textSpell".

Regards,
Gora

Re: MMapDirectory failed to map a 23G compound index segment

[François Schiettecatte]

My memory of this is a little rusty but isn't mmap also limited by mem + swap 
on the box? What does 'free -g' report?

François

On Sep 7, 2011, at 12:25 PM, Rich Cariens wrote:

> Ahoy ahoy!
> 
> I've run into the dreaded OOM error with MMapDirectory on a 23G cfs compound
> index segment file. The stack trace looks pretty much like every other trace
> I've found when searching for OOM & "map failed"[1]. My configuration
> follows:
> 
> Solr 1.4.1/Lucene 2.9.3 (plus
> SOLR-1969
> )
> CentOS 4.9 (Final)
> Linux 2.6.9-100.ELsmp x86_64 yada yada yada
> Java SE (build 1.6.0_21-b06)
> Hotspot 64-bit Server VM (build 17.0-b16, mixed mode)
> ulimits:
>core file size (blocks, -c) 0
>data seg size(kbytes, -d) unlimited
>file size (blocks, -f) unlimited
>pending signals(-i) 1024
>max locked memory (kbytes, -l) 32
>max memory size (kbytes, -m) unlimited
>open files(-n) 256000
>pipe size (512 bytes, -p) 8
>POSIX message queues (bytes, -q) 819200
>stack size(kbytes, -s) 10240
>cpu time(seconds, -t) unlimited
>max user processes (-u) 1064959
>virtual memory(kbytes, -v) unlimited
>file locks(-x) unlimited
> 
> Any suggestions?
> 
> Thanks in advance,
> Rich
> 
> [1]
> ...
> java.io.IOException: Map failed
> at sun.nio.ch.FileChannelImpl.map(Unknown Source)
> at org.apache.lucene.store.MMapDirectory$MMapIndexInput.(Unknown
> Source)
> at org.apache.lucene.store.MMapDirectory$MMapIndexInput.(Unknown
> Source)
> at org.apache.lucene.store.MMapDirectory.openInput(Unknown Source)
> at org.apache.lucene.index.SegmentReader$CoreReaders.(Unknown Source)
> 
> at org.apache.lucene.index.SegmentReader.get(Unknown Source)
> at org.apache.lucene.index.SegmentReader.get(Unknown Source)
> at org.apache.lucene.index.DirectoryReader.(Unknown Source)
> at org.apache.lucene.index.ReadOnlyDirectoryReader.(Unknown Source)
> at org.apache.lucene.index.DirectoryReader$1.doBody(Unknown Source)
> at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(Unknown
> Source)
> at org.apache.lucene.index.DirectoryReader.open(Unknown Source)
> at org.apache.lucene.index.IndexReader.open(Unknown Source)
> ...
> Caused by: java.lang.OutOfMemoryError: Map failed
> at sun.nio.ch.FileChannelImpl.map0(Native Method)
> ...

MMapDirectory failed to map a 23G compound index segment

[Rich Cariens]

Ahoy ahoy!

I've run into the dreaded OOM error with MMapDirectory on a 23G cfs compound
index segment file. The stack trace looks pretty much like every other trace
I've found when searching for OOM & "map failed"[1]. My configuration
follows:

Solr 1.4.1/Lucene 2.9.3 (plus
SOLR-1969
)
CentOS 4.9 (Final)
Linux 2.6.9-100.ELsmp x86_64 yada yada yada
Java SE (build 1.6.0_21-b06)
Hotspot 64-bit Server VM (build 17.0-b16, mixed mode)
ulimits:
core file size (blocks, -c) 0
data seg size(kbytes, -d) unlimited
file size (blocks, -f) unlimited
pending signals(-i) 1024
max locked memory (kbytes, -l) 32
max memory size (kbytes, -m) unlimited
open files(-n) 256000
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
stack size(kbytes, -s) 10240
cpu time(seconds, -t) unlimited
max user processes (-u) 1064959
virtual memory(kbytes, -v) unlimited
file locks(-x) unlimited

Any suggestions?

Thanks in advance,
Rich

[1]
...
java.io.IOException: Map failed
 at sun.nio.ch.FileChannelImpl.map(Unknown Source)
 at org.apache.lucene.store.MMapDirectory$MMapIndexInput.(Unknown
Source)
 at org.apache.lucene.store.MMapDirectory$MMapIndexInput.(Unknown
Source)
 at org.apache.lucene.store.MMapDirectory.openInput(Unknown Source)
 at org.apache.lucene.index.SegmentReader$CoreReaders.(Unknown Source)

 at org.apache.lucene.index.SegmentReader.get(Unknown Source)
 at org.apache.lucene.index.SegmentReader.get(Unknown Source)
 at org.apache.lucene.index.DirectoryReader.(Unknown Source)
 at org.apache.lucene.index.ReadOnlyDirectoryReader.(Unknown Source)
 at org.apache.lucene.index.DirectoryReader$1.doBody(Unknown Source)
 at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(Unknown
Source)
 at org.apache.lucene.index.DirectoryReader.open(Unknown Source)
 at org.apache.lucene.index.IndexReader.open(Unknown Source)
...
Caused by: java.lang.OutOfMemoryError: Map failed
 at sun.nio.ch.FileChannelImpl.map0(Native Method)
...

RE: running SOLR on same server as your website

[Tim Gilbert]

Just make sure that outside users can't talk directly to your solr
instance.  If they can talk to Solr, they can add/delete documents which
will affect your site.

Tim

-Original Message-
From: okayndc [mailto:bodymo...@gmail.com] 
Sent: Wednesday, September 07, 2011 10:45 AM
To: solr-user@lucene.apache.org
Subject: Re: running SOLR on same server as your website

Right now, the index is relatively small in size ~less than 1mb.  I
think
right now, it's okay but, a couple years down the road, we may have to
transfer SOLR onto a separate application server.

On Wed, Sep 7, 2011 at 10:15 AM, Jaeger, Jay - DOT
wrote:

> You could host Solr inside the same Tomcat container, or in a
different
> servlet container (say, a second Tomcat instance) on the same server.
>
> Be aware of your OS memory requirements, though:  In my experience,
Solr
> performs best when it has lots of OS memory to cache index files (at
least,
> if your index is very big).  For that reason alone, we chose to host
our
> Solr instance (used internally only) in a separate virtual machine in
its
> own web app server instance.
>
> It is all a matter of managing your memory, CPU and disk performance.
If
> those are already constrained or nearly constrained on your website,
then
> adding Solr into that mix is probably not such a good idea.  If those
are
> not issues on your existing website, and your Solr load is modest,
then you
> can probably squeeze it onto the same server.
>
> Like most real-world answers, it comes down to "it depends".
>
> JRJ
>
> -Original Message-
> From: okayndc [mailto:bodymo...@gmail.com]
> Sent: Wednesday, September 07, 2011 9:02 AM
> To: solr-user@lucene.apache.org
> Subject: running SOLR on same server as your website
>
> Hi everyone!
>
> Is it not a good practice to run SOLR on the same server where you
website
> files sit?  Or is it a MUST to house SOLR on it's own application
server?
> The problem that I'm facing is that, my website's files sit on a
servlet
> container (Tomcat) and I think it would be more convenient to house
the
> SOLR
> instance on the same server?  Is this not a good idea?  What is your
SOLR
> setup?
>
> Thanks
>

Re: running SOLR on same server as your website

[okayndc]

Right now, the index is relatively small in size ~less than 1mb.  I think
right now, it's okay but, a couple years down the road, we may have to
transfer SOLR onto a separate application server.

On Wed, Sep 7, 2011 at 10:15 AM, Jaeger, Jay - DOT wrote:

> You could host Solr inside the same Tomcat container, or in a different
> servlet container (say, a second Tomcat instance) on the same server.
>
> Be aware of your OS memory requirements, though:  In my experience, Solr
> performs best when it has lots of OS memory to cache index files (at least,
> if your index is very big).  For that reason alone, we chose to host our
> Solr instance (used internally only) in a separate virtual machine in its
> own web app server instance.
>
> It is all a matter of managing your memory, CPU and disk performance.  If
> those are already constrained or nearly constrained on your website, then
> adding Solr into that mix is probably not such a good idea.  If those are
> not issues on your existing website, and your Solr load is modest, then you
> can probably squeeze it onto the same server.
>
> Like most real-world answers, it comes down to "it depends".
>
> JRJ
>
> -Original Message-
> From: okayndc [mailto:bodymo...@gmail.com]
> Sent: Wednesday, September 07, 2011 9:02 AM
> To: solr-user@lucene.apache.org
> Subject: running SOLR on same server as your website
>
> Hi everyone!
>
> Is it not a good practice to run SOLR on the same server where you website
> files sit?  Or is it a MUST to house SOLR on it's own application server?
> The problem that I'm facing is that, my website's files sit on a servlet
> container (Tomcat) and I think it would be more convenient to house the
> SOLR
> instance on the same server?  Is this not a good idea?  What is your SOLR
> setup?
>
> Thanks
>

RE: running SOLR on same server as your website

[Jaeger, Jay - DOT]

You could host Solr inside the same Tomcat container, or in a different servlet 
container (say, a second Tomcat instance) on the same server.

Be aware of your OS memory requirements, though:  In my experience, Solr 
performs best when it has lots of OS memory to cache index files (at least, if 
your index is very big).  For that reason alone, we chose to host our Solr 
instance (used internally only) in a separate virtual machine in its own web 
app server instance.

It is all a matter of managing your memory, CPU and disk performance.  If those 
are already constrained or nearly constrained on your website, then adding Solr 
into that mix is probably not such a good idea.  If those are not issues on 
your existing website, and your Solr load is modest, then you can probably 
squeeze it onto the same server.

Like most real-world answers, it comes down to "it depends".

JRJ

-Original Message-
From: okayndc [mailto:bodymo...@gmail.com] 
Sent: Wednesday, September 07, 2011 9:02 AM
To: solr-user@lucene.apache.org
Subject: running SOLR on same server as your website

Hi everyone!

Is it not a good practice to run SOLR on the same server where you website
files sit?  Or is it a MUST to house SOLR on it's own application server?
The problem that I'm facing is that, my website's files sit on a servlet
container (Tomcat) and I think it would be more convenient to house the SOLR
instance on the same server?  Is this not a good idea?  What is your SOLR
setup?

Thanks

Re: running SOLR on same server as your website

[okayndc]

In the context of "application", I assume that you mean SOLRJ (for example)?

On Wed, Sep 7, 2011 at 10:04 AM, Erik Hatcher wrote:

> It's not necessarily a bad idea... as long as you secure it properly such
> that user requests cannot hit Solr, only requests from your application can
> do so.
>
> Eventually, perhaps, scale would be an issue and you'd want/need to
> separate the tiers, but as long as you've got security and scalability
> covered there's no reason not to deploy together like that.
>
>Erik
>
> On Sep 7, 2011, at 10:01 , okayndc wrote:
>
> > Hi everyone!
> >
> > Is it not a good practice to run SOLR on the same server where you
> website
> > files sit?  Or is it a MUST to house SOLR on it's own application server?
> > The problem that I'm facing is that, my website's files sit on a servlet
> > container (Tomcat) and I think it would be more convenient to house the
> SOLR
> > instance on the same server?  Is this not a good idea?  What is your SOLR
> > setup?
> >
> > Thanks
>
>

Re: running SOLR on same server as your website

[Erik Hatcher]

It's not necessarily a bad idea... as long as you secure it properly such that 
user requests cannot hit Solr, only requests from your application can do so.

Eventually, perhaps, scale would be an issue and you'd want/need to separate 
the tiers, but as long as you've got security and scalability covered there's 
no reason not to deploy together like that.

Erik

On Sep 7, 2011, at 10:01 , okayndc wrote:

> Hi everyone!
> 
> Is it not a good practice to run SOLR on the same server where you website
> files sit?  Or is it a MUST to house SOLR on it's own application server?
> The problem that I'm facing is that, my website's files sit on a servlet
> container (Tomcat) and I think it would be more convenient to house the SOLR
> instance on the same server?  Is this not a good idea?  What is your SOLR
> setup?
> 
> Thanks

running SOLR on same server as your website

[okayndc]

Hi everyone!

Is it not a good practice to run SOLR on the same server where you website
files sit?  Or is it a MUST to house SOLR on it's own application server?
The problem that I'm facing is that, my website's files sit on a servlet
container (Tomcat) and I think it would be more convenient to house the SOLR
instance on the same server?  Is this not a good idea?  What is your SOLR
setup?

Thanks

Re: Reading results from FieldCollapsing

[Sowmya V.B.]

Hi Erick

It was indeed an eclipse issue! Thanks for saying that.
I cleaned the project, restarted eclipse and built again...and I can see the
getGroupResponse() method in the intellisense.

I don't understand why eclipse did that...and what happened in a
restart...but, I now see the method.

Thanks.

Sowmya.

On Wed, Sep 7, 2011 at 3:17 PM, Sowmya V.B.  wrote:

> Hi Erick
>
>
> >>does it compile? Are you absolutely sure you've pathed to the proper jar
> file? Did you check that the jar file that Eclipse is looking at has been
> rebuilt after you got the new code?
>  -the webapp does not throw compilation errors. The very fact that I am
> able to declare a GroupResponse class tells me that I am using the new Jar
> file and not the old one. Solr 3.3's Solrj jar does not have GroupResponse
> and all its related classes.
>
>
> >>What ant target did you execute to build the file?
> -After saying ant dist, a dist directory was created and I took SolrJ jar
> from that dist directory.
>
>
> >>Has Eclipse re-indexed the contents of the (new) jar file?
>  -Since I was able to declare a GroupResponse object, I think the Eclipse
> is using the new Jar file..because the Old Jar (3.3) did not have a
> GroupResponse class at all (which was why I posed this question in this user
> group, in the first place)
>
> Sowmya.
>
>
> On Wed, Sep 7, 2011 at 3:09 PM, Erick Erickson wrote:
>
>> Well, all I can say is that it does show up for me. I use IntelliJ but
>> that shouldn't
>> matter.
>>
>> I suspect there's magic in Eclipse or it's a user error. If you put it
>> in anyway,
>> does it compile? Are you absolutely sure you've pathed to the proper
>> jar file? Did you check that the jar file that Eclipse is looking at has
>> been
>> rebuilt after you got the new code? What ant target did you execute to
>> build the file? Has Eclipse re-indexed the contents of the (new) jar file?
>>
>> Perhaps someone with more Eclipse knowledge than me can chime in.
>>
>> Best
>> Erick
>>
>> On Wed, Sep 7, 2011 at 9:02 AM, Sowmya V.B.  wrote:
>> > Hi Erick
>> >
>> > I was looking the .Java file in the Src folder (...
>> > apache-solr-3.4-2011-08-29
>> _18-09-28/solr/solrj/src/java/org/apache/solr/client/solrj/response/QueryResponse.java)
>> > to make sure that the method getGroupResponse() exists in the source
>> code.
>> >
>> > After adding the Solrj jar file to my buildpath, and importing
>> QueryResponse
>> > and GroupResponse classes from it, I was looking for the method
>> > getGroupResponse() by doing a Ctrl-Space on my Eclipse IDE, for a
>> > QueryResponse class instance.  Attaching a screenshot of "ctrl-space",
>> to
>> > make myself more clear.
>> >
>> > As you can see in the screenshot, I can declare an object for
>> GroupResponse
>> > class, without getting errors. But, I dont see a getGroupResponse()
>> method
>> > for response (which is a QueryResponse object) object.
>> >
>> > Sowmya.
>> >
>> > On Wed, Sep 7, 2011 at 2:45 PM, Erick Erickson > >
>> > wrote:
>> >>
>> >> How were you looking for it? The QueryResponse class exists, and
>> >> the method is available on an instance of that class in an IDE. As I
>> said
>> >> I got a copy this morning.
>> >>
>> >> But 'jar tvf apache-solr-solrj-3.4-SNAPSHOT.jar' won't show you the
>> >> method, just the class existence.
>> >>
>> >> Best
>> >> Erick
>> >>
>> >> On Wed, Sep 7, 2011 at 7:41 AM, Sowmya V.B. 
>> wrote:
>> >> > Hi Erick
>> >> >
>> >> > Both methods don't exist in the
>> jar(apache-solr-solrj-3.4-SNAPSHOT.jar)
>> >> > file.
>> >> > I did notice getGroupResponse() method in the QueryResponse.java file
>> in
>> >> > the
>> >> > src directory though. But, it did not show up in the Jar file I got
>> >> > after
>> >> > compiling the source.
>> >> >
>> >> > Sowmya.
>> >> >
>> >> > On Wed, Sep 7, 2011 at 1:27 PM, Erick Erickson
>> >> > wrote:
>> >> >
>> >> >> I think it's
>> >> >> getGroupResponse, not
>> >> >> getGroupedResponse
>> >> >>
>> >> >> I was looking at source I just got this morning...
>> >> >>
>> >> >> Best
>> >> >> Erick
>> >> >>
>> >> >> On Wed, Sep 7, 2011 at 3:32 AM, Sowmya V.B. 
>> wrote:
>> >> >> > Hi Martjin
>> >> >> >
>> >> >> > Sorry for a late response.
>> >> >> >
>> >> >> > I did take the latest Solr build last week.
>> >> >> >
>> >> >> > After the new snapshot, there was a class called grouped response:
>> >> >> > (org.apache.solr.client.solrj.response.GroupResponse)
>> >> >> > But, the Solrj snapshot (apache-solr-solrj-3.4-SNAPSHOT.jar)'s
>> >> >> QueryResponse
>> >> >> > class did not have a method: getGroupedResponse().
>> >> >> >
>> >> >> > Is there something I am missing?
>> >> >> >
>> >> >> > S.
>> >> >> >
>> >> >> > On Wed, Aug 31, 2011 at 2:55 PM, Martijn v Groningen <
>> >> >> > martijn.v.gronin...@gmail.com> wrote:
>> >> >> >
>> >> >> >> The CollapseComponent was never comitted. This class exists in
>> the
>> >> >> >> SOLR-236 patches. You don't need to change the configuration in
>> >> >> >> order
>> >> >> >> to use grouping.
>> >> >> >> The blog yo

RE: how to run solr in apache server?

[Jaeger, Jay - DOT]

> is it possible to add servlet container to the web servers?

Some JEE/J2EE web application servers work well "downstream" of an HTTP server. 
 WebSphere application server has that capability.  Tomcat has that ability as 
well, according to the information at 
http://tomcat.apache.org/connectors-doc/webserver_howto/apache.html  (I googled 
+Tomcat +"Apache web server")

Another way is to set up your HTTP server as a "reverse proxy", and have it 
forward requests to the standalone JEE/J2EE web application server.  You can do 
that with any web app server -- it isn't really aware of the reverse proxy.  
See http://httpd.apache.org/docs/2.0/mod/mod_proxy.html 

JRJ

-Original Message-
From: nagarjuna [mailto:nagarjuna.avul...@gmail.com] 
Sent: Wednesday, September 07, 2011 8:34 AM
To: solr-user@lucene.apache.org
Subject: RE: how to run solr in apache server?

Thank u for ur reply Jaeger, Jay - DOT.
so i can conclude that solr will run only on "application
servers"(having servlet containers) and not in "web" servers am
i correct?
and i have one more question is it possible to add servlet container to the
web servers?

--
View this message in context: 
http://lucene.472066.n3.nabble.com/how-to-run-solr-in-apache-server-tp3316377p3316673.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Synonyms Not Working when using SRC & DEST

[balaji]

> So, if instead of:
>
> allergy test  =>  Doctors, Doctors-Medical, PHYSICIANS, Physicians &
> Surgeons
>
> You specified
>
>
> allergy test => allergy test, Doctors, Doctors-Medical, PHYSICIANS,
> Physicians & Surgeons
>
>
   I followed the above approach " allergy test => allergy test, Doctors,
Doctors-Medical, PHYSICIANS, Physicians & Surgeons " and it works as
expected , Thanks for making it more clear

Thanks
Balaji


--
View this message in context: 
http://lucene.472066.n3.nabble.com/Synonyms-Not-Working-when-using-SRC-DEST-tp3313862p3316691.html
Sent from the Solr - User mailing list archive at Nabble.com.

RE: how to run solr in apache server?

[nagarjuna]

Thank u for ur reply Jaeger, Jay - DOT.
so i can conclude that solr will run only on "application
servers"(having servlet containers) and not in "web" servers am
i correct?
and i have one more question is it possible to add servlet container to the
web servers?

--
View this message in context: 
http://lucene.472066.n3.nabble.com/how-to-run-solr-in-apache-server-tp3316377p3316673.html
Sent from the Solr - User mailing list archive at Nabble.com.

RE: how to run solr in apache server?

[Jaeger, Jay - DOT]

Other containers that will support Solr:  just about any JEE/J2EE container.  
We have tested under WebSphere Application Server Version 7 -- works fine.  
Oracle's web application server would presumably work, too -- just about 
anything.

-Original Message-
From: nagarjuna [mailto:nagarjuna.avul...@gmail.com] 
Sent: Wednesday, September 07, 2011 7:01 AM
To: solr-user@lucene.apache.org
Subject: RE: how to run solr in apache server?

so finally what do u say ? we cant run solr in apacheHTTP serverit is
possible only with servlet containeram i right? 
can u pls explain other than tomcat and jetty which containers will support
to run solr?

--
View this message in context: 
http://lucene.472066.n3.nabble.com/how-to-run-solr-in-apache-server-tp3316377p3316424.html
Sent from the Solr - User mailing list archive at Nabble.com.

RE: how to run solr in apache server?

[Jaeger, Jay - DOT]

That is correct.  Apache is not an *application* server.  It is an HTTP *web* 
server.  On its own it does not support running Java applications written to 
the JEE/J2EE servlet specification - like Solr.

(Apache is also not written in Java, if that was what you meant).

-Original Message-
From: nagarjuna [mailto:nagarjuna.avul...@gmail.com] 
Sent: Wednesday, September 07, 2011 6:53 AM
To: solr-user@lucene.apache.org
Subject: Re: how to run solr in apache server?

is the apacheHTTP server is not java server?

--
View this message in context: 
http://lucene.472066.n3.nabble.com/how-to-run-solr-in-apache-server-tp3316377p3316408.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: maximum rows for dataimport using solrj

[Tobias Rübner]

Thanks Erik,
but I want to change the whole configuration to e.g. connect to an other
database.
So there is also the need to add/remove (sub-)entities to resolve database
relations.

tob


On Wed, Sep 7, 2011 at 3:04 PM, Erick Erickson wrote:

> Hossman just posted this, does it help?
>
> You should be able to paramaterize hte table name in the SQL using a
> request parameter...
>
> https://wiki.apache.org/solr/DataImportHandler#Accessing_request_parameters
>
>
> Best
> Erick
>
> On Wed, Sep 7, 2011 at 9:00 AM, Tobias Rübner  wrote:
> > Thanks for your quick response.
> > The reason why I am using the debug mode is to dynamically add a data
> config
> > with my request.
> > I want to create a new core and add a new configuration to index a new
> > database with the DIH, without changing the solrconfig.xml.
> >
> > Do you see any other options?
> > tob
> >
> >
> >
> >
> >
> > On Wed, Sep 7, 2011 at 12:15 PM, Shalin Shekhar Mangar <
> > shalinman...@gmail.com> wrote:
> >
> >> On Wed, Sep 7, 2011 at 1:45 PM, Tobias Rübner  wrote:
> >>
> >> > Hi,
> >> >
> >> > I want to trigger the data import handler remotly using the solrj api.
> >> > So I added a dih request handler to my solr config and tried to call
> the
> >> > handler as described here
> >> > http://wiki.apache.org/solr/SolJava
> >> >
> >> > ModifiableSolrParams params = new ModifiableSolrParams();
> >> > params.set("qt", "/dataimport");
> >> > params.set("command", "full-import");
> >> > params.set("commit", "true");
> >> > params.set("debug", "true");
> >> >
> >> > solrServer.query(params);
> >> >
> >> >
> >> > That worked fine, but it only added the first 10 rows.
> >> > So I added a rows param
> >> > params.set("rows", 5000);
> >> >
> >> > which only allows 50M as maximum value.
> >> >
> >> > Having databases with more records, this wouldn't index all entries.
> >> >
> >> > Do you hav any suggestions how to change this?
> >> >
> >> >
> >> You are sending debug=true as a request parameter. The debug mode limits
> >> the
> >> number of rows to 10 by default and it also forces indexing to be
> >> synchronous with the request.
> >>
> >> Just remove debug=true from the params and DIH will index all entries.
> >>
> >> --
> >> Regards,
> >> Shalin Shekhar Mangar.
> >>
> >
>

Re: Reading results from FieldCollapsing

[Sowmya V.B.]

Hi Erick

>>does it compile? Are you absolutely sure you've pathed to the proper jar
file? Did you check that the jar file that Eclipse is looking at has been
rebuilt after you got the new code?
-the webapp does not throw compilation errors. The very fact that I am able
to declare a GroupResponse class tells me that I am using the new Jar file
and not the old one. Solr 3.3's Solrj jar does not have GroupResponse and
all its related classes.

>>What ant target did you execute to build the file?
-After saying ant dist, a dist directory was created and I took SolrJ jar
from that dist directory.

>>Has Eclipse re-indexed the contents of the (new) jar file?
-Since I was able to declare a GroupResponse object, I think the Eclipse is
using the new Jar file..because the Old Jar (3.3) did not have a
GroupResponse class at all (which was why I posed this question in this user
group, in the first place)

Sowmya.

On Wed, Sep 7, 2011 at 3:09 PM, Erick Erickson wrote:

> Well, all I can say is that it does show up for me. I use IntelliJ but
> that shouldn't
> matter.
>
> I suspect there's magic in Eclipse or it's a user error. If you put it
> in anyway,
> does it compile? Are you absolutely sure you've pathed to the proper
> jar file? Did you check that the jar file that Eclipse is looking at has
> been
> rebuilt after you got the new code? What ant target did you execute to
> build the file? Has Eclipse re-indexed the contents of the (new) jar file?
>
> Perhaps someone with more Eclipse knowledge than me can chime in.
>
> Best
> Erick
>
> On Wed, Sep 7, 2011 at 9:02 AM, Sowmya V.B.  wrote:
> > Hi Erick
> >
> > I was looking the .Java file in the Src folder (...
> > apache-solr-3.4-2011-08-29
> _18-09-28/solr/solrj/src/java/org/apache/solr/client/solrj/response/QueryResponse.java)
> > to make sure that the method getGroupResponse() exists in the source
> code.
> >
> > After adding the Solrj jar file to my buildpath, and importing
> QueryResponse
> > and GroupResponse classes from it, I was looking for the method
> > getGroupResponse() by doing a Ctrl-Space on my Eclipse IDE, for a
> > QueryResponse class instance.  Attaching a screenshot of "ctrl-space", to
> > make myself more clear.
> >
> > As you can see in the screenshot, I can declare an object for
> GroupResponse
> > class, without getting errors. But, I dont see a getGroupResponse()
> method
> > for response (which is a QueryResponse object) object.
> >
> > Sowmya.
> >
> > On Wed, Sep 7, 2011 at 2:45 PM, Erick Erickson 
> > wrote:
> >>
> >> How were you looking for it? The QueryResponse class exists, and
> >> the method is available on an instance of that class in an IDE. As I
> said
> >> I got a copy this morning.
> >>
> >> But 'jar tvf apache-solr-solrj-3.4-SNAPSHOT.jar' won't show you the
> >> method, just the class existence.
> >>
> >> Best
> >> Erick
> >>
> >> On Wed, Sep 7, 2011 at 7:41 AM, Sowmya V.B.  wrote:
> >> > Hi Erick
> >> >
> >> > Both methods don't exist in the
> jar(apache-solr-solrj-3.4-SNAPSHOT.jar)
> >> > file.
> >> > I did notice getGroupResponse() method in the QueryResponse.java file
> in
> >> > the
> >> > src directory though. But, it did not show up in the Jar file I got
> >> > after
> >> > compiling the source.
> >> >
> >> > Sowmya.
> >> >
> >> > On Wed, Sep 7, 2011 at 1:27 PM, Erick Erickson
> >> > wrote:
> >> >
> >> >> I think it's
> >> >> getGroupResponse, not
> >> >> getGroupedResponse
> >> >>
> >> >> I was looking at source I just got this morning...
> >> >>
> >> >> Best
> >> >> Erick
> >> >>
> >> >> On Wed, Sep 7, 2011 at 3:32 AM, Sowmya V.B. 
> wrote:
> >> >> > Hi Martjin
> >> >> >
> >> >> > Sorry for a late response.
> >> >> >
> >> >> > I did take the latest Solr build last week.
> >> >> >
> >> >> > After the new snapshot, there was a class called grouped response:
> >> >> > (org.apache.solr.client.solrj.response.GroupResponse)
> >> >> > But, the Solrj snapshot (apache-solr-solrj-3.4-SNAPSHOT.jar)'s
> >> >> QueryResponse
> >> >> > class did not have a method: getGroupedResponse().
> >> >> >
> >> >> > Is there something I am missing?
> >> >> >
> >> >> > S.
> >> >> >
> >> >> > On Wed, Aug 31, 2011 at 2:55 PM, Martijn v Groningen <
> >> >> > martijn.v.gronin...@gmail.com> wrote:
> >> >> >
> >> >> >> The CollapseComponent was never comitted. This class exists in the
> >> >> >> SOLR-236 patches. You don't need to change the configuration in
> >> >> >> order
> >> >> >> to use grouping.
> >> >> >> The blog you mentioned is based on the SOLR-236 patches. The
> current
> >> >> >> grouping in Solr 3.3 has superseded these patches.
> >> >> >>
> >> >> >> From Solr 3.4 (not yet released) the QueryResponse class in solrj
> >> >> >> has
> >> >> >> a method getGroupResponse. Use this method to get the grouped
> >> >> >> response.
> >> >> >>
> >> >> >> On 31 August 2011 14:10, Erick Erickson 
> >> >> wrote:
> >> >> >> > Actually, I haven't used the new stuff yet, so I'm not entirely
> >> >> >> > sure
> >> >> >> either,
> >> >> >> > but that sure

RE: Sentence aware Highlighter

[O. Klein]

I just stumbled upon https://issues.apache.org/jira/browse/LUCENE-1822 maybe
this can help too?

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Sentence-aware-Highlighter-tp3310982p3316619.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Reading results from FieldCollapsing

[Erick Erickson]

Well, all I can say is that it does show up for me. I use IntelliJ but
that shouldn't
matter.

I suspect there's magic in Eclipse or it's a user error. If you put it
in anyway,
does it compile? Are you absolutely sure you've pathed to the proper
jar file? Did you check that the jar file that Eclipse is looking at has been
rebuilt after you got the new code? What ant target did you execute to
build the file? Has Eclipse re-indexed the contents of the (new) jar file?

Perhaps someone with more Eclipse knowledge than me can chime in.

Best
Erick

On Wed, Sep 7, 2011 at 9:02 AM, Sowmya V.B.  wrote:
> Hi Erick
>
> I was looking the .Java file in the Src folder (...
> apache-solr-3.4-2011-08-29_18-09-28/solr/solrj/src/java/org/apache/solr/client/solrj/response/QueryResponse.java)
> to make sure that the method getGroupResponse() exists in the source code.
>
> After adding the Solrj jar file to my buildpath, and importing QueryResponse
> and GroupResponse classes from it, I was looking for the method
> getGroupResponse() by doing a Ctrl-Space on my Eclipse IDE, for a
> QueryResponse class instance.  Attaching a screenshot of "ctrl-space", to
> make myself more clear.
>
> As you can see in the screenshot, I can declare an object for GroupResponse
> class, without getting errors. But, I dont see a getGroupResponse() method
> for response (which is a QueryResponse object) object.
>
> Sowmya.
>
> On Wed, Sep 7, 2011 at 2:45 PM, Erick Erickson 
> wrote:
>>
>> How were you looking for it? The QueryResponse class exists, and
>> the method is available on an instance of that class in an IDE. As I said
>> I got a copy this morning.
>>
>> But 'jar tvf apache-solr-solrj-3.4-SNAPSHOT.jar' won't show you the
>> method, just the class existence.
>>
>> Best
>> Erick
>>
>> On Wed, Sep 7, 2011 at 7:41 AM, Sowmya V.B.  wrote:
>> > Hi Erick
>> >
>> > Both methods don't exist in the jar(apache-solr-solrj-3.4-SNAPSHOT.jar)
>> > file.
>> > I did notice getGroupResponse() method in the QueryResponse.java file in
>> > the
>> > src directory though. But, it did not show up in the Jar file I got
>> > after
>> > compiling the source.
>> >
>> > Sowmya.
>> >
>> > On Wed, Sep 7, 2011 at 1:27 PM, Erick Erickson
>> > wrote:
>> >
>> >> I think it's
>> >> getGroupResponse, not
>> >> getGroupedResponse
>> >>
>> >> I was looking at source I just got this morning...
>> >>
>> >> Best
>> >> Erick
>> >>
>> >> On Wed, Sep 7, 2011 at 3:32 AM, Sowmya V.B.  wrote:
>> >> > Hi Martjin
>> >> >
>> >> > Sorry for a late response.
>> >> >
>> >> > I did take the latest Solr build last week.
>> >> >
>> >> > After the new snapshot, there was a class called grouped response:
>> >> > (org.apache.solr.client.solrj.response.GroupResponse)
>> >> > But, the Solrj snapshot (apache-solr-solrj-3.4-SNAPSHOT.jar)'s
>> >> QueryResponse
>> >> > class did not have a method: getGroupedResponse().
>> >> >
>> >> > Is there something I am missing?
>> >> >
>> >> > S.
>> >> >
>> >> > On Wed, Aug 31, 2011 at 2:55 PM, Martijn v Groningen <
>> >> > martijn.v.gronin...@gmail.com> wrote:
>> >> >
>> >> >> The CollapseComponent was never comitted. This class exists in the
>> >> >> SOLR-236 patches. You don't need to change the configuration in
>> >> >> order
>> >> >> to use grouping.
>> >> >> The blog you mentioned is based on the SOLR-236 patches. The current
>> >> >> grouping in Solr 3.3 has superseded these patches.
>> >> >>
>> >> >> From Solr 3.4 (not yet released) the QueryResponse class in solrj
>> >> >> has
>> >> >> a method getGroupResponse. Use this method to get the grouped
>> >> >> response.
>> >> >>
>> >> >> On 31 August 2011 14:10, Erick Erickson 
>> >> wrote:
>> >> >> > Actually, I haven't used the new stuff yet, so I'm not entirely
>> >> >> > sure
>> >> >> either,
>> >> >> > but that sure would be the place to start. There's some historical
>> >> >> > ambiguity, Grouping started out as "Field Collapsing", and they
>> >> >> > are
>> >> >> > used interchangeably.
>> >> >> >
>> >> >> > If you go to the bug I linked to and open up the patch file,
>> >> >> > you'll
>> >> >> > see the code that implements the grouping in SolrJ, that should
>> >> >> > give you a good place to start.
>> >> >> >
>> >> >> > Best
>> >> >> > Erick
>> >> >> >
>> >> >> > On Wed, Aug 31, 2011 at 3:28 AM, Sowmya V.B. 
>> >> wrote:
>> >> >> >> Hi Erick
>> >> >> >>
>> >> >> >> I downloaded the latest build from (
>> >> >> >>
>> >> >>
>> >>
>> >> https://builds.apache.org/job/Solr-3.x/lastSuccessfulBuild/artifact/artifacts/
>> >> >> >> )
>> >> >> >> But, I don't find the required class CollapseComponent in the
>> >> >> >> src.
>> >> >> >> (org.apache.solr.handler.component.CollapseComponent).
>> >> >> >>
>> >> >> >> The SolrJ in 3.4 does seem to have something like GroupResponse,
>> >> >> >> GroupCommand classes, which might be the ones I am looking for
>> >> (though I
>> >> >> am
>> >> >> >> not very sure).
>> >> >> >>
>> >> >> >>
>> >> >> >> Regards
>> >> >> >> Sowmya.
>> >> >> >>
>> >> >> >> On Tue, Aug 30, 2

Re: how to run solr in apache server?

[nagarjuna]

Thank u very much for ur grateful suggestion Erick Erickson.
 actually i know whole process of running solr in "tomcat","jetty"
and right now i am using solr with jetty but, my requirement made me to
search the process of running solr in Apache HTTP serverbut ultimately i
got the point that, i only can run the solr in servlet containers and not in
the other servers those are not having servlet containers..these
things i got from my research but,i am not sure about these details ...if u
know can u pls corrections abt my research 


thank u very much 

--
View this message in context: 
http://lucene.472066.n3.nabble.com/how-to-run-solr-in-apache-server-tp3316377p3316594.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: maximum rows for dataimport using solrj

[Erick Erickson]

Hossman just posted this, does it help?

You should be able to paramaterize hte table name in the SQL using a
request parameter...

https://wiki.apache.org/solr/DataImportHandler#Accessing_request_parameters


Best
Erick

On Wed, Sep 7, 2011 at 9:00 AM, Tobias Rübner  wrote:
> Thanks for your quick response.
> The reason why I am using the debug mode is to dynamically add a data config
> with my request.
> I want to create a new core and add a new configuration to index a new
> database with the DIH, without changing the solrconfig.xml.
>
> Do you see any other options?
> tob
>
>
>
>
>
> On Wed, Sep 7, 2011 at 12:15 PM, Shalin Shekhar Mangar <
> shalinman...@gmail.com> wrote:
>
>> On Wed, Sep 7, 2011 at 1:45 PM, Tobias Rübner  wrote:
>>
>> > Hi,
>> >
>> > I want to trigger the data import handler remotly using the solrj api.
>> > So I added a dih request handler to my solr config and tried to call the
>> > handler as described here
>> > http://wiki.apache.org/solr/SolJava
>> >
>> > ModifiableSolrParams params = new ModifiableSolrParams();
>> > params.set("qt", "/dataimport");
>> > params.set("command", "full-import");
>> > params.set("commit", "true");
>> > params.set("debug", "true");
>> >
>> > solrServer.query(params);
>> >
>> >
>> > That worked fine, but it only added the first 10 rows.
>> > So I added a rows param
>> > params.set("rows", 5000);
>> >
>> > which only allows 50M as maximum value.
>> >
>> > Having databases with more records, this wouldn't index all entries.
>> >
>> > Do you hav any suggestions how to change this?
>> >
>> >
>> You are sending debug=true as a request parameter. The debug mode limits
>> the
>> number of rows to 10 by default and it also forces indexing to be
>> synchronous with the request.
>>
>> Just remove debug=true from the params and DIH will index all entries.
>>
>> --
>> Regards,
>> Shalin Shekhar Mangar.
>>
>

RE: Synonyms Not Working when using SRC & DEST

[Jaeger, Jay - DOT]

Also, just to make one thing just a bit more clear.   You can specify two 
different kinds of entries in synonym files.  See 
http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters 
(solr.SynonymFilterFactory)


One is replacement, where the words before the "=>" are *replaced* by the right 
hand side, i.e., the words on the left hand side "disappear".  This is what you 
are currently doing according to your original message:

#Explicit mappings match any token sequence on the LHS of "=>"
#and replace with all alternatives on the RHS.  These types of mappings
#ignore the expand parameter in the schema.
#Examples:
i-pod, i pod => ipod,
sea biscuit, sea biscit => seabiscuit



The other is equivalence, where each term is expanded into the entire list, if 
you do the following, with expand set to true:

#Equivalent synonyms may be separated with commas and give
#no explicit mapping.  In this case the mapping behavior will
#be taken from the expand parameter in the schema.  This allows
#the same synonym file to be used in different synonym handling strategies.
#Examples:
ipod, i-pod, i pod
foozball , foosball
universe , cosmos



So, if instead of:

allergy test  =>  Doctors, Doctors-Medical, PHYSICIANS, Physicians & Surgeons

You specified


allergy test => allergy test, Doctors, Doctors-Medical, PHYSICIANS, Physicians 
& Surgeons 

Or 

allergy test, Doctors, Doctors-Medical, PHYSICIANS, Physicians & Surgeons

with expand set to true,  then you might get the behavior your desire:  
"Allergy test" would get indexed, along with "Doctors" and all of the rest.  
The difference being that in the second case, any of those terms (e.g. 
"Docotrs") would also get indexed as "Allergy test" which might not be what you 
desire, in which case the first one would do what you want.

I expect that all you really need to do is:

allergy test => allergy test, Doctors, Doctors-Medical, PHYSICIANS, Physicians 
& Surgeons

to solve your problem.

JRJ

-Original Message-
From: balaji [mailto:mcabal...@gmail.com] 
Sent: Tuesday, September 06, 2011 7:48 PM
To: solr-user@lucene.apache.org
Subject: Re: Synonyms Not Working when using SRC & DEST

> It won't work given your current schema.  To get the desired results, you
> would need to expand your synonyms at both index AND query time.  Right now
> your schema seems to specify it only at index time.
>

I have a very huge schema spanning up to 10K lines , if I use query time it
will be huge hit for me because one term will be mapped to multiple terms .
similar in the case of allergy

I doesn't want to go with comma separated as it will give
some erroneous results  and more over allergy and doctors are not equivalent
terms to be used in comma


>
> So, as the other respondent indicated, currently you replace allergy with
> the other list when indexing, and since allergy is not replaced during
> query, it gets no hits.
>

I replace allergy during the index with doctors , So it shouldn't be part of
the document ?


Thanks
Balaji


--
View this message in context: 
http://lucene.472066.n3.nabble.com/Synonyms-Not-Working-when-using-SRC-DEST-tp3313862p3315287.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Reading results from FieldCollapsing

[Sowmya V.B.]

Hi Erick

I was looking the .Java file in the Src folder (...
apache-solr-3.4-2011-08-29_18-09-28/solr/solrj/src/java/org/apache/solr/client/solrj/response/QueryResponse.java)
to make sure that the method getGroupResponse() exists in the source code.

After adding the Solrj jar file to my buildpath, and importing QueryResponse
and GroupResponse classes from it, I was looking for the method
getGroupResponse() by doing a Ctrl-Space on my Eclipse IDE, for a
QueryResponse class instance.  Attaching a screenshot of "ctrl-space", to
make myself more clear.

As you can see in the screenshot, I can declare an object for GroupResponse
class, without getting errors. But, I dont see a getGroupResponse() method
for response (which is a QueryResponse object) object.

Sowmya.

On Wed, Sep 7, 2011 at 2:45 PM, Erick Erickson wrote:

> How were you looking for it? The QueryResponse class exists, and
> the method is available on an instance of that class in an IDE. As I said
> I got a copy this morning.
>
> But 'jar tvf apache-solr-solrj-3.4-SNAPSHOT.jar' won't show you the
> method, just the class existence.
>
> Best
> Erick
>
> On Wed, Sep 7, 2011 at 7:41 AM, Sowmya V.B.  wrote:
> > Hi Erick
> >
> > Both methods don't exist in the jar(apache-solr-solrj-3.4-SNAPSHOT.jar)
> > file.
> > I did notice getGroupResponse() method in the QueryResponse.java file in
> the
> > src directory though. But, it did not show up in the Jar file I got after
> > compiling the source.
> >
> > Sowmya.
> >
> > On Wed, Sep 7, 2011 at 1:27 PM, Erick Erickson  >wrote:
> >
> >> I think it's
> >> getGroupResponse, not
> >> getGroupedResponse
> >>
> >> I was looking at source I just got this morning...
> >>
> >> Best
> >> Erick
> >>
> >> On Wed, Sep 7, 2011 at 3:32 AM, Sowmya V.B.  wrote:
> >> > Hi Martjin
> >> >
> >> > Sorry for a late response.
> >> >
> >> > I did take the latest Solr build last week.
> >> >
> >> > After the new snapshot, there was a class called grouped response:
> >> > (org.apache.solr.client.solrj.response.GroupResponse)
> >> > But, the Solrj snapshot (apache-solr-solrj-3.4-SNAPSHOT.jar)'s
> >> QueryResponse
> >> > class did not have a method: getGroupedResponse().
> >> >
> >> > Is there something I am missing?
> >> >
> >> > S.
> >> >
> >> > On Wed, Aug 31, 2011 at 2:55 PM, Martijn v Groningen <
> >> > martijn.v.gronin...@gmail.com> wrote:
> >> >
> >> >> The CollapseComponent was never comitted. This class exists in the
> >> >> SOLR-236 patches. You don't need to change the configuration in order
> >> >> to use grouping.
> >> >> The blog you mentioned is based on the SOLR-236 patches. The current
> >> >> grouping in Solr 3.3 has superseded these patches.
> >> >>
> >> >> From Solr 3.4 (not yet released) the QueryResponse class in solrj has
> >> >> a method getGroupResponse. Use this method to get the grouped
> >> >> response.
> >> >>
> >> >> On 31 August 2011 14:10, Erick Erickson 
> >> wrote:
> >> >> > Actually, I haven't used the new stuff yet, so I'm not entirely
> sure
> >> >> either,
> >> >> > but that sure would be the place to start. There's some historical
> >> >> > ambiguity, Grouping started out as "Field Collapsing", and they are
> >> >> > used interchangeably.
> >> >> >
> >> >> > If you go to the bug I linked to and open up the patch file, you'll
> >> >> > see the code that implements the grouping in SolrJ, that should
> >> >> > give you a good place to start.
> >> >> >
> >> >> > Best
> >> >> > Erick
> >> >> >
> >> >> > On Wed, Aug 31, 2011 at 3:28 AM, Sowmya V.B. 
> >> wrote:
> >> >> >> Hi Erick
> >> >> >>
> >> >> >> I downloaded the latest build from (
> >> >> >>
> >> >>
> >>
> https://builds.apache.org/job/Solr-3.x/lastSuccessfulBuild/artifact/artifacts/
> >> >> >> )
> >> >> >> But, I don't find the required class CollapseComponent in the src.
> >> >> >> (org.apache.solr.handler.component.CollapseComponent).
> >> >> >>
> >> >> >> The SolrJ in 3.4 does seem to have something like GroupResponse,
> >> >> >> GroupCommand classes, which might be the ones I am looking for
> >> (though I
> >> >> am
> >> >> >> not very sure).
> >> >> >>
> >> >> >>
> >> >> >> Regards
> >> >> >> Sowmya.
> >> >> >>
> >> >> >> On Tue, Aug 30, 2011 at 5:14 PM, Erick Erickson <
> >> >> erickerick...@gmail.com>wrote:
> >> >> >>
> >> >> >>> Ahhh, see: https://issues.apache.org/jira/browse/SOLR-2637
> >> >> >>>
> >> >> >>> Short form: It's in 3.4, not 3.3.
> >> >> >>>
> >> >> >>> So, your choices are:
> >> >> >>> 1> parse the XML yourself
> >> >> >>> 2> get a current 3x build (as in one of the nightlys) and use
> SolrJ
> >> >> there.
> >> >> >>>
> >> >> >>> Best
> >> >> >>> Erick
> >> >> >>>
> >> >> >>> On Tue, Aug 30, 2011 at 11:09 AM, Sowmya V.B. <
> vbsow...@gmail.com>
> >> >> wrote:
> >> >> >>> > Hi Erick
> >> >> >>> >
> >> >> >>> > Yes, I did see the XML format. But, I did not understand how to
> >> read
> >> >> the
> >> >> >>> > response using SolrJ.
> >> >> >>> >
> >> >> >>> > I found some information about Collapse Component on googling,
> >

RE: Sentence aware Highlighter

[O. Klein]

Not truncating terms anymore is a good first step. Ill be looking forward to
your solution Koji.

A real SentenceAwareFragmentsBuilder is probably too difficult to make. But
maybe someone can implement the RegexFragmenter functionality for FVH.





--
View this message in context: 
http://lucene.472066.n3.nabble.com/Sentence-aware-Highlighter-tp3310982p3316573.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: maximum rows for dataimport using solrj

[Tobias Rübner]

Thanks for your quick response.
The reason why I am using the debug mode is to dynamically add a data config
with my request.
I want to create a new core and add a new configuration to index a new
database with the DIH, without changing the solrconfig.xml.

Do you see any other options?
tob





On Wed, Sep 7, 2011 at 12:15 PM, Shalin Shekhar Mangar <
shalinman...@gmail.com> wrote:

> On Wed, Sep 7, 2011 at 1:45 PM, Tobias Rübner  wrote:
>
> > Hi,
> >
> > I want to trigger the data import handler remotly using the solrj api.
> > So I added a dih request handler to my solr config and tried to call the
> > handler as described here
> > http://wiki.apache.org/solr/SolJava
> >
> > ModifiableSolrParams params = new ModifiableSolrParams();
> > params.set("qt", "/dataimport");
> > params.set("command", "full-import");
> > params.set("commit", "true");
> > params.set("debug", "true");
> >
> > solrServer.query(params);
> >
> >
> > That worked fine, but it only added the first 10 rows.
> > So I added a rows param
> > params.set("rows", 5000);
> >
> > which only allows 50M as maximum value.
> >
> > Having databases with more records, this wouldn't index all entries.
> >
> > Do you hav any suggestions how to change this?
> >
> >
> You are sending debug=true as a request parameter. The debug mode limits
> the
> number of rows to 10 by default and it also forces indexing to be
> synchronous with the request.
>
> Just remove debug=true from the params and DIH will index all entries.
>
> --
> Regards,
> Shalin Shekhar Mangar.
>

Re: how to run solr in apache server?

[Erick Erickson]

Please look at this page: http://wiki.apache.org/solr/SolrInstall.
Near the bottom
there is a list of tips for setting up Solr in various containers.
Will one of them
work for you?

But if you're just starting, why not make it easy and start with the
example that
is already set up to run in Jetty? Unpack the Solr distribution, go to the
solr example directory and type "java -jar start.jar".

Best
Erick

On Wed, Sep 7, 2011 at 8:01 AM, nagarjuna  wrote:
> so finally what do u say ? we cant run solr in apacheHTTP serverit is
> possible only with servlet containeram i right?
> can u pls explain other than tomcat and jetty which containers will support
> to run solr?
>
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/how-to-run-solr-in-apache-server-tp3316377p3316424.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

RE: Synonyms Not Working when using SRC & DEST

[Jaeger, Jay - DOT]

> I have a very huge schema spanning up to 10K lines , if I use query time it
> will be huge hit for me because one term will be mapped to multiple terms .
> similar in the case of allergy

I think maybe you mean synonym file, rather than the schema?  I doubt that the 
number of lines matters all that much, though undoubtedly some.  I expect that 
Solr loads that synonym file into some kind of hash map, rather than searching 
it linearly -- though I have not looked at the code for that.

> I replace allergy during the index with doctors , So it shouldn't be part of
> the document ?

Yes indeed, doctors would be in the index, and would give you a hit on that 
document when searched.  But because your synonym file specifies replacement, 
that means that allergy is *NOT* part of the index, hence, when you searched on 
allergy, you got no results.

As far as synonym expansion being a "huge hit", no, not really, I think.  
Besides, if you are not getting what you want or need, speed becomes pretty 
much irrelevant.  We did some performance testing:  modest single server (i.e., 
a laptop running Windows XP with only 2GB total memory available), pretty much 
configured "out of the box" with jetty, except that we added waffle 
authentication.  The data was names, addresses and the like (not text) -- 7+ 
million rows, with considerable synonym expansion:  200 first name synonyms, 
433 last name synonyms, expanded at both index time and search time.

We then did a search test driven from those same synonyms files, by randomly 
picking out a name from the first and last name list, the idea being that most 
likely names did have some synonyms.

Under Solr 3.1, once the OS file system cache got some entries in there, 
running with 8 concurrent client search threads sending HTTP search requests 
(done in perl) we averaged about .50 seconds per request, or over 55,000 
searches per hour.

JRJ

-Original Message-
From: balaji [mailto:mcabal...@gmail.com] 
Sent: Tuesday, September 06, 2011 7:48 PM
To: solr-user@lucene.apache.org
Subject: Re: Synonyms Not Working when using SRC & DEST

> It won't work given your current schema.  To get the desired results, you
> would need to expand your synonyms at both index AND query time.  Right now
> your schema seems to specify it only at index time.
>

I have a very huge schema spanning up to 10K lines , if I use query time it
will be huge hit for me because one term will be mapped to multiple terms .
similar in the case of allergy

I doesn't want to go with comma separated as it will give
some erroneous results  and more over allergy and doctors are not equivalent
terms to be used in comma


>
> So, as the other respondent indicated, currently you replace allergy with
> the other list when indexing, and since allergy is not replaced during
> query, it gets no hits.
>

I replace allergy during the index with doctors , So it shouldn't be part of
the document ?


Thanks
Balaji


--
View this message in context: 
http://lucene.472066.n3.nabble.com/Synonyms-Not-Working-when-using-SRC-DEST-tp3313862p3315287.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Reading results from FieldCollapsing

[Erick Erickson]

How were you looking for it? The QueryResponse class exists, and
the method is available on an instance of that class in an IDE. As I said
I got a copy this morning.

But 'jar tvf apache-solr-solrj-3.4-SNAPSHOT.jar' won't show you the
method, just the class existence.

Best
Erick

On Wed, Sep 7, 2011 at 7:41 AM, Sowmya V.B.  wrote:
> Hi Erick
>
> Both methods don't exist in the jar(apache-solr-solrj-3.4-SNAPSHOT.jar)
> file.
> I did notice getGroupResponse() method in the QueryResponse.java file in the
> src directory though. But, it did not show up in the Jar file I got after
> compiling the source.
>
> Sowmya.
>
> On Wed, Sep 7, 2011 at 1:27 PM, Erick Erickson wrote:
>
>> I think it's
>> getGroupResponse, not
>> getGroupedResponse
>>
>> I was looking at source I just got this morning...
>>
>> Best
>> Erick
>>
>> On Wed, Sep 7, 2011 at 3:32 AM, Sowmya V.B.  wrote:
>> > Hi Martjin
>> >
>> > Sorry for a late response.
>> >
>> > I did take the latest Solr build last week.
>> >
>> > After the new snapshot, there was a class called grouped response:
>> > (org.apache.solr.client.solrj.response.GroupResponse)
>> > But, the Solrj snapshot (apache-solr-solrj-3.4-SNAPSHOT.jar)'s
>> QueryResponse
>> > class did not have a method: getGroupedResponse().
>> >
>> > Is there something I am missing?
>> >
>> > S.
>> >
>> > On Wed, Aug 31, 2011 at 2:55 PM, Martijn v Groningen <
>> > martijn.v.gronin...@gmail.com> wrote:
>> >
>> >> The CollapseComponent was never comitted. This class exists in the
>> >> SOLR-236 patches. You don't need to change the configuration in order
>> >> to use grouping.
>> >> The blog you mentioned is based on the SOLR-236 patches. The current
>> >> grouping in Solr 3.3 has superseded these patches.
>> >>
>> >> From Solr 3.4 (not yet released) the QueryResponse class in solrj has
>> >> a method getGroupResponse. Use this method to get the grouped
>> >> response.
>> >>
>> >> On 31 August 2011 14:10, Erick Erickson 
>> wrote:
>> >> > Actually, I haven't used the new stuff yet, so I'm not entirely sure
>> >> either,
>> >> > but that sure would be the place to start. There's some historical
>> >> > ambiguity, Grouping started out as "Field Collapsing", and they are
>> >> > used interchangeably.
>> >> >
>> >> > If you go to the bug I linked to and open up the patch file, you'll
>> >> > see the code that implements the grouping in SolrJ, that should
>> >> > give you a good place to start.
>> >> >
>> >> > Best
>> >> > Erick
>> >> >
>> >> > On Wed, Aug 31, 2011 at 3:28 AM, Sowmya V.B. 
>> wrote:
>> >> >> Hi Erick
>> >> >>
>> >> >> I downloaded the latest build from (
>> >> >>
>> >>
>> https://builds.apache.org/job/Solr-3.x/lastSuccessfulBuild/artifact/artifacts/
>> >> >> )
>> >> >> But, I don't find the required class CollapseComponent in the src.
>> >> >> (org.apache.solr.handler.component.CollapseComponent).
>> >> >>
>> >> >> The SolrJ in 3.4 does seem to have something like GroupResponse,
>> >> >> GroupCommand classes, which might be the ones I am looking for
>> (though I
>> >> am
>> >> >> not very sure).
>> >> >>
>> >> >>
>> >> >> Regards
>> >> >> Sowmya.
>> >> >>
>> >> >> On Tue, Aug 30, 2011 at 5:14 PM, Erick Erickson <
>> >> erickerick...@gmail.com>wrote:
>> >> >>
>> >> >>> Ahhh, see: https://issues.apache.org/jira/browse/SOLR-2637
>> >> >>>
>> >> >>> Short form: It's in 3.4, not 3.3.
>> >> >>>
>> >> >>> So, your choices are:
>> >> >>> 1> parse the XML yourself
>> >> >>> 2> get a current 3x build (as in one of the nightlys) and use SolrJ
>> >> there.
>> >> >>>
>> >> >>> Best
>> >> >>> Erick
>> >> >>>
>> >> >>> On Tue, Aug 30, 2011 at 11:09 AM, Sowmya V.B. 
>> >> wrote:
>> >> >>> > Hi Erick
>> >> >>> >
>> >> >>> > Yes, I did see the XML format. But, I did not understand how to
>> read
>> >> the
>> >> >>> > response using SolrJ.
>> >> >>> >
>> >> >>> > I found some information about Collapse Component on googling,
>> which
>> >> >>> looks
>> >> >>> > like a normal Solr XML results format.
>> >> >>> >
>> >> >>>
>> >>
>> http://blog.jteam.nl/2009/10/20/result-grouping-field-collapsing-with-solr/
>> >> >>> >
>> >> >>> > However, this class CollapseComponent does not seem to exist in
>> Solr
>> >> >>> > 3.3. (org.apache.solr.handler.component.CollapseComponent)
>> >> >>> > was the component mentioned in that link, which is not there in
>> >> Solr3.3
>> >> >>> > class files.
>> >> >>> >
>> >> >>> > Sowmya.
>> >> >>> >
>> >> >>> > On Tue, Aug 30, 2011 at 4:48 PM, Erick Erickson <
>> >> erickerick...@gmail.com
>> >> >>> >wrote:
>> >> >>> >
>> >> >>> >> Have you looked at the XML (or JSON) response format?
>> >> >>> >> You're right, it is different and you have to parse it
>> >> >>> >> differently, there are move levels. Try this query
>> >> >>> >> and you'll see the format (default data set).
>> >> >>> >>
>> >> >>> >>
>> >> http://localhost:8983/solr/select?q=*:*&group=on&group.field=manu_exact
>> >> >>> >>
>> >> >>> >>
>> >> >>> >> Best
>> >> >>> >> Erick
>> >> >>> >>
>> >> >>> >> On Tue, Aug 30, 2011 at 9:25

RE: how to run solr in apache server?

[nagarjuna]

so finally what do u say ? we cant run solr in apacheHTTP serverit is
possible only with servlet containeram i right? 
can u pls explain other than tomcat and jetty which containers will support
to run solr?

--
View this message in context: 
http://lucene.472066.n3.nabble.com/how-to-run-solr-in-apache-server-tp3316377p3316424.html
Sent from the Solr - User mailing list archive at Nabble.com.

RE: how to run solr in apache server?

[Moore, Gary]

Solr only runs in a container.  To make it appear as if Solr is "running" on 
httpd,  Google 'httpd tomcat' for instructions on how to front tomcat with 
httpd mod_jk or mod_proxy.  Our system admins prefer mod_proxy.  Not sure why 
you'd need to front Solr with httpd since it's usually an application backend, 
e.g. a PHP application running on port 80 connects to Solr on port 8983.
Gary

-Original Message-
From: nagarjuna [mailto:nagarjuna.avul...@gmail.com] 
Sent: Wednesday, September 07, 2011 7:41 AM
To: solr-user@lucene.apache.org
Subject: how to run solr in apache server?

Hi everybody...
 can anybody tell me how to run solr on Apache server(not apache
tomcat)


Thnax in advance

--
View this message in context: 
http://lucene.472066.n3.nabble.com/how-to-run-solr-in-apache-server-tp3316377p3316377.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr 1.4.1: problems with replication and index operation both at the same time.

[Erick Erickson]

Hmmm, why all those tomcats? Are they all running Solr?
I'm pretty sure you'd be a lot better off simply having
one indexer and one searcher on this box. Give the searcher
the most resources I'd guess. In fact, you'd
be even better off offloading the indexing process to a different
(perhaps less powerful machine) and running your searcher
on this box, giving it a bunch of resources.

Here's what I'd do: Monitor the box (top on a *nix machine is
a good first approximation) and see what your resource contention
is all about. I suspect you're simply I/O bound since, if I'm reading
this all correctly, this is all on one box and they're all Solr's. It's
all sitting on one poor little disk, which is probably being beaten to
death when it replicates to the 5 tomcats on the same box that
are slaves at the same time.

Try it with one slave rather than 5 for a quick test whether this is
indeed an issue.

Of course I may be mis-reading your setup entirely

Best
Erick

Re: how to run solr in apache server?

[Markus Jelsma]

You can only run Solr embedded in a Java application (not recommended) or in 
some servlet container such as Tomcat, Jetty etc.

On Wednesday 07 September 2011 13:40:50 nagarjuna wrote:
> Hi everybody...
>  can anybody tell me how to run solr on Apache server(not apache
> tomcat)
> 
> 
> Thnax in advance
> 
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/how-to-run-solr-in-apache-server-tp3316
> 377p3316377.html Sent from the Solr - User mailing list archive at
> Nabble.com.

-- 
Markus Jelsma - CTO - Openindex
http://www.linkedin.com/in/markus17
050-8536620 / 06-50258350

Re: Reading results from FieldCollapsing

[Sowmya V.B.]

Hi Erick

Both methods don't exist in the jar(apache-solr-solrj-3.4-SNAPSHOT.jar)
file.
I did notice getGroupResponse() method in the QueryResponse.java file in the
src directory though. But, it did not show up in the Jar file I got after
compiling the source.

Sowmya.

On Wed, Sep 7, 2011 at 1:27 PM, Erick Erickson wrote:

> I think it's
> getGroupResponse, not
> getGroupedResponse
>
> I was looking at source I just got this morning...
>
> Best
> Erick
>
> On Wed, Sep 7, 2011 at 3:32 AM, Sowmya V.B.  wrote:
> > Hi Martjin
> >
> > Sorry for a late response.
> >
> > I did take the latest Solr build last week.
> >
> > After the new snapshot, there was a class called grouped response:
> > (org.apache.solr.client.solrj.response.GroupResponse)
> > But, the Solrj snapshot (apache-solr-solrj-3.4-SNAPSHOT.jar)'s
> QueryResponse
> > class did not have a method: getGroupedResponse().
> >
> > Is there something I am missing?
> >
> > S.
> >
> > On Wed, Aug 31, 2011 at 2:55 PM, Martijn v Groningen <
> > martijn.v.gronin...@gmail.com> wrote:
> >
> >> The CollapseComponent was never comitted. This class exists in the
> >> SOLR-236 patches. You don't need to change the configuration in order
> >> to use grouping.
> >> The blog you mentioned is based on the SOLR-236 patches. The current
> >> grouping in Solr 3.3 has superseded these patches.
> >>
> >> From Solr 3.4 (not yet released) the QueryResponse class in solrj has
> >> a method getGroupResponse. Use this method to get the grouped
> >> response.
> >>
> >> On 31 August 2011 14:10, Erick Erickson 
> wrote:
> >> > Actually, I haven't used the new stuff yet, so I'm not entirely sure
> >> either,
> >> > but that sure would be the place to start. There's some historical
> >> > ambiguity, Grouping started out as "Field Collapsing", and they are
> >> > used interchangeably.
> >> >
> >> > If you go to the bug I linked to and open up the patch file, you'll
> >> > see the code that implements the grouping in SolrJ, that should
> >> > give you a good place to start.
> >> >
> >> > Best
> >> > Erick
> >> >
> >> > On Wed, Aug 31, 2011 at 3:28 AM, Sowmya V.B. 
> wrote:
> >> >> Hi Erick
> >> >>
> >> >> I downloaded the latest build from (
> >> >>
> >>
> https://builds.apache.org/job/Solr-3.x/lastSuccessfulBuild/artifact/artifacts/
> >> >> )
> >> >> But, I don't find the required class CollapseComponent in the src.
> >> >> (org.apache.solr.handler.component.CollapseComponent).
> >> >>
> >> >> The SolrJ in 3.4 does seem to have something like GroupResponse,
> >> >> GroupCommand classes, which might be the ones I am looking for
> (though I
> >> am
> >> >> not very sure).
> >> >>
> >> >>
> >> >> Regards
> >> >> Sowmya.
> >> >>
> >> >> On Tue, Aug 30, 2011 at 5:14 PM, Erick Erickson <
> >> erickerick...@gmail.com>wrote:
> >> >>
> >> >>> Ahhh, see: https://issues.apache.org/jira/browse/SOLR-2637
> >> >>>
> >> >>> Short form: It's in 3.4, not 3.3.
> >> >>>
> >> >>> So, your choices are:
> >> >>> 1> parse the XML yourself
> >> >>> 2> get a current 3x build (as in one of the nightlys) and use SolrJ
> >> there.
> >> >>>
> >> >>> Best
> >> >>> Erick
> >> >>>
> >> >>> On Tue, Aug 30, 2011 at 11:09 AM, Sowmya V.B. 
> >> wrote:
> >> >>> > Hi Erick
> >> >>> >
> >> >>> > Yes, I did see the XML format. But, I did not understand how to
> read
> >> the
> >> >>> > response using SolrJ.
> >> >>> >
> >> >>> > I found some information about Collapse Component on googling,
> which
> >> >>> looks
> >> >>> > like a normal Solr XML results format.
> >> >>> >
> >> >>>
> >>
> http://blog.jteam.nl/2009/10/20/result-grouping-field-collapsing-with-solr/
> >> >>> >
> >> >>> > However, this class CollapseComponent does not seem to exist in
> Solr
> >> >>> > 3.3. (org.apache.solr.handler.component.CollapseComponent)
> >> >>> > was the component mentioned in that link, which is not there in
> >> Solr3.3
> >> >>> > class files.
> >> >>> >
> >> >>> > Sowmya.
> >> >>> >
> >> >>> > On Tue, Aug 30, 2011 at 4:48 PM, Erick Erickson <
> >> erickerick...@gmail.com
> >> >>> >wrote:
> >> >>> >
> >> >>> >> Have you looked at the XML (or JSON) response format?
> >> >>> >> You're right, it is different and you have to parse it
> >> >>> >> differently, there are move levels. Try this query
> >> >>> >> and you'll see the format (default data set).
> >> >>> >>
> >> >>> >>
> >> http://localhost:8983/solr/select?q=*:*&group=on&group.field=manu_exact
> >> >>> >>
> >> >>> >>
> >> >>> >> Best
> >> >>> >> Erick
> >> >>> >>
> >> >>> >> On Tue, Aug 30, 2011 at 9:25 AM, Sowmya V.B.  >
> >> >>> wrote:
> >> >>> >> > Hi All
> >> >>> >> >
> >> >>> >> > I am trying to use FieldCollapsing feature in Solr. On the Solr
> >> admin
> >> >>> >> > interface, I give "...&group=true&group.field=fieldA" and I can
> >> see
> >> >>> >> grouped
> >> >>> >> > results.
> >> >>> >> > But, I am not able to figure out how to read those results in
> that
> >> >>> order
> >> >>> >> on
> >> >>> >> > java.
> >> >>> >> >
> >> >>> >> > Something like: SolrDocumentList docli

Re: Reading results from FieldCollapsing

[Erick Erickson]

I think it's
getGroupResponse, not
getGroupedResponse

I was looking at source I just got this morning...

Best
Erick

On Wed, Sep 7, 2011 at 3:32 AM, Sowmya V.B.  wrote:
> Hi Martjin
>
> Sorry for a late response.
>
> I did take the latest Solr build last week.
>
> After the new snapshot, there was a class called grouped response:
> (org.apache.solr.client.solrj.response.GroupResponse)
> But, the Solrj snapshot (apache-solr-solrj-3.4-SNAPSHOT.jar)'s QueryResponse
> class did not have a method: getGroupedResponse().
>
> Is there something I am missing?
>
> S.
>
> On Wed, Aug 31, 2011 at 2:55 PM, Martijn v Groningen <
> martijn.v.gronin...@gmail.com> wrote:
>
>> The CollapseComponent was never comitted. This class exists in the
>> SOLR-236 patches. You don't need to change the configuration in order
>> to use grouping.
>> The blog you mentioned is based on the SOLR-236 patches. The current
>> grouping in Solr 3.3 has superseded these patches.
>>
>> From Solr 3.4 (not yet released) the QueryResponse class in solrj has
>> a method getGroupResponse. Use this method to get the grouped
>> response.
>>
>> On 31 August 2011 14:10, Erick Erickson  wrote:
>> > Actually, I haven't used the new stuff yet, so I'm not entirely sure
>> either,
>> > but that sure would be the place to start. There's some historical
>> > ambiguity, Grouping started out as "Field Collapsing", and they are
>> > used interchangeably.
>> >
>> > If you go to the bug I linked to and open up the patch file, you'll
>> > see the code that implements the grouping in SolrJ, that should
>> > give you a good place to start.
>> >
>> > Best
>> > Erick
>> >
>> > On Wed, Aug 31, 2011 at 3:28 AM, Sowmya V.B.  wrote:
>> >> Hi Erick
>> >>
>> >> I downloaded the latest build from (
>> >>
>> https://builds.apache.org/job/Solr-3.x/lastSuccessfulBuild/artifact/artifacts/
>> >> )
>> >> But, I don't find the required class CollapseComponent in the src.
>> >> (org.apache.solr.handler.component.CollapseComponent).
>> >>
>> >> The SolrJ in 3.4 does seem to have something like GroupResponse,
>> >> GroupCommand classes, which might be the ones I am looking for (though I
>> am
>> >> not very sure).
>> >>
>> >>
>> >> Regards
>> >> Sowmya.
>> >>
>> >> On Tue, Aug 30, 2011 at 5:14 PM, Erick Erickson <
>> erickerick...@gmail.com>wrote:
>> >>
>> >>> Ahhh, see: https://issues.apache.org/jira/browse/SOLR-2637
>> >>>
>> >>> Short form: It's in 3.4, not 3.3.
>> >>>
>> >>> So, your choices are:
>> >>> 1> parse the XML yourself
>> >>> 2> get a current 3x build (as in one of the nightlys) and use SolrJ
>> there.
>> >>>
>> >>> Best
>> >>> Erick
>> >>>
>> >>> On Tue, Aug 30, 2011 at 11:09 AM, Sowmya V.B. 
>> wrote:
>> >>> > Hi Erick
>> >>> >
>> >>> > Yes, I did see the XML format. But, I did not understand how to read
>> the
>> >>> > response using SolrJ.
>> >>> >
>> >>> > I found some information about Collapse Component on googling, which
>> >>> looks
>> >>> > like a normal Solr XML results format.
>> >>> >
>> >>>
>> http://blog.jteam.nl/2009/10/20/result-grouping-field-collapsing-with-solr/
>> >>> >
>> >>> > However, this class CollapseComponent does not seem to exist in Solr
>> >>> > 3.3. (org.apache.solr.handler.component.CollapseComponent)
>> >>> > was the component mentioned in that link, which is not there in
>> Solr3.3
>> >>> > class files.
>> >>> >
>> >>> > Sowmya.
>> >>> >
>> >>> > On Tue, Aug 30, 2011 at 4:48 PM, Erick Erickson <
>> erickerick...@gmail.com
>> >>> >wrote:
>> >>> >
>> >>> >> Have you looked at the XML (or JSON) response format?
>> >>> >> You're right, it is different and you have to parse it
>> >>> >> differently, there are move levels. Try this query
>> >>> >> and you'll see the format (default data set).
>> >>> >>
>> >>> >>
>> http://localhost:8983/solr/select?q=*:*&group=on&group.field=manu_exact
>> >>> >>
>> >>> >>
>> >>> >> Best
>> >>> >> Erick
>> >>> >>
>> >>> >> On Tue, Aug 30, 2011 at 9:25 AM, Sowmya V.B. 
>> >>> wrote:
>> >>> >> > Hi All
>> >>> >> >
>> >>> >> > I am trying to use FieldCollapsing feature in Solr. On the Solr
>> admin
>> >>> >> > interface, I give "...&group=true&group.field=fieldA" and I can
>> see
>> >>> >> grouped
>> >>> >> > results.
>> >>> >> > But, I am not able to figure out how to read those results in that
>> >>> order
>> >>> >> on
>> >>> >> > java.
>> >>> >> >
>> >>> >> > Something like: SolrDocumentList doclist = response.getResults();
>> >>> >> > gives me a set of results, on which I iterate, and get something
>> like
>> >>> >> > doclist.get(1).getFieldValue("title") etc.
>> >>> >> >
>> >>> >> > After grouping, doing the same step throws me error (apparently,
>> >>> because
>> >>> >> the
>> >>> >> > returned xml formats are different too).
>> >>> >> >
>> >>> >> > How can I read groupValues and thereby other fieldvalues of the
>> >>> documents
>> >>> >> > inside that group?
>> >>> >> >
>> >>> >> > S.
>> >>> >> > --
>> >>> >> > Sowmya V.B.
>> >>> >> > 
>> >>> >> > Losing op

Re: logging client ip address

[Markus Jelsma]

You could configure your proxy or application to send any key/value pair not 
being using by Solr. Solr will ignore the parameter but still log it as part 
of params={}.

We use this to send various pieces of information that's being analyzed later 
together with the query information.

On Wednesday 07 September 2011 13:09:53 dan sutton wrote:
> Does anyone know how I would be able to include the client ip address
> for tomcat 6 with log4j?
> 
> Cheers,
> Dan
> 
> On Wed, Sep 7, 2011 at 11:03 AM, Shalin Shekhar Mangar
> 
>  wrote:
> > On Wed, Sep 7, 2011 at 2:56 PM, dan sutton  wrote:
> >> Hi,
> >> 
> >> We're using log4j with solr which is working fine and I'm wondering
> >> how I might be able to log the client ip address?
> >> 
> >> Has anyone else been able to do this?
> > 
> > Your application container should have an access log facility. That is
> > the best way to record client IPs. Solr does not have that capability.
> > 
> > --
> > Regards,
> > Shalin Shekhar Mangar.

-- 
Markus Jelsma - CTO - Openindex
http://www.linkedin.com/in/markus17
050-8536620 / 06-50258350

Re: Synonyms problem

[Ahmet Arslan]

Simply multi-word synonyms are recommended to use at index time. 

As explained here: 
http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.SynonymFilterFactory


--- On Wed, 9/7/11, roySolr  wrote:

> From: roySolr 
> Subject: Synonyms problem
> To: solr-user@lucene.apache.org
> Date: Wednesday, September 7, 2011, 1:46 PM
> hello,
> 
> I have some problems with synonyms. I will show some
> examples to descripe
> the problem:
> 
> Data:
> 
> High school Lissabon
> High school Barcelona
> University of applied science
> 
> When a user search for IFD i want all the results back. So
> i want to use
> this synonyms at query time:
> 
> IFD => high school lissabon, high school
> barcelona,University of applied
> science
> 
> 
> The data is stored in the field "schools".
> 
> Schools type looks like this:
> 
>     class="solr.TextField"
> positionIncrementGap="100">
>       
>      class="solr.HTMLStripCharFilterFactory"/>
>            class="solr.PatternTokenizerFactory" pattern="\s|,|-" />
>          class="solr.LowerCaseFilterFactory"/>
>       
>       
>      class="solr.HTMLStripCharFilterFactory"/>
>            class="solr.PatternTokenizerFactory" pattern="\s|,|-" />
>          class="solr.LowerCaseFilterFactory"/>
>          class="solr.SynonymFilterFactory" synonyms="synonyms.txt"
> ignoreCase="true" expand="false"/>
>       
>     
> 
> 
> AS you can see i use some pattern tokenizer which splits on
> whitespace. When
> i use the synonyms at query time the
> analytics show me this:
> 
> high           | school
> | lissabon    | science
> high           | school
> | barcelona  | 
> university   | of   
>    | applied      |
> 
> When i search for IFD i get no results. I found this in
> debugQuery:
> 
> schools:"(high high university) (school school of)
> (lissaban barcelona
> applied) (science)"
> 
> With this i see the problem: solr tries a lot of
> combinations but not the
> right one. I thought i could
> escape the whitespaces in the synonyms(High\ school\
> Lissabon). Then the
> analytics shows me better results:
> 
> High school Lissabon
> High school Barcelona
> University of applied science
> 
> Then SOLR search for "high school Lissabon" but in my index
> it is tokenized
> on whitespace, still no results.
> 
> 
> I'm stuck, can someone help me??
> 
> Thanks
> R
> 
> 
> 
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/Synonyms-problem-tp3316287p3316287.html
> Sent from the Solr - User mailing list archive at
> Nabble.com.
>

Re: logging client ip address

[dan sutton]

Does anyone know how I would be able to include the client ip address
for tomcat 6 with log4j?

Cheers,
Dan

On Wed, Sep 7, 2011 at 11:03 AM, Shalin Shekhar Mangar
 wrote:
> On Wed, Sep 7, 2011 at 2:56 PM, dan sutton  wrote:
>
>> Hi,
>>
>> We're using log4j with solr which is working fine and I'm wondering
>> how I might be able to log the client ip address?
>>
>> Has anyone else been able to do this?
>>
>
> Your application container should have an access log facility. That is the
> best way to record client IPs. Solr does not have that capability.
>
> --
> Regards,
> Shalin Shekhar Mangar.
>

Synonyms problem

[roySolr]

hello,

I have some problems with synonyms. I will show some examples to descripe
the problem:

Data:

High school Lissabon
High school Barcelona
University of applied science

When a user search for IFD i want all the results back. So i want to use
this synonyms at query time:

IFD => high school lissabon, high school barcelona,University of applied
science


The data is stored in the field "schools".

Schools type looks like this:

   
  



  
  




  



AS you can see i use some pattern tokenizer which splits on whitespace. When
i use the synonyms at query time the
analytics show me this:

high   | school | lissabon| science
high   | school | barcelona  | 
university   | of   | applied  |

When i search for IFD i get no results. I found this in debugQuery:

schools:"(high high university) (school school of) (lissaban barcelona
applied) (science)"

With this i see the problem: solr tries a lot of combinations but not the
right one. I thought i could
escape the whitespaces in the synonyms(High\ school\ Lissabon). Then the
analytics shows me better results:

High school Lissabon
High school Barcelona
University of applied science

Then SOLR search for "high school Lissabon" but in my index it is tokenized
on whitespace, still no results.


I'm stuck, can someone help me??

Thanks
R



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Synonyms-problem-tp3316287p3316287.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: please help! *:* followed by commit does not work

[Roland Tollenaar]

Hi Parvin,

Parvin Gasimzade wrote:

Use this to clear the solr server.

http://localhost:8983/solr/update?stream.body=
*:*&commit=true


Thanks, this worked first time.

Kind regards,

Roland





On Wed, Sep 7, 2011 at 10:48 AM, Roland Tollenaar wrote:


Hi All,

I want to clear the solr server and start loading documents afresh.

According to the information I found on internet I would have to do
somethign like this:

http://localhost:8983/solr/**update?commit=true&-H&Content-**
Type:&text/xml&--data-binary&
'***:*'

which in my case returns:





00




I have tried following this command up with:


http://localhost:8983/solr/**update?commit=true&-H&Content-**
Type:&text/xml&--data-binary&
'**'


and

-http://localhost:8983/solr/**update?commit=true&-H&Content-**
Type:&text/xml&--data-binary&
'**'


all of which reply with the same





00



response.

But when I run a query, all data is still returned.

I have also tried removing an entry specifically by id, exactly the same
behaviour. Record is never deleted.


Restarting the solr server after all this also does not help.


I have also tried using curl but that complains to this line:


curl http://localhost:8983/solr/**update?commit=true-H 
"Content-Type: text/xml" --data-binary '*:*
**delete>'


with:

"< was unexpected at this time."


no idea what to make of that..


I hope someone can give some advice here.

Thanks in advance.


regards,


Roland

Re: please help! *:* followed by commit does not work

[Roland Tollenaar]

curl http://localhost:8983/solr/update?commit=true -H "Content-Type:
text/xml" --data-binary '*:*'


This executed but still did not clear the data...

Thanks.

Roland



Please see http://wiki.apache.org/solr/UpdateXmlMessages .

Regards,
Gora

Re: Spellcheck

[Danicela nutch]

I just tried to start the data from scratch, I deleted Nutch segments and 
solr/data/index files, but it changed nothing. Maybe I should delete other 
elements ?

- Original Message -
From: Shalin Shekhar Mangar
Sent: 09/07/11 12:08 PM
To: solr-user@lucene.apache.org
Subject: Re: Spellcheck

 On Wed, Sep 7, 2011 at 1:52 PM, Danicela nutch wrote: 
> Hi, > > I'm trying to get search suggestions like Google 'Did you mean ?' 
with > indexed data with Solr from Nutch. > > I added this to my schema.xml : > 
>  
positionIncrementGap="100" > >  >  >  >  >  >  
> >  
multiValued="true" /> > >  > Did 
you re-index after adding the textSpell field? It sounds like you added the 
field after the index was already created therefore the building the spellcheck 
index created an empty index. -- Regards, Shalin Shekhar Mangar.

Re: maximum rows for dataimport using solrj

[Shalin Shekhar Mangar]

On Wed, Sep 7, 2011 at 1:45 PM, Tobias Rübner  wrote:

> Hi,
>
> I want to trigger the data import handler remotly using the solrj api.
> So I added a dih request handler to my solr config and tried to call the
> handler as described here
> http://wiki.apache.org/solr/SolJava
>
> ModifiableSolrParams params = new ModifiableSolrParams();
> params.set("qt", "/dataimport");
> params.set("command", "full-import");
> params.set("commit", "true");
> params.set("debug", "true");
>
> solrServer.query(params);
>
>
> That worked fine, but it only added the first 10 rows.
> So I added a rows param
> params.set("rows", 5000);
>
> which only allows 50M as maximum value.
>
> Having databases with more records, this wouldn't index all entries.
>
> Do you hav any suggestions how to change this?
>
>
You are sending debug=true as a request parameter. The debug mode limits the
number of rows to 10 by default and it also forces indexing to be
synchronous with the request.

Just remove debug=true from the params and DIH will index all entries.

-- 
Regards,
Shalin Shekhar Mangar.

Re: Spellcheck

[Shalin Shekhar Mangar]

On Wed, Sep 7, 2011 at 1:52 PM, Danicela nutch wrote:

> Hi,
>
>  I'm trying to get search suggestions like Google 'Did you mean ?' with
> indexed data with Solr from Nutch.
>
>  I added this to my schema.xml :
>
>   positionIncrementGap="100" >
>  
>  
>  
>  
>  
>  
>
>   multiValued="true" />
>
>  
>

Did you re-index after adding the textSpell field? It sounds like you added
the field after the index was already created therefore the building the
spellcheck index created an empty index.

-- 
Regards,
Shalin Shekhar Mangar.

Re: logging client ip address

[Shalin Shekhar Mangar]

On Wed, Sep 7, 2011 at 2:56 PM, dan sutton  wrote:

> Hi,
>
> We're using log4j with solr which is working fine and I'm wondering
> how I might be able to log the client ip address?
>
> Has anyone else been able to do this?
>

Your application container should have an access log facility. That is the
best way to record client IPs. Solr does not have that capability.

-- 
Regards,
Shalin Shekhar Mangar.

Re: Solr 1.4.1: problems with replication and index operation both at the same time.

[Luis Cappa Banda]

Excuse me, I mean an Apache Tomcat 6.

Re: Solr 1.4.1: problems with replication and index operation both at the same time.

[Luis Cappa Banda]

Hello, Erik.

Thank you for answering again. I'm using Java JDK 1.5 and an Apache Tomcat
1.6 configuring it's memory parameters from 1G to 2G maximum for each Tomcat
server. The machine has a RAID5 HDD, 32G RAM and eight cores, and I have six
Tomcat launched with their process running at the same time. However, I
think that the computer is enough powerful to handle the workload. Well, at
least I thought that... Finally, I'm optimizing the index one time per two
nights, but no indexing is in process, because I've got an Active MQ queue
that queues petitions while optimization is in progresss and then index
them. The alternatives that I think that could solve the problem are:

1. Updating Solr version and check the behaviour. I think that the latest
versions have replication improvements.
2. Control (right now I don't know how) the replication and index operations
so that I'll activate replication in slaves queueing new petitions (the no
index will be in progress) and then re-activate it after replication. It's a
bit complicated, but posible.

Any alternative would be welcome, :-)

Thank you for your help.

logging client ip address

[dan sutton]

Hi,

We're using log4j with solr which is working fine and I'm wondering
how I might be able to log the client ip address?

Has anyone else been able to do this?

Cheers,
Dan

Spellcheck

[Danicela nutch]

Hi,

 I'm trying to get search suggestions like Google 'Did you mean ?' with indexed 
data with Solr from Nutch.

 I added this to my schema.xml :

 
 
 
 
 
 
 

 

 

 ---

 I added this to my solrconfig.xml :

 

 textSpell

 
 solr.IndexBasedSpellChecker
 textSpell
 textSpell
 ./spellcheckerDefault
 
 

 I modified this :

 
 
 explicit

 true
 textSpell
 false
 true
 true
 5

 

 
 spellcheck
 
 

 ---

 The first time, I put a spellcheck.build=true in the request, the index was 
modified, but has only 20 bytes. (I think that's strange for 7000 indexed pages)

 This request : http://localhost:8983/solr/select/?q=nytames

 returns that :

 −
 
 −
 
 0
 33
 −
 
 nytames
 
 
 
 −
 
 −
 
 false
 
 
 

 I tried with spellcheck=true but it doesn't change nothing.

 I should get some suggestions in the 

maximum rows for dataimport using solrj

[Tobias Rübner]

Hi,

I want to trigger the data import handler remotly using the solrj api.
So I added a dih request handler to my solr config and tried to call the
handler as described here
http://wiki.apache.org/solr/SolJava

ModifiableSolrParams params = new ModifiableSolrParams();
params.set("qt", "/dataimport");
params.set("command", "full-import");
params.set("commit", "true");
params.set("debug", "true");

solrServer.query(params);


That worked fine, but it only added the first 10 rows.
So I added a rows param
params.set("rows", 5000);

which only allows 50M as maximum value.

Having databases with more records, this wouldn't index all entries.

Do you hav any suggestions how to change this?

Thanks,
tob

Re: please help! *:* followed by commit does not work

[Parvin Gasimzade]

Use this to clear the solr server.

http://localhost:8983/solr/update?stream.body=
*:*&commit=true


On Wed, Sep 7, 2011 at 10:48 AM, Roland Tollenaar wrote:

> Hi All,
>
> I want to clear the solr server and start loading documents afresh.
>
> According to the information I found on internet I would have to do
> somethign like this:
>
> http://localhost:8983/solr/**update?commit=true&-H&Content-**
> Type:&text/xml&--data-binary&
> '***:*'
>
> which in my case returns:
>
> 
>
> 
>
> 0 name=QTime>0
>
> 
>
>
> I have tried following this command up with:
>
>
> http://localhost:8983/solr/**update?commit=true&-H&Content-**
> Type:&text/xml&--data-binary&
> '**'
>
>
> and
>
> -http://localhost:8983/solr/**update?commit=true&-H&Content-**
> Type:&text/xml&--data-binary&
> '**'
>
>
> all of which reply with the same
>
> 
>
> 
>
> 0 name=QTime>0
>
> 
>
> response.
>
> But when I run a query, all data is still returned.
>
> I have also tried removing an entry specifically by id, exactly the same
> behaviour. Record is never deleted.
>
>
> Restarting the solr server after all this also does not help.
>
>
> I have also tried using curl but that complains to this line:
>
> >curl 
> >http://localhost:8983/solr/**update?commit=true-H
> > "Content-Type: text/xml" --data-binary '*:* **delete>'
>
>
> with:
>
> "< was unexpected at this time."
>
>
> no idea what to make of that..
>
>
> I hope someone can give some advice here.
>
> Thanks in advance.
>
>
> regards,
>
>
> Roland
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>

Re: please help! *:* followed by commit does not work

[Gora Mohanty]

On Wed, Sep 7, 2011 at 1:18 PM, Roland Tollenaar  wrote:
> Hi All,
>
> I want to clear the solr server and start loading documents afresh.
>
> According to the information I found on internet I would have to do
> somethign like this:
>
> http://localhost:8983/solr/update?commit=true&-H&Content-Type:&text/xml&--data-binary&;'*:*'
[...]

Are you loading that URL directly in the browser? That won't work.
You will need to use something like curl. Thus,

curl http://localhost:8983/solr/update?commit=true -H "Content-Type:
text/xml" --data-binary '*:*'

Please see http://wiki.apache.org/solr/UpdateXmlMessages .

Regards,
Gora

please help! *:* followed by commit does not work

[Roland Tollenaar]

Hi All,

I want to clear the solr server and start loading documents afresh.

According to the information I found on internet I would have to do 
somethign like this:


http://localhost:8983/solr/update?commit=true&-H&Content-Type:&text/xml&--data-binary&;'*:*'

which in my case returns:





0name=QTime>0





I have tried following this command up with:


http://localhost:8983/solr/update?commit=true&-H&Content-Type:&text/xml&--data-binary&;''


and

-http://localhost:8983/solr/update?commit=true&-H&Content-Type:&text/xml&--data-binary&;''


all of which reply with the same





0name=QTime>0




response.

But when I run a query, all data is still returned.

I have also tried removing an entry specifically by id, exactly the same 
behaviour. Record is never deleted.



Restarting the solr server after all this also does not help.


I have also tried using curl but that complains to this line:

>curl http://localhost:8983/solr/update?commit=true -H "Content-Type: 
text/xml" --data-binary '*:*'



with:

"< was unexpected at this time."


no idea what to make of that..


I hope someone can give some advice here.

Thanks in advance.


regards,


Roland

Re: Reading results from FieldCollapsing

[Sowmya V.B.]

Hi Martjin

Sorry for a late response.

I did take the latest Solr build last week.

After the new snapshot, there was a class called grouped response:
(org.apache.solr.client.solrj.response.GroupResponse)
But, the Solrj snapshot (apache-solr-solrj-3.4-SNAPSHOT.jar)'s QueryResponse
class did not have a method: getGroupedResponse().

Is there something I am missing?

S.

On Wed, Aug 31, 2011 at 2:55 PM, Martijn v Groningen <
martijn.v.gronin...@gmail.com> wrote:

> The CollapseComponent was never comitted. This class exists in the
> SOLR-236 patches. You don't need to change the configuration in order
> to use grouping.
> The blog you mentioned is based on the SOLR-236 patches. The current
> grouping in Solr 3.3 has superseded these patches.
>
> From Solr 3.4 (not yet released) the QueryResponse class in solrj has
> a method getGroupResponse. Use this method to get the grouped
> response.
>
> On 31 August 2011 14:10, Erick Erickson  wrote:
> > Actually, I haven't used the new stuff yet, so I'm not entirely sure
> either,
> > but that sure would be the place to start. There's some historical
> > ambiguity, Grouping started out as "Field Collapsing", and they are
> > used interchangeably.
> >
> > If you go to the bug I linked to and open up the patch file, you'll
> > see the code that implements the grouping in SolrJ, that should
> > give you a good place to start.
> >
> > Best
> > Erick
> >
> > On Wed, Aug 31, 2011 at 3:28 AM, Sowmya V.B.  wrote:
> >> Hi Erick
> >>
> >> I downloaded the latest build from (
> >>
> https://builds.apache.org/job/Solr-3.x/lastSuccessfulBuild/artifact/artifacts/
> >> )
> >> But, I don't find the required class CollapseComponent in the src.
> >> (org.apache.solr.handler.component.CollapseComponent).
> >>
> >> The SolrJ in 3.4 does seem to have something like GroupResponse,
> >> GroupCommand classes, which might be the ones I am looking for (though I
> am
> >> not very sure).
> >>
> >>
> >> Regards
> >> Sowmya.
> >>
> >> On Tue, Aug 30, 2011 at 5:14 PM, Erick Erickson <
> erickerick...@gmail.com>wrote:
> >>
> >>> Ahhh, see: https://issues.apache.org/jira/browse/SOLR-2637
> >>>
> >>> Short form: It's in 3.4, not 3.3.
> >>>
> >>> So, your choices are:
> >>> 1> parse the XML yourself
> >>> 2> get a current 3x build (as in one of the nightlys) and use SolrJ
> there.
> >>>
> >>> Best
> >>> Erick
> >>>
> >>> On Tue, Aug 30, 2011 at 11:09 AM, Sowmya V.B. 
> wrote:
> >>> > Hi Erick
> >>> >
> >>> > Yes, I did see the XML format. But, I did not understand how to read
> the
> >>> > response using SolrJ.
> >>> >
> >>> > I found some information about Collapse Component on googling, which
> >>> looks
> >>> > like a normal Solr XML results format.
> >>> >
> >>>
> http://blog.jteam.nl/2009/10/20/result-grouping-field-collapsing-with-solr/
> >>> >
> >>> > However, this class CollapseComponent does not seem to exist in Solr
> >>> > 3.3. (org.apache.solr.handler.component.CollapseComponent)
> >>> > was the component mentioned in that link, which is not there in
> Solr3.3
> >>> > class files.
> >>> >
> >>> > Sowmya.
> >>> >
> >>> > On Tue, Aug 30, 2011 at 4:48 PM, Erick Erickson <
> erickerick...@gmail.com
> >>> >wrote:
> >>> >
> >>> >> Have you looked at the XML (or JSON) response format?
> >>> >> You're right, it is different and you have to parse it
> >>> >> differently, there are move levels. Try this query
> >>> >> and you'll see the format (default data set).
> >>> >>
> >>> >>
> http://localhost:8983/solr/select?q=*:*&group=on&group.field=manu_exact
> >>> >>
> >>> >>
> >>> >> Best
> >>> >> Erick
> >>> >>
> >>> >> On Tue, Aug 30, 2011 at 9:25 AM, Sowmya V.B. 
> >>> wrote:
> >>> >> > Hi All
> >>> >> >
> >>> >> > I am trying to use FieldCollapsing feature in Solr. On the Solr
> admin
> >>> >> > interface, I give "...&group=true&group.field=fieldA" and I can
> see
> >>> >> grouped
> >>> >> > results.
> >>> >> > But, I am not able to figure out how to read those results in that
> >>> order
> >>> >> on
> >>> >> > java.
> >>> >> >
> >>> >> > Something like: SolrDocumentList doclist = response.getResults();
> >>> >> > gives me a set of results, on which I iterate, and get something
> like
> >>> >> > doclist.get(1).getFieldValue("title") etc.
> >>> >> >
> >>> >> > After grouping, doing the same step throws me error (apparently,
> >>> because
> >>> >> the
> >>> >> > returned xml formats are different too).
> >>> >> >
> >>> >> > How can I read groupValues and thereby other fieldvalues of the
> >>> documents
> >>> >> > inside that group?
> >>> >> >
> >>> >> > S.
> >>> >> > --
> >>> >> > Sowmya V.B.
> >>> >> > 
> >>> >> > Losing optimism is blasphemy!
> >>> >> > http://vbsowmya.wordpress.com
> >>> >> > 
> >>> >> >
> >>> >>
> >>> >
> >>> >
> >>> >
> >>> > --
> >>> > Sowmya V.B.
> >>> > 
> >>> > Losing optimism is blasphemy!
> >>> > http://vbsowmya.wordpre