Re: Refresh synonyms.txt file via replication

2009-06-09 Thread mlathe


Shalin Shekhar Mangar wrote:
 
 Second Question:
 If i force an empty commit, like this:
 curl
 http://localhost:8080/solr_rep_master/core/update?stream.body=%3Ccommit/%3E
 Then the changed synonym.txt config file are replicated to the slave.
 Unfortunately now I need to do a core RELOAD on both the master and
 slave
 to get them to see the updated synonym.txt file.

 Calling RELOAD on slave should not be necessary. If a configuration file
 is
 replicated, the slave is always reloaded. Can you try using the
 analysis.txt
 on a field which has the SynonymFilterFactory enabled to see if the new
 file
 is indeed not getting used?
 

I'm a bit confused now. It's not doing what i saw before.
Now I can't get it to replicate when i do an empty commit. Rather I need
to do a real data update, and a commit, then any changes to the
solr_rep_master's conf/synonyms.txt file get replicated to the slave, and
the slave seems to pick up the change without reloading.

I'm not really sure what you mean by the analysis.txt file. Do you mean the
/analysis request handler? I've been making synonyms for solr so it is
pretty obvious if it was picked up.

Can you explain what you expect should happen? ie
1) should the slave replicate when you do an empty commit on the master?
2) If you change a master config file, and it is replicated to the slave,
would you expect the slave to pick it up automatically, but the master will
require a reload?

Thanks
--Matthias
-- 
View this message in context: 
http://www.nabble.com/Refresh-synonyms.txt-file-via-replication-tp23789187p23951978.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: Refresh synonyms.txt file via replication

2009-06-09 Thread Noble Paul നോബിള്‍ नोब्ळ्
Hi ,
Unfortunately , the problem is that an 'empty' commit does not really
do anything. I mean, it is not a real commit.Solr takes a look to find
if the index is changed and if not, the call is ignored

When we designed it, the choice was to look for all the changed conf
files also to decide if a replication is required or not . That proved
to be expensive and error prone. so we relied on index change to
trigger this.


take the case of schema.xml change . schema.xml is changed first and
then indexing is done . If the schema.xml is replicated and slave core
is reloaded , it will cause error.

you can raise an issue and we can find out a better way to do this.

--Noble




On Wed, Jun 10, 2009 at 3:23 AM, mlathemla...@gmail.com wrote:


 Shalin Shekhar Mangar wrote:

 Second Question:
 If i force an empty commit, like this:
 curl
 http://localhost:8080/solr_rep_master/core/update?stream.body=%3Ccommit/%3E
 Then the changed synonym.txt config file are replicated to the slave.
 Unfortunately now I need to do a core RELOAD on both the master and
 slave
 to get them to see the updated synonym.txt file.

 Calling RELOAD on slave should not be necessary. If a configuration file
 is
 replicated, the slave is always reloaded. Can you try using the
 analysis.txt
 on a field which has the SynonymFilterFactory enabled to see if the new
 file
 is indeed not getting used?


 I'm a bit confused now. It's not doing what i saw before.
 Now I can't get it to replicate when i do an empty commit. Rather I need
 to do a real data update, and a commit, then any changes to the
 solr_rep_master's conf/synonyms.txt file get replicated to the slave, and
 the slave seems to pick up the change without reloading.

 I'm not really sure what you mean by the analysis.txt file. Do you mean the
 /analysis request handler? I've been making synonyms for solr so it is
 pretty obvious if it was picked up.

 Can you explain what you expect should happen? ie
 1) should the slave replicate when you do an empty commit on the master?
 2) If you change a master config file, and it is replicated to the slave,
 would you expect the slave to pick it up automatically, but the master will
 require a reload?

 Thanks
 --Matthias
 --
 View this message in context: 
 http://www.nabble.com/Refresh-synonyms.txt-file-via-replication-tp23789187p23951978.html
 Sent from the Solr - User mailing list archive at Nabble.com.





-- 
-
Noble Paul | Principal Engineer| AOL | http://aol.com


Re: Refresh synonyms.txt file via replication

2009-06-06 Thread Shalin Shekhar Mangar
On Sat, May 30, 2009 at 6:45 AM, mlathe mla...@gmail.com wrote:


 I would like to provide an admin interface (in a different system) that
 would update the synonyms.txt file and automatically inform a set of Solr
 instances that are being replicated to update their synonyms.txt file too.

 This discussion shows a possible solution:

 http://www.nabble.com/Refresh-of-synonyms.txt-without-reload-td19629361.html
 Namely use the CoreAdmin system to do a RELOAD, rather than forcing tomcat
 to reload the webapp.

 Here is my setup:
 1) I made these instances (both are separate webapps running one core named
 core, this allows me to use the CoreAdmin):
 http://localhost:8080/solr_rep_master/core/admin/
 http://localhost:8080/solr_rep_slave1/core/admin/
 2) the master's config looks like this:
lst name=master
str name=replicateAfterstartup/str
str name=replicateAftercommit/str
str name=snapshotstartup/str
str name=snapshotcommit/str
str name=confFilesschema.xml,stopwords.txt,synonyms.txt/str
/lst
 3) the slave's config looks like this:
lst name=slave
str
 name=masterUrlhttp://localhost:8080/solr_rep_master/core/replication
 /str
str name=pollInterval00:00:20/str
str name=compressioninternal/str
/lst

 First Question:
 If i update the solr_rep_master's conf/synonyms.txt file and GET
 http://localhost:8080/solr_rep_master/admin/cores?action=RELOADcore=core,
 the config is not replicated to the slave. Isn't a RELOAD considered a
 startup in regards to the master's replicateAfter setting?


Yes, it is. Let me run a few tests to see if I can reproduce this.


 Second Question:
 If i force an empty commit, like this:
 curl
 http://localhost:8080/solr_rep_master/core/update?stream.body=%3Ccommit/%3E
 Then the changed synonym.txt config file are replicated to the slave.
 Unfortunately now I need to do a core RELOAD on both the master and slave
 to get them to see the updated synonym.txt file.


Calling RELOAD on slave should not be necessary. If a configuration file is
replicated, the slave is always reloaded. Can you try using the analysis.txt
on a field which has the SynonymFilterFactory enabled to see if the new file
is indeed not getting used?

-- 
Regards,
Shalin Shekhar Mangar.


Refresh synonyms.txt file via replication

2009-05-29 Thread mlathe

Hi All,
I would like to provide an admin interface (in a different system) that
would update the synonyms.txt file and automatically inform a set of Solr
instances that are being replicated to update their synonyms.txt file too.

This discussion shows a possible solution:
http://www.nabble.com/Refresh-of-synonyms.txt-without-reload-td19629361.html
Namely use the CoreAdmin system to do a RELOAD, rather than forcing tomcat
to reload the webapp.

Here is my setup:
1) I made these instances (both are separate webapps running one core named
core, this allows me to use the CoreAdmin):
http://localhost:8080/solr_rep_master/core/admin/
http://localhost:8080/solr_rep_slave1/core/admin/
2) the master's config looks like this:
lst name=master
str name=replicateAfterstartup/str
str name=replicateAftercommit/str
str name=snapshotstartup/str
str name=snapshotcommit/str
str name=confFilesschema.xml,stopwords.txt,synonyms.txt/str
/lst
3) the slave's config looks like this:
lst name=slave
str
name=masterUrlhttp://localhost:8080/solr_rep_master/core/replication/str
str name=pollInterval00:00:20/str  
str name=compressioninternal/str
/lst

First Question:
If i update the solr_rep_master's conf/synonyms.txt file and GET
http://localhost:8080/solr_rep_master/admin/cores?action=RELOADcore=core,
the config is not replicated to the slave. Isn't a RELOAD considered a
startup in regards to the master's replicateAfter setting?

Second Question:
If i force an empty commit, like this:
curl
http://localhost:8080/solr_rep_master/core/update?stream.body=%3Ccommit/%3E
Then the changed synonym.txt config file are replicated to the slave.
Unfortunately now I need to do a core RELOAD on both the master and slave
to get them to see the updated synonym.txt file. 
Is there any way to circumvent this reload? (this is what was effectively
asked in the nabble link at the top)

Thanks
--Matthias
-- 
View this message in context: 
http://www.nabble.com/Refresh-synonyms.txt-file-via-replication-tp23789187p23789187.html
Sent from the Solr - User mailing list archive at Nabble.com.