[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584892#comment-13584892
]
Commit Tag Bot commented on SOLR-4471:
--
[branch_4x commit] Mark Robert Miller
http://svn.apache.org/viewvc?view=revision&revision=1449259
SOLR-4471: Fix up test.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_TestRefactor.diff, SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584887#comment-13584887
]
Commit Tag Bot commented on SOLR-4471:
--
[trunk commit] Mark Robert Miller
http://svn.apache.org/viewvc?view=revision&revision=1449258
SOLR-4471: Fix up test.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_TestRefactor.diff, SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584768#comment-13584768
]
Commit Tag Bot commented on SOLR-4471:
--
[branch_4x commit] Mark Robert Miller
http://svn.apache.org/viewvc?view=revision&revision=1449241
SOLR-4471: Improve and clean up TestReplicationHandler.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_TestRefactor.diff, SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584763#comment-13584763
]
Commit Tag Bot commented on SOLR-4471:
--
[trunk commit] Mark Robert Miller
http://svn.apache.org/viewvc?view=revision&revision=1449240
SOLR-4471: Improve and clean up TestReplicationHandler.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_TestRefactor.diff, SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584726#comment-13584726
]
Helder Sepulveda commented on SOLR-4471:
I just tested the .war in the solr-4.2-SNAPSHOT.tgz and replication is working
as intended!
Thanks a bunch
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_TestRefactor.diff, SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584719#comment-13584719
]
Shikhar Bhushan commented on SOLR-4471:
---
We ran into the same issue with full copies happening with each incremental.
Patch works! Thank you.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_TestRefactor.diff, SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584528#comment-13584528
]
Mark Miller commented on SOLR-4471:
---
bq. but didn't realize it was for other bugs.
I did SOLR-4484 because it was causing me problems with the test so had to be
fixed for this fix.
I did SOLR-4488 because I used it as part of the new testing.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_TestRefactor.diff, SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584524#comment-13584524
]
Mark Miller commented on SOLR-4471:
---
Thanks, I'll commit this shortly.
bq. I'd rather have a slower clean test class than a dirtier fast one
It depends on the time difference I think.
In this case, it doesn't look like a problem. I'm not sure what the original
motivation to have them together was.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_TestRefactor.diff, SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584470#comment-13584470
]
Mark Miller commented on SOLR-4471:
---
I've put up an intermediate build of the current 4X branch at
http://people.apache.org/~markrmiller/solr-4.2-SNAPSHOT.tgz that includes the
current fixes.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584440#comment-13584440
]
Commit Tag Bot commented on SOLR-4471:
--
[branch_4x commit] Mark Robert Miller
http://svn.apache.org/viewvc?view=revision&revision=1449117
SOLR-4471: Replication occurs even when a slave is already up to date.
SOLR-4484: ReplicationHandler#loadReplicationProperties still uses Files rather
than the Directory to try and read the replication properties files.
SOLR-4488: Return slave replication details for a master if the master has also
acted like a slave.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584432#comment-13584432
]
Commit Tag Bot commented on SOLR-4471:
--
[trunk commit] Mark Robert Miller
http://svn.apache.org/viewvc?view=revision&revision=1449115
SOLR-4471: Replication occurs even when a slave is already up to date.
SOLR-4484: ReplicationHandler#loadReplicationProperties still uses Files rather
than the Directory to try and read the replication properties files.
SOLR-4488: Return slave replication details for a master if the master has also
acted like a slave.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584408#comment-13584408
]
Helder Sepulveda commented on SOLR-4471:
Andre if you already have a .war file, I would appreciate it very much if you
can upload it somewhere, it will save me a lot of troubles
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584397#comment-13584397
]
Helder Sepulveda commented on SOLR-4471:
I think I will have to start by installing SVN and ANT...
My servers are VM clones of production servers, they have the bare minimum to
run solr, no extra bells and whistles.
Anything else I might need?
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584390#comment-13584390
]
Andre Charton commented on SOLR-4471:
-
For me patch looks good, together with 4413 replication in solr 4.x is working.
Thanks for that ( especially from network team, because angry about heavy
network usage during replications)!
@Helder try:
{noformat:title=build script to apply patches in solr, copy content in build.sh
an run - may it works for you}
mkdir patches
cd patches
wget https://issues.apache.org/jira/secure/attachment/12570408/SOLR-4471.patch
wget https://issues.apache.org/jira/secure/attachment/12569673/SOLR-4413.patch
cd ..
mkdir work
cd work
svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
cd lucene_solr_4_1
patch -p0 < ../../patches/SOLR-4413.patch
patch -p0 < ../../patches/SOLR-4471.patch
cd solr
ant dist
{noformat}
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584328#comment-13584328
]
Helder Sepulveda commented on SOLR-4471:
Once you commit, Can you generate a .war file?
I would like to test it on the servers
Solr 4.1 reduced my index size by more than 50%, Me so happy!
But this problem with the replication is a show stopper.
Let me know if there is anything I can do to help.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584325#comment-13584325
]
Mark Miller commented on SOLR-4471:
---
I think I'm about ready to commit what I have. I think it fixes the glaring
issues and has some improved tests. Then it will be easier to build on top of
that if needed.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584289#comment-13584289
]
Mark Miller commented on SOLR-4471:
---
No, the commit was not to single new data - see the comment - it was mainly
about fixing an issue when restarting the writer.
At one point, it may have also been what triggered a new searcher, but we have
done that explicitly instead for a while now.
getIndexDir and getNewIndexDir are kind of complicated. getNewIndexDir should
always be safe to use, but it does this extra step of reading a properties file
sometimes. Technically, it's mainly supposed to be critical to use
getNewIndexDir when making new writers and searchers - i sometimes use it
elsewhere in replication to be sure any kind of race is not an issue.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584064#comment-13584064
]
Amit Nithian commented on SOLR-4471:
Sorry I'm trying to read the patch and perhaps I'm missing something but where
is the commit that I thought was needed to signal new data? If that's not
needed can you explain why just for my understanding?
Also why is there such a distinction between getIndexDir and getNewIndexDir and
why can't all calls route through one? It's a bit confusing to me at the moment.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch, SOLR-4471.patch,
> SOLR-4471_Tests.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583807#comment-13583807
]
Mark Miller commented on SOLR-4471:
---
One thing that does seem to mess things up is precommit. I'm not sure that's
the most useful feature at the moment anyway, but avoid it in your testing :)
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583803#comment-13583803
]
Mark Miller commented on SOLR-4471:
---
I think that patch may solve things for you. It at least fixes some things.
Next I want to write more tests or try and think of what is not currently being
tested. If you can break that patch, that would help as I can then add that
test and fix it.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583801#comment-13583801
]
Amit Nithian commented on SOLR-4471:
Mark, do you have any details you can provide about the underlying issue that
you are trying to resolve in case there is something we can do to help?
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583796#comment-13583796
]
Mark Miller commented on SOLR-4471:
---
Amit: I think that's a fine change - I'd only check if it affects the overall
test time much.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch, SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583748#comment-13583748
]
Amit Nithian commented on SOLR-4471:
It's in the TestReplicationHandler.java file.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583742#comment-13583742
]
Andre Charton commented on SOLR-4471:
-
Sorry for the spam - but which test method - can't find any related to the
SnapPuller on trunk. But may is better to have no test method than the one with
10 aspects.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583717#comment-13583717
]
Amit Nithian commented on SOLR-4471:
:-) So I tried to create a @BeforeClass and @AfterClass annotation to keep the
server static.. now I just moved them to setup and teardown so each test
creates and destroys jetty instances. I hate single methods that test 10 things
so I hope that others agree.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583710#comment-13583710
]
Mark Miller commented on SOLR-4471:
---
Your guess is as good as mine - someone else originally wrote these. I think it
tries to make order not matter, I don't know how successful it is. I generally
just comment out the methods I'm not currently working with.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583707#comment-13583707
]
Amit Nithian commented on SOLR-4471:
One question in the unit tests, I noticed that it's one method test() which I
am trying to break out into multiple unit test methods but was wondering if
there is an order to the private test method invocations that caused this one
single test() method.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583685#comment-13583685
]
Mark Miller commented on SOLR-4471:
---
In the test i was building on, pre commit was screwing with things. I've taken
that out for now and am making some progress.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583631#comment-13583631
]
Mark Miller commented on SOLR-4471:
---
Or it was at one point - once we have some more thorough testing and some more
fixes, we will have to see how that turns out.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583629#comment-13583629
]
Mark Miller commented on SOLR-4471:
---
bq. why this comment "// update our commit point to the right dir"
It's needed when you switch Directory's.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583621#comment-13583621
]
Andre Charton commented on SOLR-4471:
-
@Amit: First thought was version, but it was because setup was to small. Now I
see it's stale b/c file exits and size is diff (-> segment file).
@Mark: why this comment "// update our commit point to the right dir" - how we
mark replicated index as ready for search?
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583603#comment-13583603
]
Mark Miller commented on SOLR-4471:
---
bq. Somebody agree?
It's kind of a workaround, but there is more to this. I've already advanced a
bit beyond this though - I'm not using a soft commit, I'm just not doing that
commit unless isFullCopyNeeded. I'm running into an issue with the version
though. Somehow, after the replication happens, the commit timestamp we store
is not getting set to the value of the index we replicated in - it's like it's
stale.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583599#comment-13583599
]
Amit Nithian commented on SOLR-4471:
When your replication is downloading the full index what is the value of the
isFullCopyNeeded variable? Are you getting a full copy b/c the variable value
is true or b/c the index is "stale"?
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583594#comment-13583594
]
Andre Charton commented on SOLR-4471:
-
One shot: I tried to set commit after replication as soft commit and it works
for me:
{code:title=SnapPuller line 622 ff}
// update our commit point to the right dir
CommitUpdateCommand cuc = new CommitUpdateCommand(req, false);
...
cuc.softCommit = true; // use soft commit here, so on commit no new
segment info are generated - on slave.
...
{code}
Now slave didn't generate new segment file, also index version looks fine.
Somebody agree?
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583567#comment-13583567
]
Helder Sepulveda commented on SOLR-4471:
I also tested this:
Upgraded servers to the latest n-Build
- Do a commit on the Master
- The Slave seems replicate only what it needs (correct way)
- Next replication cycle comes and slave will download entire index
First I noticed this behavior when clicking two times on the *replicate now*
button
but I changed my pollInterval to 30 seconds and the problem is more evident.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583528#comment-13583528
]
Andre Charton commented on SOLR-4471:
-
Today after debugging in a bigger environment I found slave marked the index as
stale (method isStale() in SnapPuller). This is because segment the file, which
comes from master and is different in size than the file on slave. This only
happens if there are enough data and also 'delta-date'. With few data file
looks same (exists + same size).
So again: problem is that slave generates this segment file after replication
(and also a new version). In the end the version number is may a "subproblem"
of this new segment file. I'm note sure how lucene work, but that looks for me
as the general problem.
I also checked solr 3.6.1, the version is same. Also 3.6 didn't create index
dir with time stamp (eg. index.12345) and segment files are same slave <->
master.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583468#comment-13583468
]
Mark Miller commented on SOLR-4471:
---
I'm working on some improved tests in this area, but I'd appreciate any help or
additional test work. We can't have too many for this stuff.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583465#comment-13583465
]
Amit Nithian commented on SOLR-4471:
I'll work on the test if no one else is. I think I see that my slave_gen >
master_gen+1 is not needed but simply slave_gen > mater. I'll see if I can put
some tests around it and re-submit a patch soon.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
>Assignee: Mark Miller
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4471) slave index version is different form master (full index copy needed)
[
https://issues.apache.org/jira/browse/SOLR-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583217#comment-13583217
]
Mark Miller commented on SOLR-4471:
---
Looks like we need a test for this.
> slave index version is different form master (full index copy needed)
> -
>
> Key: SOLR-4471
> URL: https://issues.apache.org/jira/browse/SOLR-4471
> Project: Solr
> Issue Type: Bug
> Components: replication (java)
>Affects Versions: 4.1
>Reporter: Andre Charton
> Labels: master, replication, slave, version
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4471.patch
>
>
> Scenario: master/slave replication, master delta index runs every 10 minutes,
> slave poll interval is 10 sec.
> There was an issue SOLR-4413 - slave reads index from wrong directory, so
> slave is full copy index from master every time, which is fixed after
> applying this patch from 4413 (see script below).
> Now on replication the slave downloads only updated files, but slave is
> create a new segement file and also a new version of index (generation is
> identical with master). On next polling the slave is download the full index
> again, because the new version slave is force a full copy.
> Problem is the new version of index on the slave after first replication.
> {noformat:apply patch SOLR-4413 script, please copy patch into patches
> directory before useage.}
> mkdir work
> cd work
> svn co http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_1/
> cd lucene_solr_4_1
> patch -p0 < ../../patches/SOLR-4413.patch
> cd solr
> ant dist
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
