[ https://issues.apache.org/jira/browse/LUCENE-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13502090#comment-13502090 ]
Shai Erera commented on LUCENE-3441: ------------------------------------ I added a TODO to consider switching to use DoubleBarrleLRUCache (to DirTaxoReader). Also added some javadocs to DTR.doOpenIfChanged, noting about the cache sharing. I ran all tests with 30 iterations on trunk and committed. After I ported to 4x, I hit this failure: org.apache.lucene.index.CorruptIndexException: Missing parent data for category 0 at __randomizedtesting.SeedInfo.seed([A790471136DA8197:3D43CAE660B7F604]:0) at org.apache.lucene.facet.taxonomy.directory.ParentArray.initFromReader(ParentArray.java:116) at org.apache.lucene.facet.taxonomy.directory.ParentArray.<init>(ParentArray.java:66) at org.apache.lucene.facet.taxonomy.directory.DirectoryTaxonomyReader.<init>(DirectoryTaxonomyReader.java:92) at org.apache.lucene.facet.taxonomy.directory.DirectoryTaxonomyReader.doOpenIfChanged(DirectoryTaxonomyReader.java:238) at org.apache.lucene.facet.taxonomy.directory.DirectoryTaxonomyReader.doOpenIfChanged(DirectoryTaxonomyReader.java:1) at org.apache.lucene.facet.taxonomy.TaxonomyReader.openIfChanged(TaxonomyReader.java:95) at org.apache.lucene.facet.taxonomy.directory.TestDirectoryTaxonomyReader.testOpenIfChangedManySegments(TestDirectoryTaxonomyReader.java:224) NOTE: reproduce with: ant test -Dtestcase=TestDirectoryTaxonomyReader -Dtests.method="testOpenIfChangedManySegments {#66 seed=[A790471136DA8197:3D43CAE660B7F604]}" -Dtests.seed=A790471136DA8197 -Dtests.slow=true -Dtests.locale=lt_LT -Dtests.timezone=Australia/South -Dtests.file.encoding=UTF-8 NOTE: test params are: codec=SimpleText, sim=DefaultSimilarity, locale=lt_LT, timezone=Australia/South NOTE: Windows 7 6.1 build 7600 amd64/IBM Corporation 1.6.0 (64-bit)/cpus=2,threads=1,free=1071336,total=15596544 NOTE: All tests run in this JVM: [TestDirectoryTaxonomyReader] Even though the test is single-threaded, it's not reproducible no matter if I use the master seed or the iteration seed. I can reproduce quite easily though if I add -Dtests.iters=100 and -Dtests.failfast=yes -- but it makes it hard to debug ... I'm digging. I won't revert the commit to trunk yet, hopefully I'll get to the bottom of it quickly. > Add NRT support to facets > ------------------------- > > Key: LUCENE-3441 > URL: https://issues.apache.org/jira/browse/LUCENE-3441 > Project: Lucene - Core > Issue Type: New Feature > Components: modules/facet > Reporter: Shai Erera > Assignee: Shai Erera > Priority: Minor > Attachments: LUCENE-3441.patch, LUCENE-3441.patch > > > Currently LuceneTaxonomyReader does not support NRT - i.e., on changes to > LuceneTaxonomyWriter, you cannot have the reader updated, like > IndexReader/Writer. In order to do that we need to do the following: > # Add ctor to LuceneTaxonomyReader to allow you to instantiate it with > LuceneTaxonomyWriter. > # Add API to LuceneTaxonomyWriter to expose its internal IndexReader > # Change LTR.refresh() to return an LTR, rather than void. This is actually > not strictly related to that issue, but since we'll need to modify refresh() > impl, I think it'll be good to change its API as well. Since all of facet API > is @lucene.experimental, no backwards issues here (and the sooner we do it, > the better). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org