[
https://issues.apache.org/jira/browse/SOLR-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16046599#comment-16046599
]
Amrit Sarkar edited comment on SOLR-10867 at 6/12/17 2:11 PM:
--------------------------------------------------------------
Shalin,
Sorry I uploaded old test-error-log and patch, uploaded new ones, object leaks
etc. I will take some more time to understand what different I am doing from
rest of the test cases in the project. Thank you for your help.
{code}
[junit4] 2> 28893 ERROR (coreCloseExecutor-12-thread-1) [
x:collection1] o.a.s.c.CachingDirectoryFactory Timeout waiting for all
directory ref counts to be released - gave up waiting on
CachedDir<<refCount=1;path=/Users/amritsarkar/git_space/solr-june/lucene-solr/solr/build/solr-core/test/J0/temp/solr.update.processor.ClassificationUpdateProcessorFactoryTest_27D2820C6C631FAD-001/init-core-data-001/index;done=false>>
[junit4] 2> 28894 ERROR (coreCloseExecutor-12-thread-1) [
x:collection1] o.a.s.c.CachingDirectoryFactory Error closing
directory:org.apache.solr.common.SolrException: Timeout waiting for all
directory ref counts to be released - gave up waiting on
CachedDir<<refCount=1;path=/Users/amritsarkar/git_space/solr-june/lucene-solr/solr/build/solr-core/test/J0/temp/solr.update.processor.ClassificationUpdateProcessorFactoryTest_27D2820C6C631FAD-001/init-core-data-001/index;done=false>>
[junit4] 2> at
org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:177)
[junit4] 2> at
org.apache.solr.core.SolrCore.close(SolrCore.java:1617)
[junit4] 2> at
org.apache.solr.core.SolrCores.lambda$close$0(SolrCores.java:132)
[junit4] 2> at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 28895 ERROR (coreCloseExecutor-12-thread-1) [
x:collection1] o.a.s.c.SolrCore java.lang.AssertionError: 1
[junit4] 2> at
org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:191)
[junit4] 2> at
org.apache.solr.core.SolrCore.close(SolrCore.java:1617)
[junit4] 2> at
org.apache.solr.core.SolrCores.lambda$close$0(SolrCores.java:132)
[junit4] 2> at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 28896 ERROR (coreCloseExecutor-12-thread-1) [
x:collection1] o.a.s.c.SolrCores Error shutting down
core:java.lang.AssertionError: 1
[junit4] 2> at
org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:191)
[junit4] 2> at
org.apache.solr.core.SolrCore.close(SolrCore.java:1617)
[junit4] 2> at
org.apache.solr.core.SolrCores.lambda$close$0(SolrCores.java:132)
[junit4] 2> at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 28898 INFO
(SUITE-ClassificationUpdateProcessorFactoryTest-seed#[27D2820C6C631FAD]-worker)
[ ] o.a.s.SolrTestCaseJ4 Waiting for all tracked resources to be released
[junit4] 2> 38936 INFO
(SUITE-ClassificationUpdateProcessorFactoryTest-seed#[27D2820C6C631FAD]-worker)
[ ] o.a.s.SolrTestCaseJ4 Waiting for all tracked resources to be released
[junit4] 2> 48965 INFO
(SUITE-ClassificationUpdateProcessorFactoryTest-seed#[27D2820C6C631FAD]-worker)
[ ] o.a.s.SolrTestCaseJ4 Waiting for all tracked resources to be released
[junit4] 2> JUnit4-serializer-daemon:
[junit4] 2> java.lang.Thread.sleep(Native Method)
[junit4] 2>
com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
[junit4] 2>
[junit4] 2> Signal Dispatcher:
[junit4] 2>
[junit4] 2> Finalizer:
[junit4] 2> java.lang.Object.wait(Native Method)
[junit4] 2>
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
[junit4] 2>
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
[junit4] 2>
java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
[junit4] 2>
[junit4] 2>
SUITE-ClassificationUpdateProcessorFactoryTest-seed#[27D2820C6C631FAD]:
[junit4] 2> java.lang.Object.wait(Native Method)
[junit4] 2> java.lang.Thread.join(Thread.java:1257)
[junit4] 2> [...com.carrotsearch.randomizedtesting.*]
[junit4] 2>
[junit4] 2> main:
[junit4] 2> java.lang.Object.wait(Native Method)
[junit4] 2> java.lang.Thread.join(Thread.java:1249)
[junit4] 2> java.lang.Thread.join(Thread.java:1323)
[junit4] 2> [...com.carrotsearch.randomizedtesting.*]
[junit4] 2>
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:244)
[junit4] 2>
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
[junit4] 2>
com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
[junit4] 2>
[junit4] 2> Reference Handler:
[junit4] 2> java.lang.Object.wait(Native Method)
[junit4] 2> java.lang.Object.wait(Object.java:502)
[junit4] 2>
java.lang.ref.Reference.tryHandlePending(Reference.java:191)
[junit4] 2>
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
[junit4] 2>
[junit4] 2>
SUITE-ClassificationUpdateProcessorFactoryTest-seed#[27D2820C6C631FAD]-worker:
[junit4] 2> java.lang.Thread.dumpThreads(Native Method)
[junit4] 2> java.lang.Thread.getAllStackTraces(Thread.java:1607)
[junit4] 2>
org.apache.solr.SolrTestCaseJ4.clearObjectTrackerAndCheckEmpty(SolrTestCaseJ4.java:350)
[junit4] 2>
org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:294)
[junit4] 2> [...sun.*, java.lang.reflect.*,
com.carrotsearch.randomizedtesting.*]
[junit4] 2>
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> [...com.carrotsearch.randomizedtesting.*]
[junit4] 2>
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> [...com.carrotsearch.randomizedtesting.*]
[junit4] 2>
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2>
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2>
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2>
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> [...com.carrotsearch.randomizedtesting.*]
[junit4] 2> java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 49973 INFO
(SUITE-ClassificationUpdateProcessorFactoryTest-seed#[27D2820C6C631FAD]-worker)
[ ] o.a.s.SolrTestCaseJ4
------------------------------------------------------- Done waiting for
tracked resources to be released
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {},
docValues:{}, maxPointsInLeafNode=730, maxMBSortInHeap=7.789755564495978,
sim=RandomSimilarity(queryNorm=true): {}, locale=es-CL, timezone=Pacific/Samoa
[junit4] 2> NOTE: Mac OS X 10.12.5 x86_64/Oracle Corporation 1.8.0_102
(64-bit)/cpus=4,threads=1,free=184904088,total=217579520
[junit4] 2> NOTE: All tests run in this JVM:
[ClassificationUpdateProcessorFactoryTest]
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=ClassificationUpdateProcessorFactoryTest
-Dtests.seed=27D2820C6C631FAD -Dtests.slow=true -Dtests.locale=es-CL
-Dtests.timezone=Pacific/Samoa -Dtests.asserts=true
-Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s | ClassificationUpdateProcessorFactoryTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ObjectTracker found 5
object(s) that were not released!!! [MockDirectoryWrapper, SolrIndexSearcher,
MockDirectoryWrapper, SolrCore, MockDirectoryWrapper]
[junit4] >
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
org.apache.lucene.store.MockDirectoryWrapper
[junit4] > at
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
[junit4] > at
org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:361)
[junit4] > at
org.apache.solr.core.SolrCore.initIndex(SolrCore.java:721)
[junit4] > at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:948)
[junit4] > at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:855)
[junit4] > at
org.apache.solr.core.CoreContainer.create(CoreContainer.java:979)
[junit4] > at
org.apache.solr.core.CoreContainer.lambda$load$7(CoreContainer.java:611)
[junit4] > at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
[junit4] > at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] > at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] > at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] >
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
org.apache.solr.search.SolrIndexSearcher
[junit4] > at
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at
org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:323)
[junit4] > at
org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2047)
[junit4] > at
org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2199)
[junit4] > at
org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1085)
[junit4] > at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:974)
[junit4] > at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:855)
[junit4] > at
org.apache.solr.core.CoreContainer.create(CoreContainer.java:979)
[junit4] > at
org.apache.solr.core.CoreContainer.lambda$load$7(CoreContainer.java:611)
[junit4] > at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
[junit4] > at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] > at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] > at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] >
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
org.apache.lucene.store.MockDirectoryWrapper
[junit4] > at
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
[junit4] > at
org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92)
[junit4] > at
org.apache.solr.core.SolrCore.initIndex(SolrCore.java:753)
[junit4] > at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:948)
[junit4] > at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:855)
[junit4] > at
org.apache.solr.core.CoreContainer.create(CoreContainer.java:979)
[junit4] > at
org.apache.solr.core.CoreContainer.lambda$load$7(CoreContainer.java:611)
[junit4] > at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
[junit4] > at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] > at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] > at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] >
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
org.apache.solr.core.SolrCore
[junit4] > at
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:1033)
[junit4] > at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:855)
[junit4] > at
org.apache.solr.core.CoreContainer.create(CoreContainer.java:979)
[junit4] > at
org.apache.solr.core.CoreContainer.lambda$load$7(CoreContainer.java:611)
[junit4] > at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
[junit4] > at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] > at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] > at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] >
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
org.apache.lucene.store.MockDirectoryWrapper
[junit4] > at
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
[junit4] > at
org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:490)
[junit4] > at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:942)
[junit4] > at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:855)
[junit4] > at
org.apache.solr.core.CoreContainer.create(CoreContainer.java:979)
[junit4] > at
org.apache.solr.core.CoreContainer.lambda$load$7(CoreContainer.java:611)
[junit4] > at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
[junit4] > at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] > at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] > at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at
__randomizedtesting.SeedInfo.seed([27D2820C6C631FAD]:0)
[junit4] > at
org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:295)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] Completed [1/1 (1!)] in 51.53s, 3 tests, 1 failure <<< FAILURES!
[junit4]
[junit4]
[junit4] Tests with failures [seed: 27D2820C6C631FAD]:
[junit4] -
org.apache.solr.update.processor.ClassificationUpdateProcessorFactoryTest
(suite)
[junit4]
[junit4]
[junit4] JVM J0: 15.77 .. 63.40 = 47.63s
[junit4] Execution time total: 1 minute 3 seconds
[junit4] Tests summary: 1 suite, 3 tests, 1 suite-level error
{code}
was (Author: sarkaramr...@gmail.com):
Shalin,
Sorry I uploaded old test-error-log and patch, uploaded new ones, object leaks
etc. I will take some more time to understand what different I am doing from
rest of the test cases in the project. Thank you for your help.
> Make ClassificationUpdateProcessorFactory as Runtime URP; take params(s) with
> request
> -------------------------------------------------------------------------------------
>
> Key: SOLR-10867
> URL: https://issues.apache.org/jira/browse/SOLR-10867
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Components: update
> Reporter: Amrit Sarkar
> Priority: Minor
> Attachments: error_test, SOLR-10867.patch, SOLR-10867.patch,
> SOLR-10867.patch, SOLR-10867.patch
>
>
> We are trying to get rid of processor definitions in SolrConfig for all URPs
> and take parameters in the request itself.
> ClassificationUpdateProcessorFactory will be able to execute by sample curl
> like below:
> {code}
> curl -X POST -H Content-Type: application/json
> http://localhost:8983/solr/test/update/json/docs?processor=Classification&classification.fieldName=url_s&classification.classField=training&commit=true
> --data-binary { "id" : "1" , "url_s" : "http://www.example.com/subroot"; }
> {code}
> All the param(s) for this URP available can be passed as request handler
> param(s).
> Configuration for ClassificationUpdateProcessorFactory in solrconfig.xml is
> optional.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
