[
https://issues.apache.org/jira/browse/SOLR-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13636184#comment-13636184
]
Karl Wright commented on SOLR-4358:
-----------------------------------
Ok, I found one that fails repeatably - but it seems to fail not due to
HttpSolrServer but due to problems shutting down threads.
This is how to repeat it:
ant test -Dtestcase=BasicDistributedZk2Test -Dtests.seed=398C285200313054
-Dtests.slow=true -Dtests.locale=uk_UA -Dtests.timezone=Africa/Kigali
-Dtests.file.encoding=Cp1252
The error it gets is this:
{code}
[junit4:junit4] 2> Creating dataDir: C:\wip\solr\branch_4x\solr\build\solr-cor
e\test\J0\.\solrtest-BasicDistributedZk2Test-1366359983221
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\wip\solr\branch_4x\s
olr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-1366
359983220\jetty2\index\org.apache.lucene.store.RAMDirectory@10c6406 lockFactory=
[email protected] FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\wip\solr\branch_4x\s
olr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-1366
359983220\jetty2\index FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\wip\solr\branch_4x\s
olr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-1366
359983220\jetty2 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\wip\solr\branch_4x\s
olr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-1366
359983220 FAILED !!!!!
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributed
Zk2Test -Dtests.method=testDistribSearch -Dtests.seed=398C285200313054 -Dtests.s
low=true -Dtests.locale=uk_UA -Dtests.timezone=Africa/Kigali -Dtests.file.encodi
ng=Cp1252
[junit4:junit4] ERROR 57.2s | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrSer
ver$RemoteSolrException: Server at http://127.0.0.1:59625/onenodecollectioncore
returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([398C285200313054:B
86AA64A776E5068]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.requ
est(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.requ
est(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRe
quest.process(AbstractUpdateRequest.java:117)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServe
r.java:116)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServe
r.java:102)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNod
eWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(
BasicDistributedZk2Test.java:89)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDis
tribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:619)
[junit4:junit4] 1> INFO - 2013-04-19 04:27:20.374; org.apache.solr.SolrTestCa
seJ4; ###deleteCore
[junit4:junit4] HEARTBEAT J0 PID(14064@acromantula): 2013-04-19T04:28:30, stalle
d for 69.7s at: BasicDistributedZk2Test.testDistribSearch
[junit4:junit4] 1> ERROR - 2013-04-19 04:29:21.383; org.apache.solr.SolrTestCa
seJ4; ERROR: SolrIndexSearcher opens=10 closes=8
[junit4:junit4] 2> 178598 T9 ccr.ThreadLeakControl.checkThreadLeaks WARNING Wi
ll linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] HEARTBEAT J0 PID(14064@acromantula): 2013-04-19T04:29:30, stalle
d for 130s at: BasicDistributedZk2Test.testDistribSearch
[junit4:junit4] 2> 198601 T9 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1 t
hread leaked from SUITE scope at org.apache.solr.cloud.BasicDistributedZk2Test:
[junit4:junit4] 2> 1) Thread[id=71, name=searcherExecutor-25-thread-1, s
tate=WAITING, group=TGRP-BasicDistributedZk2Test]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(L
ockSupport.java:158)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSync
hronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take
(LinkedBlockingQueue.java:399)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTa
sk(ThreadPoolExecutor.java:947)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worke
r.run(ThreadPoolExecutor.java:907)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:619)
[junit4:junit4] 2> 198601 T9 ccr.ThreadLeakControl.tryToInterruptAll Starting
to interrupt leaked threads:
[junit4:junit4] 2> 1) Thread[id=71, name=searcherExecutor-25-thread-1, s
tate=WAITING, group=TGRP-BasicDistributedZk2Test]
[junit4:junit4] 2> 201602 T9 ccr.ThreadLeakControl.tryToInterruptAll SEVERE Th
ere are still zombie threads that couldn't be terminated:
[junit4:junit4] 2> 1) Thread[id=71, name=searcherExecutor-25-thread-1, s
tate=WAITING, group=TGRP-BasicDistributedZk2Test]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(L
ockSupport.java:158)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSync
hronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take
(LinkedBlockingQueue.java:399)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTa
sk(ThreadPoolExecutor.java:947)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worke
r.run(ThreadPoolExecutor.java:907)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:619)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, si
m=DefaultSimilarity, locale=uk_UA, timezone=Africa/Kigali
[junit4:junit4] 2> NOTE: Windows Vista 6.0 x86/Sun Microsystems Inc. 1.6.0_21
(32-bit)/cpus=2,threads=2,free=8746296,total=33193984
[junit4:junit4] 2> NOTE: All tests run in this JVM: [BasicDistributedZk2Test]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributed
Zk2Test -Dtests.seed=398C285200313054 -Dtests.slow=true -Dtests.locale=uk_UA -Dt
ests.timezone=Africa/Kigali -Dtests.file.encoding=Cp1252
[junit4:junit4] ERROR 0.00s | BasicDistributedZk2Test (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSea
rcher opens=10 closes=8
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([398C285200313054]:
0)
[junit4:junit4] > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(S
olrTestCaseJ4.java:252)
[junit4:junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCas
eJ4.java:101)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:619)Throwable #2: co
m.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE sco
pe at org.apache.solr.cloud.BasicDistributedZk2Test:
[junit4:junit4] > 1) Thread[id=71, name=searcherExecutor-25-thread-1, stat
e=WAITING, group=TGRP-BasicDistributedZk2Test]
[junit4:junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] > at java.util.concurrent.locks.LockSupport.park(Lock
Support.java:158)
[junit4:junit4] > at java.util.concurrent.locks.AbstractQueuedSynchro
nizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4:junit4] > at java.util.concurrent.LinkedBlockingQueue.take(Li
nkedBlockingQueue.java:399)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(
ThreadPoolExecutor.java:947)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.r
un(ThreadPoolExecutor.java:907)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:619)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([398C285200313054]:
0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are st
ill zombie threads that couldn't be terminated:
[junit4:junit4] > 1) Thread[id=71, name=searcherExecutor-25-thread-1, stat
e=WAITING, group=TGRP-BasicDistributedZk2Test]
[junit4:junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] > at java.util.concurrent.locks.LockSupport.park(Lock
Support.java:158)
[junit4:junit4] > at java.util.concurrent.locks.AbstractQueuedSynchro
nizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4:junit4] > at java.util.concurrent.LinkedBlockingQueue.take(Li
nkedBlockingQueue.java:399)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(
ThreadPoolExecutor.java:947)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.r
un(ThreadPoolExecutor.java:907)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:619)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([398C285200313054]:
0)
[junit4:junit4] Completed in 203.91s, 1 test, 1 failure, 3 errors <<< FAILURES!
[junit4:junit4]
[junit4:junit4]
[junit4:junit4] Tests with failures:
[junit4:junit4] - org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSea
rch
[junit4:junit4] - org.apache.solr.cloud.BasicDistributedZk2Test (suite)
[junit4:junit4]
[junit4:junit4]
[junit4:junit4] JVM J0: 1.55 .. 206.98 = 205.43s
[junit4:junit4] Execution time total: 3 minutes 27 seconds
[junit4:junit4] Tests summary: 1 suite, 1 test, 3 suite-level errors, 1 error
BUILD FAILED
{code}
I don't think this is related to the patch for this ticket, but to be sure I'll
peel the patch out and try it again.
> SolrJ, by preventing multi-part post, loses key information about file name
> that Tika needs
> -------------------------------------------------------------------------------------------
>
> Key: SOLR-4358
> URL: https://issues.apache.org/jira/browse/SOLR-4358
> Project: Solr
> Issue Type: Bug
> Components: clients - java
> Affects Versions: 4.0
> Reporter: Karl Wright
> Assignee: Ryan McKinley
> Attachments: additional_changes.diff, SOLR-4358.patch,
> SOLR-4358.patch, SOLR-4358.patch
>
>
> SolrJ accepts a ContentStream, which has a name field. Within
> HttpSolrServer.java, if SolrJ makes the decision to use multipart posts, this
> filename is transmitted as part of the form boundary information. However,
> if SolrJ chooses not to use multipart post, the filename information is lost.
> This information is used by SolrCell (Tika) to make decisions about content
> extraction, so it is very important that it makes it into Solr in one way or
> another. Either SolrJ should set appropriate equivalent headers to send the
> filename automatically, or it should force multipart posts when this
> information is present.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
