[
https://issues.apache.org/jira/browse/SOLR-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881432#comment-13881432
]
Steve Rowe commented on SOLR-5652:
----------------------------------
It looks to me like there are two problems here: 1) the same doc is showing up
on different pages when deep paging; and 2) missing docvalue docs are sorted
incorrectly.
I can easily find examples of problem #2 in logs of non-failing trials, e.g.
from trial #91 - when sort=long_dv_first+asc, missing value docs id=19, id=32
and id=37 are sorted as if they had the value 0, on the second page, when they
should be sorted first on the first page:
{noformat}
[junit4] 2> 19554 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups
SOLR-5652:
({params(q=*%3A*&fl=id%2Clong_dv_first&rows=31&sort=long_dv_first+asc%2C+id+asc),defaults(cursorMark=*)})
gave us these docs: {id=49, long_dv_first=-8979994988935574161}; {id=92,
long_dv_first=-8755571709855874971}; {id=84,
long_dv_first=-8574119732015592678}; {id=56,
long_dv_first=-8572499504943249879}; {id=91,
long_dv_first=-8203042523619772390}; {id=75,
long_dv_first=-8115138008435097864}; {id=85,
long_dv_first=-7569390009163464752}; {id=58,
long_dv_first=-7543350239050885008}; {id=45,
long_dv_first=-7525477648502620266}; {id=80,
long_dv_first=-7520859819773031357}; {id=20,
long_dv_first=-7124229734364778199}; {id=64,
long_dv_first=-6830701259982220043}; {id=60,
long_dv_first=-6805829375857154103}; {id=2,
long_dv_first=-6659642971458854219}; {id=72,
long_dv_first=-6436183300694469323}; {id=41,
long_dv_first=-6013357013156317440}; {id=16,
long_dv_first=-5909224636078497253}; {id=90,
long_dv_first=-5891044973987397315}; {id=21,
long_dv_first=-5139637696689790888}; {id=95,
long_dv_first=-4964664340542583607}; {id=25,
long_dv_first=-4953002351284696779}; {id=101,
long_dv_first=-4409331376874778593}; {id=40,
long_dv_first=-4123215048596655849}; {id=4,
long_dv_first=-3899694572079828547}; {id=94,
long_dv_first=-3621827719107024030}; {id=29,
long_dv_first=-3602538116122488005}; {id=54,
long_dv_first=-3286165773326701533}; {id=5,
long_dv_first=-3144094377585650477}; {id=22,
long_dv_first=-3050916496497308906}; {id=71,
long_dv_first=-2534895618188255748}; {id=48,
long_dv_first=-2165485763197155213};
[junit4] 2> 19567 T10 oasc.DistribCursorPagingTest.assertFullWalkNoDups
SOLR-5652:
({params(q=*%3A*&fl=id%2Clong_dv_first&rows=31&sort=long_dv_first+asc%2C+id+asc),defaults(cursorMark=AoIH4fKmK%2B53yHNQAw%3D%3D)})
gave us these docs: {id=76, long_dv_first=-1932456939352186404}; {id=68,
long_dv_first=-1878698959726559452}; {id=88,
long_dv_first=-1623167100548405744}; {id=83,
long_dv_first=-1589461579047178358}; {id=13,
long_dv_first=-1411021277082593064}; {id=74,
long_dv_first=-1013366478463336966}; {id=17,
long_dv_first=-946883306115055217}; {id=99, long_dv_first=-663522491219747257};
{id=42, long_dv_first=-92189538677577379}; {id=19}; {id=32}; {id=37}; {id=82,
long_dv_first=5004}; {id=97, long_dv_first=5006}; {id=24, long_dv_first=5012};
{id=11, long_dv_first=5013}; {id=87, long_dv_first=5035}; {id=33,
long_dv_first=5037}; {id=10, long_dv_first=5048}; {id=34, long_dv_first=5051};
{id=28, long_dv_first=5067}; {id=3, long_dv_first=5073}; {id=43,
long_dv_first=5076}; {id=23, long_dv_first=5083}; {id=89, long_dv_first=5087};
{id=8, long_dv_first=58919190259123570}; {id=51,
long_dv_first=225066202121560643}; {id=67, long_dv_first=844890816756093941};
{id=6, long_dv_first=1032728410845862227}; {id=36,
long_dv_first=1141671958716920319}; {id=96, long_dv_first=1226886190401658912};
{noformat}
TestDistributedMissingSort does not test sorting by docvalue - I'll work on
adding docvalue tests there.
> Heisenbug in DistribCursorPagingTest: "walk already seen ..."
> -------------------------------------------------------------
>
> Key: SOLR-5652
> URL: https://issues.apache.org/jira/browse/SOLR-5652
> Project: Solr
> Issue Type: Bug
> Reporter: Hoss Man
> Assignee: Hoss Man
> Attachments: 129.log, 372.log,
> jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1200.log.txt,
> jenkins.thetaphi.de_Lucene-Solr-4.x-MacOSX_1217.log.txt
>
>
> Twice now, Uwe's jenkins has encountered a "walk already seen ..." assertion
> failure from DistribCursorPagingTest that I've been unable to fathom, let
> alone reproduce (although sarowe was able to trigger a similar,
> non-reproducible seed, failure on his machine)
> Using this as a tracking issue to try and make sense of it.
> Summary of things noticed so far (in 3 failures):
> * So far only seen on http://jenkins.thetaphi.de & sarowe's mac
> * So far only seen on MacOSX
> * So far only seen on branch 4x
> * So far seen on both Java6 and Java7
> * fails occured in first block of randomized testing:
> ** we've indexed a small number of randomized docs
> ** we're explicitly looping over every field and sorting in both directions
> * fails were both when doing a "desc" sorting on one of the "\*_dv_last" or
> "\*_dv_first" fields (docValues=true, either sortMissingLast=true OR
> sortMissingFirst=true)
> ** sort on same field asc has always worked fine just before this (fields are
> in arbitrary order, but "asc" always tried before "desc")
> ** sorting on some other random fields has sometimes been tried before this
> and worked
> (specifics of each failure seen in the wild recorded in comments)
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
