[ 
https://issues.apache.org/jira/browse/LUCENE-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steven Rowe updated LUCENE-3913:
--------------------------------

    Attachment: LUCENE-3913.patch

Patch, a superset of Mike's:

* fixes the identified problem: {{</br>}} offset was improperly calculated.  
(Added comments describing the offset calculations everywhere they're performed 
in the .jflex source.)
* adds a new case emitting {{<\s*(/\s*)?(br|script|style)>?}} to 
{{_TestUtil.randomHtmlishString()}}, because <br>, <script>, and <style> are 
handled specially in HTMLStripCharFilter.
* adds a new method {{_TestUtil.randomlyRecaseCodePoints()}}, used by the 
above-mentioned new {{randomHtmlishString()}} case, to produce things like 
{{<Br>}}, {{</sCriPT>}}, etc.
* switches {{HTMLStripCharFilterTest.testRandomBrokenHTML()}} to use Mike's new 
{{BaseTokenStreamTestCase.checkAnalysisConsistency()}}.
* fixes the Jenkins test failure of 
{{HTMLStripCharFilterTest.testRandomHugeStrings()}} at 
[https://builds.apache.org/job/Lucene-Solr-tests-only-3.x/12863/]: {{ant test 
-Dtestcase=HTMLStripCharFilterTest -Dtestmethod=null 
-Dtests.seed=48bbf57c15b7aa2d:5bb640584c81078d:-7e916259eafd7e54 
-Dtests.multiplier=5 -Dargs="-Dfile.encoding=ISO8859-1"
}}

Committing shortly.
                
> HTMLStripCharFilter produces invalid final offset
> -------------------------------------------------
>
>                 Key: LUCENE-3913
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3913
>             Project: Lucene - Java
>          Issue Type: Bug
>            Reporter: Michael McCandless
>            Assignee: Steven Rowe
>             Fix For: 3.6, 4.0
>
>         Attachments: LUCENE-3913.patch, LUCENE-3913.patch
>
>
> Nightly build found this... I boiled it down to a small test case that 
> doesn't require the big line file docs.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to