[
https://issues.apache.org/jira/browse/TIKA-272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12753880#action_12753880
]
Jukka Zitting commented on TIKA-272:
------------------------------------
There are basically two ways for us to do this:
1) Use the SAX Locator API to report current parse location (line, column)
whenever the ContentHandler implementation wants to know it.
2) Explicitly add XML attributes like tika:location="..." to the XHTML elements
emitted by a parser.
The latter option would be more accurate and could also be adapted to things
like PDF coordinates, etc., so that seems like a better alternative.
I'm not sure how to handle all the details here. Do we have some concrete
simple use case that we could use as an example and a test case of a first
approximation of the implementation?
> Expose characters offsets information while parsing text-based inputs.
> ----------------------------------------------------------------------
>
> Key: TIKA-272
> URL: https://issues.apache.org/jira/browse/TIKA-272
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Affects Versions: 0.4
> Reporter: David Causse
> Priority: Minor
>
> It would be interesting to access actual characters offset information when
> parsing text-based files (I don't know if it's interesting/usable/doable for
> binary formats...).
> If I use tika for parsing HTML and inject parsed strings into lucene, I'm not
> able to tell to the lucene analyzer where is the actual character in the
> original input.
> If tika expose this information It will permit to use unmodified lucene
> analyzers behind tika and implement for example pretty highlighting in search
> result (see google cache view).
> With new Lucene Attribute API it could be fairly easy to provide a sort of
> TikaOffsetRectifierTokenFilter in lucene contrib and use a stack like tika ->
> unmodified lucene analyzer -> tika offset correction.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
