[
https://issues.apache.org/jira/browse/TIKA-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Pilato updated TIKA-4774:
-------------------------------
Description:
I'm trying to move FSCrawler to Tika 4.0.0-beta-1 to check if everything looks
good on my side.
While running some unit tests, I found that the metadata name encoding might be
wrong (or I need to fix this on my side and I don't know it yet ;) )
{{java.lang.AssertionError: }}
{{Expecting map:}}
{{{} {"Content-Encoding"="x-MacRoman", "Content-Location"="Web%20page",
"Content-Type"="text/html; charset=x-MacRoman", "Content-Type-Hint"="text/html;
charset=macintosh", "Content-Type-Magic-Detected"="text/html",
"X-TIKA:Parsed-By"="org.apache.tika.parser.DefaultParser",
"X-TIKA:Parsed-By-Full-Set"="org.apache.tika.parser.DefaultParser",
"X-TIKA:detectedEncoding"="x-MacRoman",
"X-TIKA:encodingDetectionTrace"="HtmlEncodingDetector->x-MacRoman[DECLARATIVE],
MojibusterEncodingDetector->UTF-8[STRUCTURAL]
[junk-filter-prefer-declarative]",
"X-TIKA:encodingDetector"="HtmlEncodingDetector",
"X-TIKA:resourceName"="test.html", "dc:title"="Test Tika title",
"html:Generator"="Microsoft Word 15", "html:Mots clés"="keyword1, keyword2",
"html:Originator"="Microsoft Word 15", "html:ProgId"="Word.Document",
"html:Titre"="Test Tika title"{}}}}
{{to contain entries:}}
{{ ["html:Mots clés"="keyword1, keyword2"]}}
{{but could not find the following map entries:}}
{{ ["html:Mots clés"="keyword1, keyword2"]}}
Note that i'm not seeing the same behavior with a doc (MSOffice). The metadata
names are correctly encoded with the .doc file.
was:
I'm trying to move FSCrawler to Tika 4.0.0-beta-1 to check if everything looks
good on my side.
While running some unit tests, I found that the metadata name encoding might be
wrong (or I need to fix this on my side and I don't know it yet ;) )
{{java.lang.AssertionError: }}
{{Expecting map:}}
{{ \{"Content-Encoding"="x-MacRoman", "Content-Location"="Web%20page",
"Content-Type"="text/html; charset=x-MacRoman", "Content-Type-Hint"="text/html;
charset=macintosh", "Content-Type-Magic-Detected"="text/html",
"X-TIKA:Parsed-By"="org.apache.tika.parser.DefaultParser",
"X-TIKA:Parsed-By-Full-Set"="org.apache.tika.parser.DefaultParser",
"X-TIKA:detectedEncoding"="x-MacRoman",
"X-TIKA:encodingDetectionTrace"="HtmlEncodingDetector->x-MacRoman[DECLARATIVE],
MojibusterEncodingDetector->UTF-8[STRUCTURAL]
[junk-filter-prefer-declarative]",
"X-TIKA:encodingDetector"="HtmlEncodingDetector",
"X-TIKA:resourceName"="test.html", "dc:title"="Test Tika title",
"html:Generator"="Microsoft Word 15", "html:Mots clés"="keyword1, keyword2",
"html:Originator"="Microsoft Word 15", "html:ProgId"="Word.Document",
"html:Titre"="Test Tika title"}}}
{{to contain entries:}}
{{ ["html:Mots clés"="keyword1, keyword2"]}}
{{but could not find the following map entries:}}
{{ ["html:Mots clés"="keyword1, keyword2"]}}
> Metadata names encoding might have changed
> ------------------------------------------
>
> Key: TIKA-4774
> URL: https://issues.apache.org/jira/browse/TIKA-4774
> Project: Tika
> Issue Type: Bug
> Affects Versions: 4.0.0
> Reporter: David Pilato
> Priority: Major
> Attachments: test.doc, test.html
>
>
> I'm trying to move FSCrawler to Tika 4.0.0-beta-1 to check if everything
> looks good on my side.
>
> While running some unit tests, I found that the metadata name encoding might
> be wrong (or I need to fix this on my side and I don't know it yet ;) )
>
> {{java.lang.AssertionError: }}
> {{Expecting map:}}
> {{{} {"Content-Encoding"="x-MacRoman", "Content-Location"="Web%20page",
> "Content-Type"="text/html; charset=x-MacRoman",
> "Content-Type-Hint"="text/html; charset=macintosh",
> "Content-Type-Magic-Detected"="text/html",
> "X-TIKA:Parsed-By"="org.apache.tika.parser.DefaultParser",
> "X-TIKA:Parsed-By-Full-Set"="org.apache.tika.parser.DefaultParser",
> "X-TIKA:detectedEncoding"="x-MacRoman",
> "X-TIKA:encodingDetectionTrace"="HtmlEncodingDetector->x-MacRoman[DECLARATIVE],
> MojibusterEncodingDetector->UTF-8[STRUCTURAL]
> [junk-filter-prefer-declarative]",
> "X-TIKA:encodingDetector"="HtmlEncodingDetector",
> "X-TIKA:resourceName"="test.html", "dc:title"="Test Tika title",
> "html:Generator"="Microsoft Word 15", "html:Mots clés"="keyword1, keyword2",
> "html:Originator"="Microsoft Word 15", "html:ProgId"="Word.Document",
> "html:Titre"="Test Tika title"{}}}}
> {{to contain entries:}}
> {{ ["html:Mots clés"="keyword1, keyword2"]}}
> {{but could not find the following map entries:}}
> {{ ["html:Mots clés"="keyword1, keyword2"]}}
> Note that i'm not seeing the same behavior with a doc (MSOffice). The
> metadata names are correctly encoded with the .doc file.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
