[
https://issues.apache.org/jira/browse/TIKA-522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12918323#action_12918323
]
Dennis Adler edited comment on TIKA-522 at 10/5/10 7:40 PM:
------------------------------------------------------------
Local copy of the network file that is mis-detected.
This is one of a few files that gave me a repro case; what I do not understand
is why it is somewhat inconsistent in its repro. The problem occurs in
MimeTypes.getMimeType().
The data passed in looks correct (manually verified the first 30 bytes or so)
and it reads the 8k in one pass; so it's not a read error issue.
I traced the code through this FOR loop:
// Then, check for magic bytes
MimeType result = null;
for (Magic magic : magics) {
if (magic.eval(data)) {
result = magic.getType();
break;
}
}
On exit from the loop, result has the type "audio/mpeg". This is a UNICODE HTML
file downloaded off the web.
Jsut saw Jukka's comment; it could be the same problem. I'll check into the 0.8
build I snapped last week and see if the problem goes away when I hook this in.
Though first I need to see if I can make it repro reliably with this file using
Tika 0.7.
was (Author: dennisad):
Local copy of the network file that is mis-detected.
> AutoDetectParser treats HTML/XML files as Audio
> -----------------------------------------------
>
> Key: TIKA-522
> URL: https://issues.apache.org/jira/browse/TIKA-522
> Project: Tika
> Issue Type: Bug
> Components: parser
> Affects Versions: 0.7
> Environment: WIndows 7 x64, java v6.0.170.4, jdk1.6.0_21, Eclipse
> 20100617-1415
> Reporter: Dennis Adler
> Assignee: Ken Krugler
> Attachments: Tika MimeTypes bug repro case.htm
>
>
> I am crawling an SMB share. I've used the steps outlined in Tika samples to
> initialize; given a File object in f, my code is:
> parser = new AutoDetectParser();
> context.set(Parser.class, parser);
> // Get the URL
> URL url = f.toURI().toURL();
> // Extract Metadata
> Metadata metadata = new Metadata();
> BodyContentHandler handler = new BodyContentHandler(-1); // -1 =
> infinite size for XML string buffer (per file)
> // Get the input stream
> InputStream input = MetadataHelper.getInputStream(url, metadata);
> // Parse the document
> parser.parse(input, handler, metadata, context);
> If I place a breakpoint right after the parser.parse invoke, I find the
> metadata calling my input out as an Audio file. If I try to debug the parse
> steps, it correctly tags it as Text/HTML. Seems like a timing-related problem.
> I have a half-baked workaround: I invoke Thread.sleep(5000) just after the
> context.set invoke... in 3 sequential test runs that works fine. Problem is,
> this was working fine several days ago without that (perhaps my computer was
> busy with other things and the timing issue did not pop up then).
> I have downloade and am building today's 0.8 from svn to see if that helps,
> though I am concerned about the impacts to the rest of my testing if I have
> to swtich to 0.8. Just understanding what was going on would be a huge help :)
> * UPDATE * I was able to repro this once under the debugger. MimeTypes.detect
> invokes org.apache.tika.mime.MimeTypes.getMimeType on the input stream to
> determine the Mime Type based on the first 8k of data. I did not trace into
> getMimeType, but did see it return "audio/mpeg" on an HTML file one time, and
> "text/html" most others. I can supply the HTML file if desired.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
