[
https://issues.apache.org/jira/browse/TIKA-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14004103#comment-14004103
]
Giuseppe Totaro commented on TIKA-1302:
---------------------------------------
Thank you Chris.
I'm working with Tika against large set of data. Govdocs1 represents a good
choice in order to test Tika performance with a large amount of heterogeneous
documents. By using Tika 1.4, I noticed that about 10% of govdocs1 files are
not correctly parsed.
Unfortunately, each file of govdocs1 corpus has the same metadata properties
(http://digitalcorpora.org/corpora/files), so this corpus does not provide the
possibility to realistically test metadata extraction.
After our paper will be published in proceedings, I will happy to describe
results more in details and share them with the community.
Now, we're working also with other corpora constructed by ourself starting from
realistic (unclassified) disk images.
I hope to meet your interests.
> Let's run Tika against a large batch of docs nightly
> ----------------------------------------------------
>
> Key: TIKA-1302
> URL: https://issues.apache.org/jira/browse/TIKA-1302
> Project: Tika
> Issue Type: Improvement
> Reporter: Tim Allison
>
> Many thanks to [~lewismc] for TIKA-1301! Once we get nightly builds up and
> running again, it might be fun to run Tika regularly against a large set of
> docs and report metrics.
> One excellent candidate corpus is govdocs1:
> http://digitalcorpora.org/corpora/files.
> Any other candidate corpora?
> [~willp-bl], have anything handy you'd like to contribute?
> [http://www.openplanetsfoundation.org/blogs/2014-03-21-tika-ride-characterising-web-content-nanite]
> ;)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
