[
https://issues.apache.org/jira/browse/TIKA-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836536#comment-15836536
]
Hudson commented on TIKA-2244:
------------------------------
SUCCESS: Integrated in Jenkins build Tika-trunk #1187 (See
[https://builds.apache.org/job/Tika-trunk/1187/])
TIKA-2244 -- be more parsimonious with BufferedInputStream -- (tallison: rev
836e2d9040bacd7a8ffe88095187aa28ff26c6ba)
* (edit) tika-core/src/main/java/org/apache/tika/detect/AutoDetectReader.java
> excessive memory usage when parsing a large nested package file
> ---------------------------------------------------------------
>
> Key: TIKA-2244
> URL: https://issues.apache.org/jira/browse/TIKA-2244
> Project: Tika
> Issue Type: Bug
> Components: core, parser
> Affects Versions: 2.0
> Reporter: Joshua Hight
> Priority: Minor
> Fix For: 2.0, 1.15
>
>
> When parsing large nested files(a couple good examples are maven jars and git
> objects), a large number of BufferedInputStreams get generated taking up
> large amounts of memory with their buffers. Upon looking through the relevant
> code I saw that many of these allocations were coming from
> TikaInputStream.get(InputStream, TemporaryResources)
> which checks if the InputStream is a BufferedInputStream or
> ByteArrayInputStream in order to determine whether on not mark is supported.
> Unfortunately it is common practice to wrap InputStreams in
> CloseShieldInputStreams, causing it to fail even if mark is in fact supported.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
