[
https://issues.apache.org/jira/browse/NUTCH-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17473209#comment-17473209
]
ASF GitHub Bot commented on NUTCH-2929:
---------------------------------------
lewismc commented on pull request #722:
URL: https://github.com/apache/nutch/pull/722#issuecomment-1010465132
@sebastian-nagel this LGTM.
Can you please post an example Tika warning about SAXParser pool?
Thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@nutch.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Fetcher: start threads slowly to avoid that resources are temporarily
> exhausted
> -------------------------------------------------------------------------------
>
> Key: NUTCH-2929
> URL: https://issues.apache.org/jira/browse/NUTCH-2929
> Project: Nutch
> Issue Type: Improvement
> Affects Versions: 1.18
> Reporter: Sebastian Nagel
> Priority: Minor
> Fix For: 1.19
>
>
> Fetcher spins all threads without any delay. This may cause that certain
> resources are temporarily exhausted if all threads start fetching the first
> pages simultaneously.
> The issue has been observed by Tika warnings about overuse of the SAXParser
> pool which appeared only during the first 2-5 minutes of fetching a segment.
> See https://lists.apache.org/thread/lo6b9wdlxy2lz12wmosldgl9x9ov1cks - adding
> a short delay between thread launches makes the warnings disappear.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
