[
https://issues.apache.org/jira/browse/DRILL-5507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16131289#comment-16131289
]
Timothy Farkas edited comment on DRILL-5507 at 8/17/17 9:04 PM:
----------------------------------------------------------------
Many of these messages get produced because there can be many Blocks for each
file. This message doesn't indicate an error and should be debug level instead
of info.
was (Author: timothyfarkas):
Many of these messages get produced because there can be many Blocks for each
file. This message doesn't indicate an error and should be debug level instead
info.
> Millions of "Failure finding Drillbit running on host" info messages in
> foreman logs
> ------------------------------------------------------------------------------------
>
> Key: DRILL-5507
> URL: https://issues.apache.org/jira/browse/DRILL-5507
> Project: Apache Drill
> Issue Type: Bug
> Components: Query Planning & Optimization
> Affects Versions: 1.10.0
> Reporter: Veera Naranammalpuram
> Assignee: Timothy Farkas
>
> When foreman tries to execute a query with data files that reside on nodes
> other than the nodes that are running drillbits, there are millions of
> messages in the log files like this:
> 2017-05-10 13:22:10,916 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0535.mydomain.com. Skipping affinity to that host.
> After 200 MB of these messages, 960K of them and 7 seconds of planning, it
> continues to execute this query. Is there a way to disable / suppress these
> messages? What's causing this? Should this be printed with INFO logging as
> we're seeing or only with DEBUG logging? Is there a way to turn off this
> check? Below is a snippet from foreman logs:
> 2017-05-10 13:22:10,916 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0535.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1402.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0929.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1098.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1230.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1388.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0535.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1291.mydomain.com. Skipping affinity to that host.
> The hostname and domain are scrubbed.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
