[
https://issues.apache.org/jira/browse/DRILL-5507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16131362#comment-16131362
]
ASF GitHub Bot commented on DRILL-5507:
---------------------------------------
Github user vrozov commented on a diff in the pull request:
https://github.com/apache/drill/pull/911#discussion_r133838104
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/store/schedule/BlockMapBuilder.java
---
@@ -228,6 +230,7 @@ public EndpointByteMap getEndpointByteMap(FileWork
work) throws IOException {
// Find submap of ranges that intersect with the rowGroup
ImmutableRangeMap<Long,BlockLocation> subRangeMap =
blockMap.subRangeMap(rowGroupRange);
+ Set<String> noDrillbitHosts = Sets.newHashSet();
--- End diff --
Consider `final Set<String> noDrillbitHosts = logger.isDebugEnabled() ?
Sets.newHashSet() : null;`
> Millions of "Failure finding Drillbit running on host" info messages in
> foreman logs
> ------------------------------------------------------------------------------------
>
> Key: DRILL-5507
> URL: https://issues.apache.org/jira/browse/DRILL-5507
> Project: Apache Drill
> Issue Type: Bug
> Components: Query Planning & Optimization
> Affects Versions: 1.10.0
> Reporter: Veera Naranammalpuram
> Assignee: Timothy Farkas
>
> When foreman tries to execute a query with data files that reside on nodes
> other than the nodes that are running drillbits, there are millions of
> messages in the log files like this:
> 2017-05-10 13:22:10,916 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0535.mydomain.com. Skipping affinity to that host.
> After 200 MB of these messages, 960K of them and 7 seconds of planning, it
> continues to execute this query. Is there a way to disable / suppress these
> messages? What's causing this? Should this be printed with INFO logging as
> we're seeing or only with DEBUG logging? Is there a way to turn off this
> check? Below is a snippet from foreman logs:
> 2017-05-10 13:22:10,916 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0535.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1402.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0929.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1098.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1230.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1388.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0535.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1291.mydomain.com. Skipping affinity to that host.
> The hostname and domain are scrubbed.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
