Z0ltrix commented on pull request #2406: URL: https://github.com/apache/drill/pull/2406#issuecomment-996896699
> Hi @vvysotskyi, @Z0ltrix. The two considerations, > > 1. this change is a workaround for buggy IPv6 support in HDFS and > > 2. the workaround is untargeted and could have side effects in some environments because Drill's JVMs get set to prefer IPv4 for every socket they open, whether to HDFS or elsewhere > > > , make me wonder if this should really be promoted to a Drill default. An alternative might be that we create a doc page describing this problem and showing users how to apply the workaround uncovered by @Z0ltrix to their own environments... Hi @jnturton, good Point... What now? How i should continue? This PR or Docs? Regards Christian > Agree with @jnturton and @vvysotskyi. > > But possibly improvements still can be done for the algorithm of closing connections by Drill to avoid: > > > This leads to thousands of CLOSE_WAIT ipv6 connections from Drillbit to Datanode > > @Z0ltrix you can submit a separate ticket for that with details and error log Mmh... I think the ticket https://issues.apache.org/jira/browse/DRILL-8077 is fine, maybe i could change the description to specify the problem more. Logs would be a problem... All systems on the server just said they could not open a new connection because "address already in use" and we saw > 60k ipv6 connections to different hdfs datanodes in state CLOSE_WAIT. Took about a week or longer to occur, depends on number of queries. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
