[ https://issues.apache.org/jira/browse/HADOOP-16618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17259830#comment-17259830 ]
Steve Loughran commented on HADOOP-16618: ----------------------------------------- also: socket buffer sizes > increase the default number of threads and http connections in S3A > ------------------------------------------------------------------ > > Key: HADOOP-16618 > URL: https://issues.apache.org/jira/browse/HADOOP-16618 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 > Affects Versions: 3.2.1 > Reporter: Steve Loughran > Priority: Major > > Enable bigger thread and http pools in the S3A connector, especially now that > the transfer manager is doing parallel block transfer, as is rename() > We can make a lot more with parallelism in a single thread, and for > applications with multiple worker threads, we need bigger defaults -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org