[jira] [Updated] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11873: -- Attachment: HDFS-11873-HDFS-7240.004.patch fix checkstyle issue by removing the unused imports. > Ozone: Object store handler cannot serve multiple requests from single http > client > -- > > Key: HDFS-11873 > URL: https://issues.apache.org/jira/browse/HDFS-11873 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone >Reporter: Weiwei Yang >Assignee: Xiaoyu Yao >Priority: Critical > Labels: ozoneMerge > Attachments: HDFS-11873-HDFS-7240.001.patch, > HDFS-11873-HDFS-7240.002.patch, HDFS-11873-HDFS-7240.003.patch, > HDFS-11873-HDFS-7240.004.patch, HDFS-11873-HDFS-7240.testcase.patch > > > This issue was found when I worked on HDFS-11846. Instead of creating a new > http client instance per request, I tried to reuse {{CloseableHttpClient}} in > {{OzoneClient}} class in a {{PoolingHttpClientConnectionManager}}. However, > every second request from the http client hangs, which could not get > dispatched to {{ObjectStoreJerseyContainer}}. There seems to be something > wrong in the netty pipeline, this jira aims to 1) fix the problem in the > server side 2) use the pool for client http clients to reduce the resource > overhead. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11873: -- Attachment: HDFS-11873-HDFS-7240.003.patch > Ozone: Object store handler cannot serve multiple requests from single http > client > -- > > Key: HDFS-11873 > URL: https://issues.apache.org/jira/browse/HDFS-11873 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone >Reporter: Weiwei Yang >Assignee: Xiaoyu Yao >Priority: Critical > Labels: ozoneMerge > Attachments: HDFS-11873-HDFS-7240.001.patch, > HDFS-11873-HDFS-7240.002.patch, HDFS-11873-HDFS-7240.003.patch, > HDFS-11873-HDFS-7240.testcase.patch > > > This issue was found when I worked on HDFS-11846. Instead of creating a new > http client instance per request, I tried to reuse {{CloseableHttpClient}} in > {{OzoneClient}} class in a {{PoolingHttpClientConnectionManager}}. However, > every second request from the http client hangs, which could not get > dispatched to {{ObjectStoreJerseyContainer}}. There seems to be something > wrong in the netty pipeline, this jira aims to 1) fix the problem in the > server side 2) use the pool for client http clients to reduce the resource > overhead. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11873: -- Attachment: HDFS-11873-HDFS-7240.002.patch Attach a patch that fixed the checkstyle issue in the unit tests. > Ozone: Object store handler cannot serve multiple requests from single http > client > -- > > Key: HDFS-11873 > URL: https://issues.apache.org/jira/browse/HDFS-11873 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone >Reporter: Weiwei Yang >Assignee: Xiaoyu Yao >Priority: Critical > Labels: ozoneMerge > Attachments: HDFS-11873-HDFS-7240.001.patch, > HDFS-11873-HDFS-7240.002.patch, HDFS-11873-HDFS-7240.testcase.patch > > > This issue was found when I worked on HDFS-11846. Instead of creating a new > http client instance per request, I tried to reuse {{CloseableHttpClient}} in > {{OzoneClient}} class in a {{PoolingHttpClientConnectionManager}}. However, > every second request from the http client hangs, which could not get > dispatched to {{ObjectStoreJerseyContainer}}. There seems to be something > wrong in the netty pipeline, this jira aims to 1) fix the problem in the > server side 2) use the pool for client http clients to reduce the resource > overhead. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11873: -- Status: Patch Available (was: Open) > Ozone: Object store handler cannot serve multiple requests from single http > client > -- > > Key: HDFS-11873 > URL: https://issues.apache.org/jira/browse/HDFS-11873 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone >Reporter: Weiwei Yang >Assignee: Xiaoyu Yao >Priority: Critical > Labels: ozoneMerge > Attachments: HDFS-11873-HDFS-7240.001.patch, > HDFS-11873-HDFS-7240.testcase.patch > > > This issue was found when I worked on HDFS-11846. Instead of creating a new > http client instance per request, I tried to reuse {{CloseableHttpClient}} in > {{OzoneClient}} class in a {{PoolingHttpClientConnectionManager}}. However, > every second request from the http client hangs, which could not get > dispatched to {{ObjectStoreJerseyContainer}}. There seems to be something > wrong in the netty pipeline, this jira aims to 1) fix the problem in the > server side 2) use the pool for client http clients to reduce the resource > overhead. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11873: -- Attachment: HDFS-11873-HDFS-7240.001.patch Thanks [~cheersyang] for the unit tests. Attach a patch that allows the Netty handler to support the Keep-Alive connection from client. Also update the unit tests with both Apache HttpClient and Netty Http client with Keep-Alive connections. > Ozone: Object store handler cannot serve multiple requests from single http > client > -- > > Key: HDFS-11873 > URL: https://issues.apache.org/jira/browse/HDFS-11873 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone >Reporter: Weiwei Yang >Assignee: Xiaoyu Yao >Priority: Critical > Labels: ozoneMerge > Attachments: HDFS-11873-HDFS-7240.001.patch, > HDFS-11873-HDFS-7240.testcase.patch > > > This issue was found when I worked on HDFS-11846. Instead of creating a new > http client instance per request, I tried to reuse {{CloseableHttpClient}} in > {{OzoneClient}} class in a {{PoolingHttpClientConnectionManager}}. However, > every second request from the http client hangs, which could not get > dispatched to {{ObjectStoreJerseyContainer}}. There seems to be something > wrong in the netty pipeline, this jira aims to 1) fix the problem in the > server side 2) use the pool for client http clients to reduce the resource > overhead. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11873: Labels: ozoneMerge (was: ) > Ozone: Object store handler cannot serve multiple requests from single http > client > -- > > Key: HDFS-11873 > URL: https://issues.apache.org/jira/browse/HDFS-11873 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone >Reporter: Weiwei Yang >Assignee: Xiaoyu Yao >Priority: Critical > Labels: ozoneMerge > Attachments: HDFS-11873-HDFS-7240.testcase.patch > > > This issue was found when I worked on HDFS-11846. Instead of creating a new > http client instance per request, I tried to reuse {{CloseableHttpClient}} in > {{OzoneClient}} class in a {{PoolingHttpClientConnectionManager}}. However, > every second request from the http client hangs, which could not get > dispatched to {{ObjectStoreJerseyContainer}}. There seems to be something > wrong in the netty pipeline, this jira aims to 1) fix the problem in the > server side 2) use the pool for client http clients to reduce the resource > overhead. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11873: Component/s: (was: HDFS-7240) ozone > Ozone: Object store handler cannot serve multiple requests from single http > client > -- > > Key: HDFS-11873 > URL: https://issues.apache.org/jira/browse/HDFS-11873 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone >Reporter: Weiwei Yang >Assignee: Xiaoyu Yao >Priority: Critical > Attachments: HDFS-11873-HDFS-7240.testcase.patch > > > This issue was found when I worked on HDFS-11846. Instead of creating a new > http client instance per request, I tried to reuse {{CloseableHttpClient}} in > {{OzoneClient}} class in a {{PoolingHttpClientConnectionManager}}. However, > every second request from the http client hangs, which could not get > dispatched to {{ObjectStoreJerseyContainer}}. There seems to be something > wrong in the netty pipeline, this jira aims to 1) fix the problem in the > server side 2) use the pool for client http clients to reduce the resource > overhead. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11873: --- Summary: Ozone: Object store handler cannot serve multiple requests from single http client (was: Ozone: Object store handler cannot serve requests from same http client) > Ozone: Object store handler cannot serve multiple requests from single http > client > -- > > Key: HDFS-11873 > URL: https://issues.apache.org/jira/browse/HDFS-11873 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: HDFS-7240 >Reporter: Weiwei Yang >Assignee: Weiwei Yang >Priority: Critical > Attachments: HDFS-11873-HDFS-7240.testcase.patch > > > This issue was found when I worked on HDFS-11846. Instead of creating a new > http client instance per request, I tried to reuse {{CloseableHttpClient}} in > {{OzoneClient}} class in a {{PoolingHttpClientConnectionManager}}. However, > every second request from the http client hangs, which could not get > dispatched to {{ObjectStoreJerseyContainer}}. There seems to be something > wrong in the netty pipeline, this jira aims to 1) fix the problem in the > server side 2) use the pool for client http clients to reduce the resource > overhead. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org