[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HADOOP-11295: - Fix Version/s: 2.6.1 Pulled this into 2.6.1 following [~ajisakaa]'s patch. Ran compilation and TestRPC before the push. > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma >Assignee: Ming Ma > Labels: 2.6.1-candidate > Fix For: 2.6.1, 2.7.0 > > Attachments: HADOOP-11295-2.patch, HADOOP-11295-3.patch, > HADOOP-11295-4.patch, HADOOP-11295-5.patch, HADOOP-11295.006.patch, > HADOOP-11295.branch-2.6.patch, HADOOP-11295.patch > > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HADOOP-11295: --- Attachment: HADOOP-11295.branch-2.6.patch Rebased the patch for branch-2.6. > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma >Assignee: Ming Ma > Labels: 2.6.1-candidate > Fix For: 2.7.0 > > Attachments: HADOOP-11295-2.patch, HADOOP-11295-3.patch, > HADOOP-11295-4.patch, HADOOP-11295-5.patch, HADOOP-11295.006.patch, > HADOOP-11295.branch-2.6.patch, HADOOP-11295.patch > > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HADOOP-11295: - Labels: 2.6.1-candidate (was: ) > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma >Assignee: Ming Ma > Labels: 2.6.1-candidate > Fix For: 2.7.0 > > Attachments: HADOOP-11295-2.patch, HADOOP-11295-3.patch, > HADOOP-11295-4.patch, HADOOP-11295-5.patch, HADOOP-11295.006.patch, > HADOOP-11295.patch > > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HADOOP-11295: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed to trunk and branch-2. > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma >Assignee: Ming Ma > Fix For: 2.7.0 > > Attachments: HADOOP-11295-2.patch, HADOOP-11295-3.patch, > HADOOP-11295-4.patch, HADOOP-11295-5.patch, HADOOP-11295.006.patch, > HADOOP-11295.patch > > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated HADOOP-11295: --- Attachment: HADOOP-11295.006.patch Incorporating Ming's suggestion in 006. I am +1 for this version since it's non-invasive. [~daryn], do you mind handling your suggestion in a separate JIRA? > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma >Assignee: Ming Ma > Attachments: HADOOP-11295-2.patch, HADOOP-11295-3.patch, > HADOOP-11295-4.patch, HADOOP-11295-5.patch, HADOOP-11295.006.patch, > HADOOP-11295.patch > > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated HADOOP-11295: --- Attachment: HADOOP-11295-5.patch relaxed ConnectException to IOException as the expected exception. > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma >Assignee: Ming Ma > Attachments: HADOOP-11295-2.patch, HADOOP-11295-3.patch, > HADOOP-11295-4.patch, HADOOP-11295-5.patch, HADOOP-11295.patch > > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated HADOOP-11295: --- Attachment: HADOOP-11295-4.patch [~mingma], I took the liberty to incorporate my nit comments myself while you are on a break. Let me know whether it looks good to you when get a chance. It would also be good if some other committer takes a look as well. > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma >Assignee: Ming Ma > Attachments: HADOOP-11295-2.patch, HADOOP-11295-3.patch, > HADOOP-11295-4.patch, HADOOP-11295.patch > > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Attachment: HADOOP-11295-3.patch Thanks [~jira.shegalov] and [~sjlee0]. Here is the updated patch to address all the comments. > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma >Assignee: Ming Ma > Attachments: HADOOP-11295-2.patch, HADOOP-11295-3.patch, > HADOOP-11295.patch > > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Attachment: HADOOP-11295-2.patch Rebased for trunk. Appreciate any input. > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma >Assignee: Ming Ma > Attachments: HADOOP-11295-2.patch, HADOOP-11295.patch > > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Assignee: Ming Ma Status: Patch Available (was: Open) > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma >Assignee: Ming Ma > Attachments: HADOOP-11295.patch > > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Attachment: HADOOP-11295.patch The fix is to interrupt the reader threads when RPC Server is stopped. > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma > Attachments: HADOOP-11295.patch > > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Summary: RPC Server Reader thread can't shutdown if RPCCallQueue is full (was: RPC Reader thread can't be shutdowned if RPCCallQueue is full) > RPC Server Reader thread can't shutdown if RPCCallQueue is full > --- > > Key: HADOOP-11295 > URL: https://issues.apache.org/jira/browse/HADOOP-11295 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ming Ma > > If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} > will just wait there. That is because > 1. The reader thread is blocked on {{callQueue.put(call);}}. > 2. When RPC server is asked to stop, it will interrupt all handler threads > and thus no threads will drain the callQueue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)