[jira] [Commented] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2015-02-17 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325108#comment-14325108 ] Ming Ma commented on HADOOP-11295: -- Thanks, Gera, Sangjin, Daryn and Kihwal. > RPC Ser

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2015-03-05 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349649#comment-14349649 ] Ming Ma commented on HADOOP-10597: -- Thanks, [~arpitagarwal]. We have been using "no ser

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2015-03-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358142#comment-14358142 ] Ming Ma commented on HADOOP-10597: -- bq. Did you use the same trigger on the server in p

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2015-04-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597-5.patch Updated patch based on Arpit's suggestion of removing the server side r

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2015-04-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597-6.patch Here is the updated patch with Steve's suggestion. Thanks, Steve and Ar

[jira] [Updated] (HADOOP-10597) RPC Server signals backoff to clients when all request queues are full

2015-04-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Release Note: This change introduces a new configuration key used by RPC server to decide whether to sen

[jira] [Commented] (HADOOP-10597) RPC Server signals backoff to clients when all request queues are full

2015-04-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1451#comment-1451 ] Ming Ma commented on HADOOP-10597: -- I have updated the release note. Thanks for your su

[jira] [Created] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-04 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-11916: Summary: TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug Key: HADOOP-11916 URL: https://issues.apache.org/jira/browse/HADOOP-11916 Project: Hadoop Com

[jira] [Updated] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11916: - Description: The test fails with the below exception. It turns out there is a JVM bug for MAC, http://b

[jira] [Updated] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11916: - Status: Patch Available (was: Open) > TestStringUtils#testLowerAndUpperStrings failed on MAC due to a J

[jira] [Updated] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11916: - Attachment: HADOOP-11916.patch Attach a patch to skip the test on MAC. > TestStringUtils#testLowerAndUp

[jira] [Commented] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527927#comment-14527927 ] Ming Ma commented on HADOOP-11916: -- Thanks [~ozawa]. > TestStringUtils#testLowerAndUpp

[jira] [Commented] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14540072#comment-14540072 ] Ming Ma commented on HADOOP-11916: -- Thanks [~jira.shegalov] for the good point. Sorry d

[jira] [Commented] (HADOOP-11924) Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init

2015-05-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14541172#comment-14541172 ] Ming Ma commented on HADOOP-11924: -- Thanks [~jira.shegalov] for the suggestion and [~oz

[jira] [Updated] (HADOOP-12789) log classpath of ApplicationClassLoader at INFO level

2016-03-07 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-12789: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.6.5 2.7.3

[jira] [Created] (HADOOP-13029) Have FairCallQueue try all lower priority sub queues before backoff

2016-04-15 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-13029: Summary: Have FairCallQueue try all lower priority sub queues before backoff Key: HADOOP-13029 URL: https://issues.apache.org/jira/browse/HADOOP-13029 Project: Hadoop Common

[jira] [Commented] (HADOOP-13029) Have FairCallQueue try all lower priority sub queues before backoff

2016-04-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252286#comment-15252286 ] Ming Ma commented on HADOOP-13029: -- Thanks [~daryn]! Here is the issue we had that moti

[jira] [Commented] (HADOOP-13065) Add a new interface for retrieving FS and FC Statistics

2016-05-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284969#comment-15284969 ] Ming Ma commented on HADOOP-13065: -- A minor note, given HDFS-9579 is only available in

[jira] [Commented] (HADOOP-13065) Add a new interface for retrieving FS and FC Statistics

2016-05-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289689#comment-15289689 ] Ming Ma commented on HADOOP-13065: -- [~liuml07] [~cmccabe], yeah the perf could be an is

[jira] [Commented] (HADOOP-12326) Implement ChecksumFileSystem#getFileChecksum equivalent to HDFS for easy check

2016-02-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145849#comment-15145849 ] Ming Ma commented on HADOOP-12326: -- Thanks [~jira.shegalov] for this useful feature. *

[jira] [Commented] (HADOOP-12077) Provide a multi-URI replication Inode for ViewFs

2017-08-07 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117109#comment-16117109 ] Ming Ma commented on HADOOP-12077: -- There are couple fixes either we need or have been

[jira] [Commented] (HADOOP-10597) RPC Server signals backoff to clients when all request queues are full

2016-10-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15620110#comment-15620110 ] Ming Ma commented on HADOOP-10597: -- [~zhz] that sounds good. Thank you. > RPC Server s

[jira] [Commented] (HADOOP-13031) Refactor rack-aware counters from FileSystemStorageStatistics to HFDS specific StorageStatistics

2016-06-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317565#comment-15317565 ] Ming Ma commented on HADOOP-13031: -- Thanks [~liuml07]. Do you have a MAPREDUCE jira to

[jira] [Commented] (HADOOP-13189) FairCallQueue makes callQueue larger than the configured capacity.

2016-06-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322007#comment-15322007 ] Ming Ma commented on HADOOP-13189: -- Thanks [~shv], [~redvine]. That seems reasonable. A

[jira] [Commented] (HADOOP-12910) Add new FileSystem API to support asynchronous method calls

2016-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15323214#comment-15323214 ] Ming Ma commented on HADOOP-12910: -- The community has added support for classloader iso

[jira] [Commented] (HADOOP-13189) FairCallQueue makes callQueue larger than the configured capacity.

2016-06-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325511#comment-15325511 ] Ming Ma commented on HADOOP-13189: -- Thanks Konstantin. Did you use https://issues.apac

[jira] [Commented] (HADOOP-13189) FairCallQueue makes callQueue larger than the configured capacity.

2016-06-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330927#comment-15330927 ] Ming Ma commented on HADOOP-13189: -- [~shv], the reason I asked is refreshCallQueue shou

[jira] [Commented] (HADOOP-13189) FairCallQueue makes callQueue larger than the configured capacity.

2016-06-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332608#comment-15332608 ] Ming Ma commented on HADOOP-13189: -- Sounds good. [~shv] please go ahead and thank you.

[jira] [Commented] (HADOOP-13031) Rack-aware read bytes stats should be managed by HFDS specific StorageStatistics

2016-08-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413681#comment-15413681 ] Ming Ma commented on HADOOP-13031: -- [~liuml07], any update on this? Given no values are

[jira] [Commented] (HADOOP-12107) long running apps may have a huge number of StatisticsData instances under FileSystem

2015-06-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14596117#comment-14596117 ] Ming Ma commented on HADOOP-12107: -- Thanks, [~sjlee0], great find. It overall looks goo

[jira] [Commented] (HADOOP-12107) long running apps may have a huge number of StatisticsData instances under FileSystem

2015-06-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598388#comment-14598388 ] Ming Ma commented on HADOOP-12107: -- Thanks [~sjlee0]. Latest patch LGTM. [~cmccabe], [~

[jira] [Commented] (HADOOP-12107) long running apps may have a huge number of StatisticsData instances under FileSystem

2015-06-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606509#comment-14606509 ] Ming Ma commented on HADOOP-12107: -- I have committed this to trunk and branch-2. Thanks

[jira] [Updated] (HADOOP-12107) long running apps may have a huge number of StatisticsData instances under FileSystem

2015-06-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-12107: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) > long

[jira] [Commented] (HADOOP-12107) long running apps may have a huge number of StatisticsData instances under FileSystem

2015-06-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606514#comment-14606514 ] Ming Ma commented on HADOOP-12107: -- Also thanks for [~walter.k.su] and [~sandyr] for th

[jira] [Commented] (HADOOP-12250) Enable RPC Congestion control by default

2015-07-17 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14632180#comment-14632180 ] Ming Ma commented on HADOOP-12250: -- [~arpitagarwal]. That sounds good. * Are you going

[jira] [Commented] (HADOOP-10598) Support configurable RPC fair share

2015-09-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14734965#comment-14734965 ] Ming Ma commented on HADOOP-10598: -- Thanks, [~zhangyongxyz]. You are welcome to take it

[jira] [Commented] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2015-09-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14908821#comment-14908821 ] Ming Ma commented on HADOOP-11295: -- Good catch [~xiaochen]! Please go ahead to attach y

[jira] [Updated] (HADOOP-12440) TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down

2015-09-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-12440: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) +1. Th

[jira] [Created] (HADOOP-8706) Provide rate metrics based on counter value

2012-08-15 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-8706: --- Summary: Provide rate metrics based on counter value Key: HADOOP-8706 URL: https://issues.apache.org/jira/browse/HADOOP-8706 Project: Hadoop Common Issue Type: Improve

[jira] [Updated] (HADOOP-8706) Provide rate metrics based on counter value

2012-08-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-8706: Attachment: HADOOP-8706.patch Here is the patch. It defines a new metrics type MutableCounterLongRate. Fo

[jira] [Commented] (HADOOP-8706) Provide rate metrics based on counter value

2012-08-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436554#comment-13436554 ] Ming Ma commented on HADOOP-8706: - @Aaron, It seems MutableRate is used to collect things

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-09-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: MoreRPCClientBackoffEvaluation.pdf Here are some more evaluation results to compare FIFO RPC

[jira] [Commented] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol

2014-10-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167400#comment-14167400 ] Ming Ma commented on HADOOP-10376: -- Interesting work. There is org.apache.hadoop.conf.R

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-10-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171966#comment-14171966 ] Ming Ma commented on HADOOP-10597: -- Thanks, Chris. 1. The first two experiments belong

[jira] [Commented] (HADOOP-11252) RPC client write does not time out by default

2014-10-31 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191944#comment-14191944 ] Ming Ma commented on HADOOP-11252: -- Agree with Wilfred that we should fix it in hadoop-

[jira] [Commented] (HADOOP-11252) RPC client write does not time out by default

2014-11-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205152#comment-14205152 ] Ming Ma commented on HADOOP-11252: -- Should we use another name other than {{ipc.client.

[jira] [Created] (HADOOP-11295) RPC Reader thread can't be shutdowned if RPCCallQueue is full

2014-11-10 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-11295: Summary: RPC Reader thread can't be shutdowned if RPCCallQueue is full Key: HADOOP-11295 URL: https://issues.apache.org/jira/browse/HADOOP-11295 Project: Hadoop Common

[jira] [Commented] (HADOOP-11252) RPC client write does not time out by default

2014-11-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206707#comment-14206707 ] Ming Ma commented on HADOOP-11252: -- [~wilfreds], are you working on this? If not, I can

[jira] [Updated] (HADOOP-11295) RPC Reader thread can't be shutdowned if RPCCallQueue is full

2014-11-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Description: If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} will just wait

[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2014-11-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Summary: RPC Server Reader thread can't shutdown if RPCCallQueue is full (was: RPC Reader thread can't

[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2014-11-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Attachment: HADOOP-11295.patch The fix is to interrupt the reader threads when RPC Server is stopped. >

[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2014-11-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Assignee: Ming Ma Status: Patch Available (was: Open) > RPC Server Reader thread can't shutdown i

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-11-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208955#comment-14208955 ] Ming Ma commented on HADOOP-10597: -- Thanks, Chris. The backoff retry policy is defined

[jira] [Created] (HADOOP-11305) RM might not start if the machine was hard shutdown and FileSystemRMStateStore was used

2014-11-13 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-11305: Summary: RM might not start if the machine was hard shutdown and FileSystemRMStateStore was used Key: HADOOP-11305 URL: https://issues.apache.org/jira/browse/HADOOP-11305 Pro

[jira] [Commented] (HADOOP-11252) RPC client write does not time out by default

2014-12-01 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14229964#comment-14229964 ] Ming Ma commented on HADOOP-11252: -- Thanks, [~wilfreds]. Yes, it should cover all the c

[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2014-12-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Attachment: HADOOP-11295-2.patch Rebased for trunk. Appreciate any input. > RPC Server Reader thread ca

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-12-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597-3.patch Rebased for trunk and address Chris' comments. Appreciate if [~ste...@

[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2014-12-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Attachment: HADOOP-11295-3.patch Thanks [~jira.shegalov] and [~sjlee0]. Here is the updated patch to add

[jira] [Commented] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2015-01-05 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14265054#comment-14265054 ] Ming Ma commented on HADOOP-11295: -- Thanks, [~jira.shegalov]! Good idea to use Executor

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2015-01-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597-4.patch Thanks, [~ste...@apache.org]! Here is the new patch with your suggestio

[jira] [Updated] (HADOOP-10668) TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails

2015-01-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10668: - Attachment: HADOOP-10668.patch It appears the check whether a node is in the right state could be the is

[jira] [Updated] (HADOOP-10668) TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails

2015-01-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10668: - Assignee: Ming Ma Status: Patch Available (was: Open) > TestZKFailoverControllerStress#testExpire

[jira] [Commented] (HADOOP-10668) TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails

2015-01-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14278974#comment-14278974 ] Ming Ma commented on HADOOP-10668: -- Anyone has time to review this? It has been verifie

[jira] [Updated] (HADOOP-10668) TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails

2015-01-20 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10668: - Attachment: HADOOP-10668-2.patch Thanks, Chris. Sorry, I didn't update {{TestZKFailoverController}} test

[jira] [Commented] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2015-02-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306746#comment-14306746 ] Ming Ma commented on HADOOP-11295: -- Thanks, [~daryn]. Yes, we can change the shutdown o

[jira] [Commented] (HADOOP-11000) HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING

2015-02-17 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324504#comment-14324504 ] Ming Ma commented on HADOOP-11000: -- Thanks, Sangjin, Vinay and Chris. > HAServiceProto

[jira] [Created] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-05-12 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10597: Summary: Evaluate if we can have RPC client back off when server is under heavy load Key: HADOOP-10597 URL: https://issues.apache.org/jira/browse/HADOOP-10597 Project: Hadoop

[jira] [Created] (HADOOP-10599) Support prioritization of DN RPCs over client RPCs

2014-05-12 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10599: Summary: Support prioritization of DN RPCs over client RPCs Key: HADOOP-10599 URL: https://issues.apache.org/jira/browse/HADOOP-10599 Project: Hadoop Common Issue Ty

[jira] [Created] (HADOOP-10598) Support configurable RPC fair share

2014-05-13 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10598: Summary: Support configurable RPC fair share Key: HADOOP-10598 URL: https://issues.apache.org/jira/browse/HADOOP-10598 Project: Hadoop Common Issue Type: Sub-task

[jira] [Commented] (HADOOP-9640) RPC Congestion Control with FairCallQueue

2014-05-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14002801#comment-14002801 ] Ming Ma commented on HADOOP-9640: - Sorry, there was a typo about, I meant "thousands of R

[jira] [Moved] (HADOOP-10657) Have RetryInvocationHandler log failover attempt at INFO level

2014-06-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma moved HDFS-6477 to HADOOP-10657: Key: HADOOP-10657 (was: HDFS-6477) Project: Hadoop Common (was: Hadoop H

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-06-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597.patch Steve, thanks for the suggestions. Yes, it is useful to have server prov

[jira] [Assigned] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-06-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reassigned HADOOP-10597: Assignee: Ming Ma > Evaluate if we can have RPC client back off when server is under heavy load >

[jira] [Assigned] (HADOOP-10657) Have RetryInvocationHandler log failover attempt at INFO level

2014-06-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reassigned HADOOP-10657: Assignee: Ming Ma > Have RetryInvocationHandler log failover attempt at INFO level >

[jira] [Updated] (HADOOP-10657) Have RetryInvocationHandler log failover attempt at INFO level

2014-06-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10657: - Attachment: HADOOP-10657.patch Here is the patch. > Have RetryInvocationHandler log failover attempt a

[jira] [Updated] (HADOOP-10657) Have RetryInvocationHandler log failover attempt at INFO level

2014-06-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10657: - Status: Patch Available (was: Open) > Have RetryInvocationHandler log failover attempt at INFO level >

[jira] [Created] (HADOOP-10673) Update rpc metrics when the call throw an exception

2014-06-09 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10673: Summary: Update rpc metrics when the call throw an exception Key: HADOOP-10673 URL: https://issues.apache.org/jira/browse/HADOOP-10673 Project: Hadoop Common Issue T

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throw an exception

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Attachment: HADOOP-10673.patch The patch updates the existing rpc metrics in the case of exception. HDF

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throw an exception

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Status: Patch Available (was: Open) > Update rpc metrics when the call throw an exception > --

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throws an exception

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Summary: Update rpc metrics when the call throws an exception (was: Update rpc metrics when the call t

[jira] [Updated] (HADOOP-10657) Have RetryInvocationHandler log failover attempt at INFO level

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10657: - Attachment: HADOOP-10657-2.patch Thanks, Jing. Yeah, it isn't necessary in this case. New patch uploade

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throws an exception

2014-06-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Attachment: HADOOP-10673-2.patch Thanks, Gera. Here is the updated patch. For RpcMetrics, it doesn't di

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throws an exception

2014-06-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Attachment: HADOOP-10673-4.patch Updates with unit test. > Update rpc metrics when the call throws an

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throws an exception

2014-06-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Attachment: HADOOP-10673-5.patch Thanks, Tsuyoshi. Here is the updated patch that makes the variables

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throws an exception

2014-06-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Attachment: HADOOP-10673-6.patch Thanks, Tsuyoshi. [~lohit] asked a good question how the increase of t

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-07-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597-2.patch RPCClientBackoffDesignAndEvaluation.pdf [~lohit] provi

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-07-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Status: Patch Available (was: Open) > Evaluate if we can have RPC client back off when server is under

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-07-31 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14081950#comment-14081950 ] Ming Ma commented on HADOOP-10597: -- Thanks, Jing and Arpit. 1. In the current implemen

[jira] [Created] (HADOOP-11000) HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING

2014-08-25 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-11000: Summary: HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING Key: HADOOP-11000 URL: https://issues.apache.org/jira/browse/HADOOP-11000 Proj

[jira] [Updated] (HADOOP-11000) HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING

2014-08-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11000: - Attachment: HADOOP-11000.patch Here is the draft patch. 1. Catch HealthCheckFailedException properly.

[jira] [Updated] (HADOOP-11000) HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING

2014-08-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11000: - Assignee: Ming Ma Status: Patch Available (was: Open) > HAServiceProtocol's health state is inco

[jira] [Updated] (HADOOP-11000) HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING

2014-08-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11000: - Attachment: HADOOP-11000-2.patch Thanks, Sangjin. Here is the updated patch. > HAServiceProtocol's hea

[jira] [Created] (HADOOP-10106) Incorrect thread name RPC log message

2013-11-15 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10106: Summary: Incorrect thread name RPC log message Key: HADOOP-10106 URL: https://issues.apache.org/jira/browse/HADOOP-10106 Project: Hadoop Common Issue Type: Bug

[jira] [Updated] (HADOOP-10106) Incorrect thread name RPC log message

2013-11-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10106: - Attachment: hadoop_10106_trunk.patch The fix is to move doRead method from Listener to Reader as that i

[jira] [Updated] (HADOOP-10106) Incorrect thread name in RPC log messages

2013-11-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10106: - Summary: Incorrect thread name in RPC log messages (was: Incorrect thread name RPC log message) > Inc

[jira] [Updated] (HADOOP-10106) Incorrect thread name in RPC log messages

2013-11-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10106: - Fix Version/s: 2.2.1 3.0.0 Affects Version/s: 3.0.0

[jira] [Updated] (HADOOP-10106) Incorrect thread name in RPC log messages

2013-11-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10106: - Status: Open (was: Patch Available) > Incorrect thread name in RPC log messages >

[jira] [Updated] (HADOOP-10106) Incorrect thread name in RPC log messages

2013-11-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10106: - Fix Version/s: (was: 2.2.1) (was: 3.0.0) Affects Version/s: (

[jira] [Created] (HADOOP-10125) no need to process RPC request if the client connection has been dropped

2013-11-22 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10125: Summary: no need to process RPC request if the client connection has been dropped Key: HADOOP-10125 URL: https://issues.apache.org/jira/browse/HADOOP-10125 Project: Hadoop Co

[jira] [Updated] (HADOOP-10125) no need to process RPC request if the client connection has been dropped

2013-11-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10125: - Attachment: hadoop_10125_trunk.patch Here is the patch. > no need to process RPC request if the client

  1   2   >