Mostafa Mokhtar created KUDU-2355:
-------------------------------------
Summary: Uneven assignment o
Key: KUDU-2355
URL: https://issues.apache.org/jira/browse/KUDU-2355
Project: Kudu
Issue Type: Bug
Affects Versions: 1.8.0
Reporter: Mostafa Mokhtar
While running inserts into a Kudu table I noticed that there is an uneven
assignment of work across maintenance threads, this reduces scalability of the
maintenance as more threads won't always mean better throughput.
|Thread name|| Cumulative User CPU(s)|| Cumulative Kernel CPU(s)
||Cumulative IO-wait(s)|
|MaintenanceMgr [worker]-59102| 3410.94| 352.07| 866.71|
|MaintenanceMgr [worker]-59101| 3056.77| 319.32| 794.1|
|MaintenanceMgr [worker]-59100| 2924.29| 300.35| 831.66|
|MaintenanceMgr [worker]-59099| 3021.22| 307.3| 783.84|
|MaintenanceMgr [worker]-59098| 2174.47| 216.55| 716|
|MaintenanceMgr [worker]-59097| 3240.47| 335.55| 846.99|
|MaintenanceMgr [worker]-59096| 2206.57| 218.63| 752.62|
|MaintenanceMgr [worker]-59095| 2112.76| 210.93| 720.67|
Snapshot from top
{code}
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
59102 kudu 20 0 25.3g 15g 11m R 105.0 6.1 64:42.20 MaintenanceMgr
59097 kudu 20 0 25.3g 15g 11m R 101.7 6.1 61:15.90 MaintenanceMgr
59096 kudu 20 0 25.3g 15g 11m R 98.4 6.1 42:12.19 MaintenanceMgr
59098 kudu 20 0 25.3g 15g 11m R 98.4 6.1 41:53.22 MaintenanceMgr
59100 kudu 20 0 25.3g 15g 11m D 36.1 6.1 55:49.99 MaintenanceMgr
59095 kudu 20 0 25.3g 15g 11m D 29.5 6.1 40:34.79 MaintenanceMgr
59099 kudu 20 0 25.3g 15g 11m D 0.0 6.1 57:28.81 MaintenanceMgr
59101 kudu 20 0 25.3g 15g 11m D 0.0 6.1 58:03.63 MaintenanceMgr
{code}
This was found using
kudu 1.8.0-SNAPSHOT (rev e70c5ee0d6d598ba53d002ebfc7f81bb2ceda404)
server uuid bd4cc6fdd79d4ebc8a4def27004b011d
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
