On Sat, Apr 21, 2018 at 01:49:37PM +0300, Slawa Olhovchenkov wrote: > On Fri, Apr 20, 2018 at 09:01:24PM +0200, Willy Tarreau wrote: > > So between these two the traffic is perfectly balanced. I don't see why you > > wouldn't have other threads :-/ > > > > Well, let's try something. In your global section you have a "stats socket > > ..." > > with a path. Please replicate this line to have 8 more of them, all with a > > different path (eg: /var/run/haproxy-stats becomes haproxy-stats1, -stats2 > > etc) > > and with a different thread binding using "process" like this : > > > > stats socket /var/run/haproxy-stats1 level admin process 1/1 > > stats socket /var/run/haproxy-stats2 level admin process 1/2 > > stats socket /var/run/haproxy-stats3 level admin process 1/3 > > ... > > stats socket /var/run/haproxy-stats8 level admin process 1/8 > > > > Then you can use the same command as above to dump exactly one thread's > > activity by connecting to each of these sockets. We definitely need to > > understand what the other threads are doing. > > Ok, I am need run haproxy some time for data collected.
CPU 0 busy 0.157 CPU 1 busy 0.152 CPU 2 busy 0.310 CPU 3 busy 0.066 CPU 4 busy 1.000 CPU 5 busy 0.121 CPU 6 busy 0.192 CPU 7 busy 0.113 thread_id: 0 date_now: 1524313534.115247 loops: 66424562 83705569 78330851 71825493 4167226792 55628229 71817734 60724445 wake_cache: 52201818 67368217 58714979 59561441 53544828 44243855 55942568 48557377 wake_tasks: 18895 20222 56518 2747 1520931 10796 27060 9580 wake_applets: 0 0 0 0 0 0 0 0 wake_signal: 0 0 0 0 0 0 0 0 poll_exp: 52220713 67388439 58771497 59564188 55065759 44254651 55969629 48566957 poll_drop: 723939 768818 1764587 185641 2927770 487536 961682 444577 poll_dead: 0 0 0 0 0 0 0 0 poll_skip: 0 0 0 0 0 0 0 0 fd_skip: 143690404 174627919 128462505 175642444 3334687603 131482878 144832583 140898515 fd_lock: 14655256 19798865 12089409 19499729 5854069 13965072 15181602 15814869 fd_del: 3524764 3669106 10697061 922788 21745990 2268134 4917603 2065821 conn_dead: 0 0 0 0 0 0 0 0 stream: 10509732 11021411 25600986 2691749 42283170 7046275 14032863 6425591 empty_rq: 56576932 73357896 56939370 69159212 4135587230 48885244 58976317 54537901 long_rq: 0 0 1 0 0 0 0 0 thread_id: 1 date_now: 1524313535.370569 loops: 66438875 83723606 78346936 71840543 4168088150 55640066 71833423 60737287 wake_cache: 52212998 67382756 58727075 59573919 53555679 44253219 55954839 48567597 wake_tasks: 18899 20226 56528 2747 1521253 10800 27064 9582 wake_applets: 1 0 0 0 0 0 0 0 wake_signal: 0 0 0 0 0 0 0 0 poll_exp: 52231898 67402982 58783603 59576666 55076932 44264019 55981903 48577179 poll_drop: 724088 768988 1764975 185678 2928369 487641 961887 444677 poll_dead: 0 0 0 0 0 0 0 0 poll_skip: 0 0 0 0 0 0 0 0 fd_skip: 143724089 174669299 128490764 175682383 3335372203 131512812 144866951 140930667 fd_lock: 14658166 19803061 12091915 19503727 5855202 13967928 15184888 15818053 fd_del: 3525575 3669952 10699097 922967 21750761 2268601 4918622 2066311 conn_dead: 0 0 0 0 0 0 0 0 stream: 10512212 11023828 25606051 2692269 42292064 7047780 14035851 6426995 empty_rq: 56588926 73373698 56951199 69173741 4136442163 48895637 58989271 54549419 long_rq: 0 0 1 0 0 0 0 0 thread_id: 2 date_now: 1524313536.610701 loops: 66453275 83741543 78363006 71856351 4168947490 55652301 71849260 60750409 wake_cache: 52224306 67397211 58739080 59587068 53566746 44262947 55967245 48578087 wake_tasks: 18901 20233 56536 2749 1521568 10806 27071 9583 wake_applets: 1 0 0 0 0 0 0 0 wake_signal: 0 0 0 0 0 0 0 0 poll_exp: 52243208 67417444 58795616 59589817 55088315 44273753 55994316 48587670 poll_drop: 724263 769166 1765357 185729 2929019 487735 962100 444776 poll_dead: 0 0 0 0 0 0 0 0 poll_skip: 0 0 0 0 0 0 0 0 fd_skip: 143756034 174708123 128517933 175722201 3336046052 131541795 144900333 140960645 fd_lock: 14661294 19807408 12094422 19508054 5856293 13970878 15188234 15821536 fd_del: 3526315 3670717 10701258 923151 21755507 2269057 4919610 2066708 conn_dead: 0 0 0 0 0 0 0 0 stream: 10514443 11026025 25611169 2692814 42301072 7049333 14038738 6428295 empty_rq: 56601219 73389575 56963030 69189018 4137294812 48906380 59002461 54561285 long_rq: 0 0 1 0 0 0 0 0 thread_id: 3 date_now: 1524313537.818126 loops: 66467365 83758678 78379368 71871265 4169864355 55663353 71863823 60763129 wake_cache: 52235329 67410965 58751359 59599397 53578313 44271729 55978634 48588279 wake_tasks: 18906 20236 56544 2749 1521909 10812 27076 9584 wake_applets: 1 0 0 0 0 0 0 0 wake_signal: 0 0 0 0 0 0 0 0 poll_exp: 52254236 67431203 58807906 59602146 55100222 44282544 56005712 48597863 poll_drop: 724427 769342 1765705 185772 2929622 487826 962303 444871 poll_dead: 0 0 0 0 0 0 0 0 poll_skip: 0 0 0 0 0 0 0 0 fd_skip: 143782633 174739475 128541333 175754751 3336744909 131564998 144927599 140987051 fd_lock: 14664389 19811604 12097103 19512234 5857664 13973748 15191632 15825045 fd_del: 3527070 3671472 10703375 923359 21759644 2269456 4920468 2067088 conn_dead: 0 0 0 0 0 0 0 0 stream: 10516755 11028316 25616203 2693387 42309675 7050697 14041305 6429547 empty_rq: 56613131 73404561 56975152 69203363 4138204982 48916119 59014666 54572779 long_rq: 0 0 1 0 0 0 0 0 thread_id: 4 date_now: 1524313539.314486 loops: 66484720 83779958 78399675 71889314 4170959374 55677222 71882212 60779004 wake_cache: 52248990 67428023 58766576 59614381 53592245 44282764 55992997 48600978 wake_tasks: 18908 20242 56557 2750 1522324 10815 27080 9585 wake_applets: 1 0 0 0 0 0 0 0 wake_signal: 0 0 0 0 0 0 0 0 poll_exp: 52267899 67448265 58823133 59617131 55114569 44293579 56020077 48610563 poll_drop: 724586 769539 1766139 185817 2930362 487969 962538 444986 poll_dead: 0 0 0 0 0 0 0 0 poll_skip: 0 0 0 0 0 0 0 0 fd_skip: 143818638 174782362 128573297 175797993 3337621380 131596833 144964195 141022427 fd_lock: 14668249 19816647 12100250 19517289 5859224 13977391 15195618 15829234 fd_del: 3527918 3672437 10706031 923559 21764960 2269990 4921597 2067643 conn_dead: 0 0 0 0 0 0 0 0 stream: 10519514 11031222 25622755 2693978 42320354 7052440 14044798 6431245 empty_rq: 56627889 73423126 56989948 69220828 4139291831 48928343 59029856 54587023 long_rq: 0 0 1 0 0 0 0 0 thread_id: 5 date_now: 1524313540.714581 loops: 66500919 83800074 78417363 71906340 4171966389 55690276 71899425 60793480 wake_cache: 52261671 67444223 58779794 59628525 53605027 44293113 56006380 48612511 wake_tasks: 18912 20245 56569 2750 1522687 10818 27085 9587 wake_applets: 1 0 0 0 0 1 0 0 wake_signal: 0 0 0 0 0 0 0 0 poll_exp: 52280584 67464468 58836364 59631275 55127714 44303932 56033465 48622098 poll_drop: 724759 769726 1766542 185860 2931111 488087 962780 445096 poll_dead: 0 0 0 0 0 0 0 0 poll_skip: 0 0 0 0 0 0 0 0 fd_skip: 143853465 174825031 128601934 175840626 3338414286 131626610 144999016 141056628 fd_lock: 14671851 19821530 12103094 19521877 5860660 13980712 15199273 15833040 fd_del: 3528751 3673291 10708483 923740 21770118 2270495 4922775 2068149 conn_dead: 0 0 0 0 0 0 0 0 stream: 10522151 11033796 25628517 2694548 42330369 7054127 14048138 6432884 empty_rq: 56641593 73440797 57002881 69237291 4140291361 48939791 59043999 54599923 long_rq: 0 0 1 0 0 0 0 0 thread_id: 6 date_now: 1524313541.946113 loops: 66515138 83817566 78433351 71921229 4172837155 55702091 71914628 60806076 wake_cache: 52272792 67458309 58791661 59640865 53616162 44302505 56018215 48622534 wake_tasks: 18913 20253 56582 2750 1523002 10821 27092 9589 wake_applets: 1 0 0 0 0 1 0 0 wake_signal: 0 0 0 0 0 0 0 0 poll_exp: 52291706 67478562 58848243 59643615 55139164 44313327 56045307 48632123 poll_drop: 724930 769892 1766910 185890 2931735 488190 962976 445190 poll_dead: 0 0 0 0 0 0 0 0 poll_skip: 0 0 0 0 0 0 0 0 fd_skip: 143884103 174862165 128627957 175877182 3339054406 131653935 145030155 141086152 fd_lock: 14674966 19825762 12105509 19526075 5861882 13983660 15202524 15836300 fd_del: 3529443 3673976 10710550 923916 21774755 2270954 4923736 2068593 conn_dead: 0 0 0 0 0 0 0 0 stream: 10524435 11035988 25633650 2695030 42339374 7055586 14050996 6434205 empty_rq: 56653651 73456208 57014532 69251698 4141155472 48950198 59056538 54611245 long_rq: 0 0 1 0 0 0 0 0 thread_id: 7 date_now: 1524313543.642275 loops: 66534417 83841861 78454969 71941661 4174043366 55718045 71935212 60823281 wake_cache: 52287915 67477955 58807889 59657785 53631362 44315072 56034328 48636299 wake_tasks: 18919 20258 56596 2751 1523497 10823 27100 9594 wake_applets: 1 0 0 0 0 1 0 0 wake_signal: 0 0 0 0 0 0 0 0 poll_exp: 52306835 67498213 58864485 59660536 55154859 44325896 56061428 48645893 poll_drop: 725140 770105 1767410 185954 2932595 488353 963265 445315 poll_dead: 0 0 0 0 0 0 0 0 poll_skip: 0 0 0 0 0 0 0 0 fd_skip: 143926030 174913873 128663789 175927151 3340087544 131690063 145072611 141125837 fd_lock: 14679180 19831810 12108970 19531657 5863614 13987591 15207006 15840916 fd_del: 3530494 3674894 10713462 924162 21781082 2271684 4925062 2069189 conn_dead: 0 0 0 0 0 0 0 0 stream: 10527586 11038974 25640595 2695741 42351501 7057869 14054951 6435994 empty_rq: 56669974 73477687 57030364 69271418 4142352703 48963968 59073525 54626730 long_rq: 0 0 1 0 0 0 0 0
