I'm concerned by output of sshare in regard to using DEPTH_OBVLIVIOUS. It
seems the depth of our accounts are causing our primary stakeholder to have
a drastically reduced normalized share value.
Here's output of 'sshare -l' (sorry if distorts readability of this email)
Account User Raw Shares Norm Shares Raw Usage Norm
Usage Effectv Usage FairShare GrpCPUMins CPURunMins
-------------------- ---------- ---------- ----------- -----------
----------- ------------- ---------- ----------- ---------------
root 1.000000 43769249
1.000000 0.870551 11154213
root root 1 0.333333 0
0.000000 0.000000 1.000000 0
grid 1 0.333333 6300
0.000145 0.000145 0.999940 0
cms 10 0.277778 6300
0.000145 0.000000 1.000000 0
suragrid 1 0.027778 0
0.000000 0.000000 1.000000 0
tamu 1 0.333333 43762948
0.999855 0.999855 0.659794 11154213
aglife 10 0.114943 28
0.000001 0.225816 0.761587 0
genomics 10 0.011610 0
0.000000 0.000000 1.000000 0
engineering 1 0.011494 12410
0.000285 0.029560 0.700111 0
pete 10 0.011494 12410
0.000285 0.029560 0.700111 0
general 5 0.057471 44499
0.000939 0.145837 0.703435 112
geo 1 0.011494 0
0.000000 0.000000 1.000000 0
atmo 10 0.011494 0
0.000000 0.000000 1.000000 0
liberalarts 1 0.011494 30971933
0.706947 0.706408 0.000199 10842867
idhmc 128 0.011494 30971933
0.706947 0.706408 0.000199 10842867
mgmt 10 0.114943 18
0.000000 0.222637 0.764512 0
science 1 0.011494 12734058
0.291684 0.291684 0.029661 311234
acad 1 0.000348 0
0.000000 0.000000 1.000000 0
chem 10 0.003483 0
0.000000 0.000000 1.000000 0
iamcs 10 0.003483 3349720
0.076799 0.088341 0.029717 22086
math 10 0.003483 3655568
0.083454 0.088369 0.029684 167191
secant 10 0.000995 0
0.000000 0.000000 1.000000 0
physics 1 0.000348 5728769
0.131431 0.131431 0.000000 121956
hepx 700 0.000348 5728769
0.131431 0.131431 0.000000 121956
stat 1 0.000348 0
0.000000 0.000000 1.000000 0
carroll 10 0.000348 0
0.000000 0.000000 1.000000 0
What concerns me is the FareShare for 'hepx' is 0.0 and is non-zero for
'idhmc' when idhmc has fewer raw shares and much more usage.
Right now these are our configs on 14.03.10
PriorityFlags=DEPTH_OBLIVIOUS,SMALL_RELATIVE_TO_TIME
PriorityType=priority/multifactor
PriorityDecayHalfLife=1-0
The group 'idhmc' has been only users running jobs for the past few days
and I wanted to check that if hepx (primary stakeholder) began running
they'd have priority. It seems the depth of 'hepx' is effecting their
normalized shares , unless sshare does not take into account
DEPTH_OBLIVIOUS.
The Raw Shares value is the number of CPUs funded by a stakeholder, or 10
for non-stakeholders. I have never really found a good value so just went
with something tangible.
Our account structure is also probably overly complicated and may be such
we need to just move all accounts containing users to be directly under
"tamu".
The goal is that usage within an account adjust a person's fairshare but
the location in the hierarchy have no impact on the account's fairshare.
The account vs account usage is still important, ie if hepx used most of
the cluster for a day then their priority should be lower than that of a
non-stakeholder who hasn't run any jobs recently.
Any insight is welcome.
Thanks,
- Trey
=============================
Trey Dockendorf
Systems Analyst I
Texas A&M University
Academy for Advanced Telecommunications and Learning Technologies
Phone: (979)458-2396
Email: [email protected]
Jabber: [email protected]
