Thanks ,valdemar.
Problem was solved.
1 Thru the timestamp, there are some suspicious memory not freed . because
those memory was not allocated during process init.
2 use ::walk umem to check those allocated memory in the cache.
then check user memory content and the requested bytes.
Most memory was filled with OID '1.3.6.1.4.1.4421.2.1.1.1.1.5'
the requested bytes is 75a9/D'251 -8 = 112 bytes.
3 code reading to confirm and find the cause.
always the last mib tree element memory was not freed.
> edc4580/36X
0xedc4580: 78 3a10bf88 5 edc45c8
edc45d8 840004 0
0 0 ffffffff 80000001
7fffffff 542258 5d70f8
5a9a38 5adfb0 5af2f8 5b5b48
6d73666d 73634674 70496e66
6f00cafe 312e332e 362e312e 342e312e
34343231 2e322e31 2e312e31
2e312e35 ddcafe bbddcafe baddcafe
feedface 75a9 edc2bb8
afcce355
> edc4580+58/36C
0xedc45d8: 1.3.6.1.4.1.4421.2.1.1.1.1.5\0\735\712\776\673\735\712\776
> edc45c0/36X
0xedc45c0: 5af2f8 5b5b48 6d73666d 73634674
70496e66 6f00cafe 312e332e
362e312e 342e312e 34343231 2e322e31
2e312e31 2e312e35 ddcafe
bbddcafe baddcafe feedface 75a9
edc2bb8 afcce355 baddcafe
baddcafe baddcafe baddcafe baddcafe
baddcafe baddcafe baddcafe
baddcafe baddcafe baddcafe baddcafe
78 3a10bf88 5
edc4688
> edc45d8/36C
0xedc45d8: 1.3.6.1.4.1.4421.2.1.1.1.1.5\0\735\712\776\673\735\712\776
> edc45c8/36C
0xedc45c8: msfmscFtpInfo\0\712\7761.3.6.1.4.1.4421.2.1
> edc2bb8::bufctl -v
ADDR BUFADDR TIMESTAMP THREAD
CACHE LASTLOG CONTENTS
edc2bb8 edc4580 5f82fed4fe7b7 4
547fb88 5461770 0
libumem.so.1`umem_cache_alloc+0x13c
libumem.so.1`umem_alloc+0x60
libumem.so.1`malloc+0x28
GetNextOTE_r+0xac
__1cbAOamCfgSnmpMgrVblTranslatorTmibWalkThroughGroup6FpnE_OID_pv_pn0ANtree_ele_info__+0x1e8
__1cbAOamCfgSnmpMgrVblTranslatorJsadkToVbl6FpnE_OID_2IpvpCb_pnI_VarBind__+0x20
__1cNOamCfgSnmpMgrNexecCmndInMsf6Fn0AJCMND_TYPE_rnLOamCfgMngmtJMSF_CC_ID_pnE_OID_6IpvpCbbbII_I_+0x248
__1cbEOamCfgSnmpMgr_msfCmcInitStatusDget6FnLOamCfgMngmtJMSF_CC_ID_rnNOamMsfNodeMgrSMSFCMC_INIT_STATUS__b_+0xa4
__1cNOamMsfNodeMgrTgetMsfCmcInitStatus6MnLOamCfgMngmtJMSF_CC_ID_rn0ASMSFCMC_INIT_STATUS__b_+0x18
k_msfNodeSynchStatusEntry_get+0x248
msfNodeSynchStatusEntry_get+0x15c
real_DispatchMethodRequest+0x13c
SADefaultAction+0x224
__1cOOamCfgSubagentMprocessInMsg6FpnO_SubagentEvent__b_+0x18
__1cWOamCfgInMsgDistributorLmainEvtLoop6F_b_+0xc6c
--
This message posted from opensolaris.org
