>From the logs can see no new object was added when the remaining size was not
>enough to accommodate new object:
**<143>1 2018-05-28T11:59:06.748419+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6393"] 846:imm/agent/imma_om_api.cc:6941 >> immsv_sync:
remainingSpace 85 objsInBatch:130**
<143>1 2018-05-28T11:59:06.750146+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6411"] 846:imm/agent/imma_om_api.cc:6482 >> get_obj_size
<143>1 2018-05-28T11:59:06.752146+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6434"] 846:imm/agent/imma_om_api.cc:6513 TR Object size: 8606
<143>1 2018-05-28T11:59:06.752166+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6435"] 846:imm/agent/imma_om_api.cc:6515 << get_obj_size
**<143>1 2018-05-28T11:59:06.752186+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6436"] 846:imm/agent/imma_om_api.cc:7094 TR Remaining space:-8521**
<141>1 2018-05-28T11:59:06.752291+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6437"] 846:imm/agent/imma_om_api.cc:7160 NO >> immsv_sync
<143>1 2018-05-28T11:59:06.752815+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6438"] 846:imm/common/immsv_evt.c:1950 TR syncDepth > 20 :130
<141>1 2018-05-28T11:59:06.75295+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6439"] 846:imm/agent/imma_proc.cc:3565 NO imma_evt_fake_evs: size =
66187
<141>1 2018-05-28T11:59:06.757232+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6440"] 846:imm/agent/imma_om_api.cc:7162 NO << immsv_sync
<143>1 2018-05-28T11:59:06.757351+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6441"] 846:imm/agent/imma_om_api.cc:7220 << immsv_sync
<143>1 2018-05-28T11:59:06.757374+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6442"] 846:imm/immloadd/imm_loader.cc:2369 TR SA_AIS_OK => sync
sent message
<143>1 2018-05-28T11:59:06.757394+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6443"] 846:imm/immloadd/imm_loader.cc:2382 TR Synced object:
safLgStrCfg=test_911,safLgStrCfg=test
<143>1 2018-05-28T11:59:06.769784+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6444"] 848:mds/mds_dt_trans.c:755 >> mdtm_process_poll_recv_data_tcp
<143>1 2018-05-28T11:59:06.770035+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6445"] 846:imm/agent/imma_om_api.cc:8234 >> saImmOmSearchFinalize
<143>1 2018-05-28T11:59:06.770387+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6446"] 848:mds/mds_dt_trans.c:755 >> mdtm_process_poll_recv_data_tcp
<143>1 2018-05-28T11:59:06.77052+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6447"] 846:imm/agent/imma_om_api.cc:8401 << saImmOmSearchFinalize
**<143>1 2018-05-28T11:59:06.770544+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6448"] 846:imm/immloadd/imm_loader.cc:2455 TR Synced 130 objects of
class TestDb**
<143>1 2018-05-28T11:59:06.770564+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6449"] 846:imm/immloadd/imm_loader.cc:2204 TR Syncing instances of
class SaSmfSwBundle
<143>1 2018-05-28T11:59:06.770601+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
sequenceId="6450"] 846:imm/immloadd/imm_loader.cc:2210 TR maxBatchSize set to
58680*
130 objects are synced (and not 131). No new object was added. The size
exceeding the MDS_DIRECT_BUF_MAXSIZE, is after encoding.
**SC-1 osafimmd[xxx]: NO MDTM: Not possible to send size:65262 TIPC multicast
to svc_id = IMMND(25)**
---
** [tickets:#2868] imm: sync message size could be over the maximum size of MDS
buf**
**Status:** assigned
**Milestone:** 5.21.10
**Created:** Mon May 28, 2018 07:03 AM UTC by Vu Minh Nguyen
**Last Updated:** Tue Jun 01, 2021 12:52 AM UTC
**Owner:** Surbhi Tripathi
To speed up IMM sync process, osafimmloadd packs a bunch of IMM class objects
in one package and sends to IMMND coordinator in one go. The size of the
package could be adjustable via the configurable attribute
`opensafImmSyncBatchSize` which has the default value around 90% of
`MDS_DIRECT_BUF_MAXSIZE`.
With current code, objects will be pushed into the batch as long as the space
which is 90% of `opensafImmSyncBatchSize` still remains - is larger than zero.
If the remaining space is quite small *and* the size of next going-to-pushed
object is quite big, the package size could be over `MDS_DIRECT_BUF_MAXSIZE`.
When that huge package arrives at the active IMMD, it will fail to broadcast
the messages with syslog:
> SC-1 osafimmd[xxx]: NO MDTM: Not possible to send size:65262 TIPC multicast
> to svc_id = IMMND(25)
Here is osafimmloadd's trace to show up the case:
> <143>1 2018-05-28T11:59:06.743861+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6348"] 846:imm/agent/imma_om_api.cc:7094 TR Remaining space:539
> <143>1 2018-05-28T11:59:06.74391+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6349"] 846:imm/agent/imma_om_api.cc:7117 << immsv_sync
> <143>1 2018-05-28T11:59:06.743959+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6350"] 846:imm/immloadd/imm_loader.cc:2374 TR
> SA_AIS_ERR_NOT_READY => BUFFERED
> <143>1 2018-05-28T11:59:06.744007+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6351"] 846:imm/immloadd/imm_loader.cc:2382 TR Synced object:
> safLgStrCfg=test_90,safLgStrCfg=test
> <143>1 2018-05-28T11:59:06.744364+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6352"] 848:mds/mds_dt_trans.c:755 >>
> mdtm_process_poll_recv_data_tcp
> <143>1 2018-05-28T11:59:06.744518+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6353"] 846:imm/agent/imma_om_api.cc:6941 >> immsv_sync:
> remainingSpace 539 objsInBatch:129
> <143>1 2018-05-28T11:59:06.745828+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6367"] 846:imm/agent/imma_om_api.cc:6482 >> get_obj_size
> <143>1 2018-05-28T11:59:06.747585+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6386"] 846:imm/agent/imma_om_api.cc:6513 TR Object size: 454
> <143>1 2018-05-28T11:59:06.747633+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6387"] 846:imm/agent/imma_om_api.cc:6515 << get_obj_size
> <143>1 2018-05-28T11:59:06.747681+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6388"] 846:imm/agent/imma_om_api.cc:7094 TR Remaining space:85
> <143>1 2018-05-28T11:59:06.747728+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6389"] 846:imm/agent/imma_om_api.cc:7117 << immsv_sync
> <143>1 2018-05-28T11:59:06.747776+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6390"] 846:imm/immloadd/imm_loader.cc:2374 TR
> SA_AIS_ERR_NOT_READY => BUFFERED
> <143>1 2018-05-28T11:59:06.747824+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6391"] 846:imm/immloadd/imm_loader.cc:2382 TR Synced object:
> safLgStrCfg=test_91,safLgStrCfg=test
> <143>1 2018-05-28T11:59:06.748207+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6392"] 848:mds/mds_dt_trans.c:755 >>
> mdtm_process_poll_recv_data_tcp
> <143>1 2018-05-28T11:59:06.748419+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6393"] 846:imm/agent/imma_om_api.cc:6941 >> immsv_sync:
> remainingSpace 85 objsInBatch:130
> <143>1 2018-05-28T11:59:06.750146+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6411"] 846:imm/agent/imma_om_api.cc:6482 >> get_obj_size
> <143>1 2018-05-28T11:59:06.752146+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6434"] 846:imm/agent/imma_om_api.cc:6513 TR Object size: 8606
> <143>1 2018-05-28T11:59:06.752166+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6435"] 846:imm/agent/imma_om_api.cc:6515 << get_obj_size
> <143>1 2018-05-28T11:59:06.752186+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6436"] 846:imm/agent/imma_om_api.cc:7094 TR Remaining space:-8521
> <141>1 2018-05-28T11:59:06.752291+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6437"] 846:imm/agent/imma_om_api.cc:7160 NO >> immsv_sync
> <143>1 2018-05-28T11:59:06.752815+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6438"] 846:imm/common/immsv_evt.c:1950 TR syncDepth > 20 :130
> <141>1 2018-05-28T11:59:06.75295+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6439"] 846:imm/agent/imma_proc.cc:3565 NO imma_evt_fake_evs: size
> = 66187
> <141>1 2018-05-28T11:59:06.757232+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6440"] 846:imm/agent/imma_om_api.cc:7162 NO << immsv_sync
> <143>1 2018-05-28T11:59:06.757351+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6441"] 846:imm/agent/imma_om_api.cc:7220 << immsv_sync
> <143>1 2018-05-28T11:59:06.757374+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6442"] 846:imm/immloadd/imm_loader.cc:2369 TR SA_AIS_OK => sync
> sent message
> <143>1 2018-05-28T11:59:06.757394+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6443"] 846:imm/immloadd/imm_loader.cc:2382 TR Synced object:
> safLgStrCfg=test_911,safLgStrCfg=test
> <143>1 2018-05-28T11:59:06.769784+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6444"] 848:mds/mds_dt_trans.c:755 >>
> mdtm_process_poll_recv_data_tcp
> <143>1 2018-05-28T11:59:06.770035+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6445"] 846:imm/agent/imma_om_api.cc:8234 >> saImmOmSearchFinalize
> <143>1 2018-05-28T11:59:06.770387+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6446"] 848:mds/mds_dt_trans.c:755 >>
> mdtm_process_poll_recv_data_tcp
> <143>1 2018-05-28T11:59:06.77052+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6447"] 846:imm/agent/imma_om_api.cc:8401 << saImmOmSearchFinalize
> <143>1 2018-05-28T11:59:06.770544+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6448"] 846:imm/immloadd/imm_loader.cc:2455 TR Synced 130 objects
> of class TestDb
> <143>1 2018-05-28T11:59:06.770564+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6449"] 846:imm/immloadd/imm_loader.cc:2204 TR Syncing instances
> of class SaSmfSwBundle
> <143>1 2018-05-28T11:59:06.770601+07:00 SC-1 osafimmloadd 846 osafimmnd [meta
> sequenceId="6450"] 846:imm/immloadd/imm_loader.cc:2210 TR maxBatchSize set to
> 58680
>
---
Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is
subscribed to https://sourceforge.net/p/opensaf/tickets/
To unsubscribe from further messages, a project admin can change settings at
https://sourceforge.net/p/opensaf/admin/tickets/options. Or, if this is a
mailing list, you can unsubscribe from the mailing list.
_______________________________________________
Opensaf-tickets mailing list
Opensaf-tickets@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets
