Hi All,
I am trying to start the opensaf from Jenkins. Following is the behavior
-- opensaf successfully comes up. As soon as the command exit, randomly any
opensaf service goes down with the reason "faulted due to 'avaDown' :
Recovery is 'nodeFailfast'".
If I start the opensaf by logging into server, that works perfectly fine.
What can be Issue here? I tried printing $SHELL from Jenkins. Value is
/bin/bash, which is same when I login onto server.
Please find attached opensaf logs.
Thanks,
Nivrutti
un 22 18:23:18 VCM opensafd: Stopping OpenSAF Services
Jun 22 18:23:18 VCM opensafd: OpenSAF services successfully stopped
Jun 22 18:23:18 VCM opensafd: Starting OpenSAF Services
Jun 22 18:23:18 VCM osafdtmd[12126]: Started
Jun 22 18:23:18 VCM osafrded[12143]: Started
Jun 22 18:23:20 VCM osafrded[12143]: NO No peer available => Setting Active
role for this node
Jun 22 18:23:20 VCM osaffmd[12155]: Started
Jun 22 18:23:20 VCM osafimmd[12166]: Started
Jun 22 18:23:20 VCM osafimmnd[12177]: Started
Jun 22 18:23:20 VCM osafimmnd[12177]: NO SERVER STATE: IMM_SERVER_ANONYMOUS -->
IMM_SERVER_CLUSTER_WAITING
Jun 22 18:23:20 VCM osafimmd[12166]: NO New IMMND process is on ACTIVE
Controller at 2010f
Jun 22 18:23:20 VCM osafimmd[12166]: NO First SC IMMND (OpenSAF 4.4 or later)
attached 2010f
Jun 22 18:23:20 VCM osafimmd[12166]: NO First IMMND at SC to attach is NOT
configured for PBE
Jun 22 18:23:20 VCM osafimmd[12166]: NO First IMMND on SC found at 2010f this
IMMD at 2010f. Cluster is loading, *not* 2PBE => designating that IMMND as
coordinator
Jun 22 18:23:20 VCM osafimmnd[12177]: NO This IMMND is now the NEW Coord
Jun 22 18:23:23 VCM osafimmnd[12177]: NO SERVER STATE:
IMM_SERVER_CLUSTER_WAITING --> IMM_SERVER_LOADING_PENDING
Jun 22 18:23:23 VCM osafimmnd[12177]: NO SERVER STATE:
IMM_SERVER_LOADING_PENDING --> IMM_SERVER_LOADING_SERVER
Jun 22 18:23:23 VCM osafimmd[12166]: NO Successfully announced loading. New
ruling epoch:1
Jun 22 18:23:23 VCM osafimmnd[12177]: NO NODE STATE-> IMM_NODE_LOADING
Jun 22 18:23:23 VCM osafimmloadd: NO Load starting
Jun 22 18:23:23 VCM osafimmloadd: NO ***** Loading from XML file imm.xml at
/etc/opensaf *****
Jun 22 18:23:23 VCM osafimmloadd: NO The class OpensafImm has been created
since it was missing from the imm.xml load file
Jun 22 18:23:23 VCM osafimmloadd: IN Class OsafImmPbeRt created
Jun 22 18:23:23 VCM osafimmloadd: NO The class OsafImmPbeRt has been created
since it was missing from the imm.xml load file
Jun 22 18:23:23 VCM osafimmloadd: NO The
opensafImm=opensafImm,safApp=safImmService object of class OpensafImm has been
created since it was missing from the imm.xml load file
Jun 22 18:23:23 VCM osafimmnd[12177]: NO Ccb 1 COMMITTED (IMMLOADER)
Jun 22 18:23:23 VCM osafimmnd[12177]: NO Closing admin owner IMMLOADER id(1),
loading of IMM done
Jun 22 18:23:23 VCM osafimmnd[12177]: NO NODE STATE-> IMM_NODE_FULLY_AVAILABLE
2462
Jun 22 18:23:23 VCM osafimmnd[12177]: NO RepositoryInitModeT is
SA_IMM_INIT_FROM_FILE
Jun 22 18:23:23 VCM osafimmnd[12177]: WA IMM Access Control mode is DISABLED!
Jun 22 18:23:23 VCM osafimmnd[12177]: NO opensafImmNostdFlags changed to: 0x16
Jun 22 18:23:23 VCM osafimmnd[12177]: NO Epoch set to 2 in ImmModel
Jun 22 18:23:23 VCM osafimmd[12166]: NO ACT: New Epoch for IMMND process at
node 2010f old epoch: 1 new epoch:2
Jun 22 18:23:23 VCM osafimmd[12166]: NO Ruling epoch changed to:2
Jun 22 18:23:23 VCM osafimmloadd: NO Load ending normally
Jun 22 18:23:23 VCM osafimmnd[12177]: NO SERVER STATE:
IMM_SERVER_LOADING_SERVER --> IMM_SERVER_READY
Jun 22 18:23:23 VCM osaflogd[12193]: Started
Jun 22 18:23:23 VCM osaflogd[12193]: NO No or invalid log service configuration
object
Jun 22 18:23:23 VCM osaflogd[12193]: NO Log config system: high 0 low 0,
application: high 0 low 0
Jun 22 18:23:23 VCM osaflogd[12193]: NO log root directory is:
/var/log/opensaf/saflog
Jun 22 18:23:23 VCM osaflogd[12193]: NO LGS_MBCSV_VERSION = 3
Jun 22 18:23:23 VCM osafimmnd[12177]: NO Implementer connected: 1
(safLogService) <3, 2010f>
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaLogStreamConfig' is safLogService => class extent is safe.
Jun 22 18:23:23 VCM osafntfd[12207]: Started
Jun 22 18:23:23 VCM osafclmd[12219]: Started
Jun 22 18:23:23 VCM osafimmnd[12177]: NO Implementer connected: 2
(safClmService) <12, 2010f>
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaClmNode' is
safClmService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaClmCluster'
is safClmService => class extent is safe.
Jun 22 18:23:23 VCM osafclmna[12230]: Started
Jun 22 18:23:23 VCM osafclmna[12230]: NO safNode=VCM,safCluster=myClmCluster
Joined cluster, nodeid=2010f
Jun 22 18:23:23 VCM osafamfd[12240]: Started
Jun 22 18:23:23 VCM osafimmnd[12177]: NO Implementer connected: 3
(safAmfService) <17, 2010f>
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfCompBaseType' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfSUBaseType' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfSGBaseType' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfAppBaseType' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfSvcBaseType' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfCSBaseType' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfCompGlobalAttributes' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaAmfCompType'
is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaAmfCSType' is
safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaAmfCtCsType'
is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfHealthcheckType' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaAmfSvcType'
is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfSvcTypeCSTypes' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaAmfSUType' is
safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfSutCompType' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaAmfSGType' is
safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaAmfAppType'
is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaAmfCluster'
is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaAmfNode' is
safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaAmfNodeGroup'
is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfNodeSwBundle' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class
'SaAmfApplication' is safAmfService => class extent is safe.
Jun 22 18:23:23 VCM osafimmnd[12177]: NO implementer for class 'SaAmfSG' is
safAmfService => class extent is safe.
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class 'SaAmfSI' is
safAmfService => class extent is safe.
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class 'SaAmfCSI' is
safAmfService => class extent is safe.
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class
'SaAmfCSIAttribute' is safAmfService => class extent is safe.
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class 'SaAmfSU' is
safAmfService => class extent is safe.
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class 'SaAmfComp' is
safAmfService => class extent is safe.
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class
'SaAmfHealthcheck' is safAmfService => class extent is safe.
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class
'SaAmfCompCsType' is safAmfService => class extent is safe.
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class
'SaAmfSIDependency' is safAmfService => class extent is safe.
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class
'SaAmfSIRankedSU' is safAmfService => class extent is safe.
Jun 22 18:23:24 VCM osafamfnd[12251]: Started
Jun 22 18:23:24 VCM osafamfd[12240]: NO Node 'SC-1' joined the cluster
Jun 22 18:23:24 VCM osafamfnd[12251]: NO
'safSu=SC-1,safSg=NoRed,safApp=OpenSAF' Presence State UNINSTANTIATED =>
INSTANTIATING
Jun 22 18:23:24 VCM osafamfnd[12251]: NO 'safSu=SC-1,safSg=2N,safApp=OpenSAF'
Presence State UNINSTANTIATED => INSTANTIATING
Jun 22 18:23:24 VCM osafsmfd[12267]: Started
Jun 22 18:23:24 VCM osafsmfnd[12271]: Started
Jun 22 18:23:24 VCM osafmsgnd[12287]: Started
Jun 22 18:23:24 VCM osafimmnd[12177]: NO Implementer connected: 4
(MsgQueueService131343) <497, 2010f>
Jun 22 18:23:24 VCM osafmsgd[12304]: Started
Jun 22 18:23:24 VCM osaflcknd[12314]: Started
Jun 22 18:23:24 VCM osafckptnd[12332]: Started
Jun 22 18:23:24 VCM osafamfwd[12348]: Started
Jun 22 18:23:24 VCM osaflckd[12355]: Started
Jun 22 18:23:24 VCM osafamfnd[12251]: NO
'safSu=SC-1,safSg=NoRed,safApp=OpenSAF' Presence State INSTANTIATING =>
INSTANTIATED
Jun 22 18:23:24 VCM osafamfnd[12251]: NO Assigning
'safSi=NoRed2,safApp=OpenSAF' ACTIVE to 'safSu=SC-1,safSg=NoRed,safApp=OpenSAF'
Jun 22 18:23:24 VCM osafamfnd[12251]: NO Assigned 'safSi=NoRed2,safApp=OpenSAF'
ACTIVE to 'safSu=SC-1,safSg=NoRed,safApp=OpenSAF'
Jun 22 18:23:24 VCM osafevtd[12370]: Started
Jun 22 18:23:24 VCM osafckptd[12380]: Started
Jun 22 18:23:24 VCM osafamfnd[12251]: NO 'safSu=SC-1,safSg=2N,safApp=OpenSAF'
Presence State INSTANTIATING => INSTANTIATED
Jun 22 18:23:24 VCM osafamfnd[12251]: NO Assigning 'safSi=SC-2N,safApp=OpenSAF'
ACTIVE to 'safSu=SC-1,safSg=2N,safApp=OpenSAF'
Jun 22 18:23:24 VCM osafimmnd[12177]: NO Implementer connected: 5
(safMsgGrpService) <498, 2010f>
Jun 22 18:23:24 VCM osafimmnd[12177]: NO Implementer connected: 6
(safCheckPointService) <501, 2010f>
Jun 22 18:23:24 VCM osafimmnd[12177]: NO Implementer connected: 7
(safLckService) <499, 2010f>
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Backup create cmd =
/usr/lib64/opensaf/smf-backup-create
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Bundle check cmd =
/usr/lib64/opensaf/smf-bundle-check
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Node check cmd =
/usr/lib64/opensaf/smf-node-check
Jun 22 18:23:24 VCM osafsmfd[12267]: NO SMF repository check cmd =
/usr/lib64/opensaf/smf-repository-check
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Cluster reboot cmd =
/usr/lib64/opensaf/smf-cluster-reboot
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Admin Op Timeout = 600000000000
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Cli Timeout = 600000000000
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Reboot Timeout = 600000000000
Jun 22 18:23:24 VCM osafsmfd[12267]: NO SMF will use the STEP standard set of
actions.
Jun 22 18:23:24 VCM osafsmfd[12267]: NO DN for si_swap operation =
safSi=SC-2N,safApp=OpenSAF
Jun 22 18:23:24 VCM osafsmfd[12267]: NO SI si_swap operation max retry = 200
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Max num of campaign restarts = 10
Jun 22 18:23:24 VCM osafsmfd[12267]: NO IMM persist command = immdump
/etc/opensaf/imm.xml
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Node reboot cmd = reboot
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Turn PBE off during upgrade = 0
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Attr smfVerifyEnable is not available
in smfConfig=1,safApp=safSmfService, using default value 0
Jun 22 18:23:24 VCM osafsmfd[12267]: NO Attr smfVerifyTimeout is not available
in smfConfig=1,safApp=safSmfService, using default value 100000000000
Jun 22 18:23:24 VCM osafimmnd[12177]: NO Implementer connected: 8
(safEvtService) <500, 2010f>
Jun 22 18:23:24 VCM osafimmnd[12177]: NO Implementer connected: 9
(safSmfService) <502, 2010f>
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class 'SaSmfCampaign'
is safSmfService => class extent is safe.
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class
'OpenSafSmfConfig' is safSmfService => class extent is safe.
Jun 22 18:23:24 VCM osafimmnd[12177]: NO implementer for class 'SaSmfSwBundle'
is safSmfService => class extent is safe.
Jun 22 18:23:24 VCM osafamfnd[12251]: NO Assigned 'safSi=SC-2N,safApp=OpenSAF'
ACTIVE to 'safSu=SC-1,safSg=2N,safApp=OpenSAF'
Jun 22 18:23:24 VCM opensafd: OpenSAF(4.5.0 - 6010:9f5981d5f409) services
successfully started
Jun 22 18:23:25 VCM osaflogd[12193]: exiting for shutdown
Jun 22 18:23:25 VCM osafamfnd[12251]: NO
'safComp=LOG,safSu=SC-1,safSg=2N,safApp=OpenSAF' faulted due to 'avaDown' :
Recovery is 'nodeFailfast'
Jun 22 18:23:25 VCM osafamfnd[12251]: ER
safComp=LOG,safSu=SC-1,safSg=2N,safApp=OpenSAF Faulted due to:avaDown Recovery
is:nodeFailfast
Jun 22 18:23:25 VCM osafamfnd[12251]: Rebooting OpenSAF NodeId = 131343 EE Name
= , Reason: Component faulted: recovery is node failfast, OwnNodeId = 131343,
SupervisionTime = 60
Jun 22 18:23:25 VCM osafclmd[12219]: exiting for shutdown
Jun 22 18:23:25 VCM osafamfnd[12251]: node reboot failure: exit code 32512
Jun 22 18:23:25 VCM osafntfd[12207]: exiting for shutdown
Jun 22 18:23:25 VCM osafimmd[12166]: exiting for shutdown
Jun 22 18:23:25 VCM osafimmnd[12177]: NO Implementer locally disconnected.
Marking it as doomed 1 <3, 2010f> (safLogService)
Jun 22 18:23:25 VCM osafimmnd[12177]: NO No IMMD service => cluster restart,
exiting
Jun 22 18:23:25 VCM osaflckd[12355]: exiting for shutdown
Jun 22 18:23:25 VCM osafevtd[12370]: exiting for shutdown
Jun 22 18:23:25 VCM osafckptd[12380]: exiting for shutdown
Jun 22 18:23:25 VCM osafsmfd[12267]: exiting for shutdown
Jun 22 18:23:25 VCM osafsmfnd[12271]: exiting for shutdown
Jun 22 18:23:25 VCM osafckptnd[12332]: exiting for shutdown
Jun 22 18:23:25 VCM osafmsgnd[12287]: exiting for shutdown
Jun 22 18:23:25 VCM osafclmna[12230]: exiting for shutdown
Jun 22 18:23:25 VCM osafamfd[12240]: exiting for shutdown
Jun 22 18:23:25 VCM osafmsgd[12304]: exiting for shutdown
Jun 22 18:23:25 VCM osaflcknd[12314]: exiting for shutdown
Jun 22 18:23:25 VCM osafrded[12143]: exiting for shutdown
Jun 22 18:23:25 VCM osaffmd[12155]: exiting for shutdown
Jun 22 18:23:25 VCM osafamfnd[12251]: MDTM:socket_recv() = 0, conn lost with dh
server, exiting library err :Success
------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
_______________________________________________
Opensaf-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/opensaf-users
