[tickets] [opensaf:tickets] #1999 osafntfd on active controller crashed while logging to alarm stream
- **status**: accepted --> review --- ** [tickets:#1999] osafntfd on active controller crashed while logging to alarm stream** **Status:** review **Milestone:** 5.1.RC1 **Created:** Tue Sep 06, 2016 05:15 AM UTC by Srikanth R **Last Updated:** Wed Sep 07, 2016 05:50 AM UTC **Owner:** A V Mahesh (AVM) Environment details -- OS : Suse 64bit Changeset : 7997 ( 5.1.FC) Setup : 5 nodes ( 2 controllers and 3 payloads with headless feature disabled & no PBE ) AMF Application : 2N model with SUs mapped on PL-3,PL-4 Summary : -- NTFD crashed on active controller, while logging notification to alarm stream. Steps followed & Observed behaviour -- -> Initially performed couple of switchovers and tests on AMF application. -> Performed CLM lock operation of standby SC-1 and later unlocked. -> Performed switchover such that SC-1 became active controller. -> Stopped opensafd on PL-4. NTFD on active controller crashed. Sep 6 10:18:25 CONTROLLER-1 osafamfd[2262]: NO Node 'PL-4' left the cluster .. Sep 6 10:18:25 CONTROLLER-1 osafntfd[2242]: osaf_abort(31) called from 0x414d1e with errno=11 Sep 6 10:18:25 CONTROLLER-1 osafamfnd[2272]: NO 'safComp=NTF,safSu=SC-1,safSg=2N,safApp=OpenSAF' faulted due to 'avaDown' : Recovery is 'nodeFailfast' -> Below is the excerpt from the ntfd trace. Sep 6 10:18:25.436394 osafntfd [2242:NtfAdmin.cc:0252] T2 New notification received, id: 682 Sep 6 10:18:25.436398 osafntfd [2242:NtfAdmin.cc:0187] >> processNotification Sep 6 10:18:25.436404 osafntfd [2242:NtfNotification.cc:0045] T3 constructor 0x685790, notId: 682 Sep 6 10:18:25.436409 osafntfd [2242:ntfsv_mem.c:0761] >> ntfsv_get_ntf_header Sep 6 10:18:25.436412 osafntfd [2242:ntfsv_mem.c:0782] << ntfsv_get_ntf_header Sep 6 10:18:25.436425 osafntfd [2242:NtfAdmin.cc:0200] T2 notification 682 with type 16384 added, notificationMap size is 1 Sep 6 10:18:25.436431 osafntfd [2242:NtfLogger.cc:0130] >> log Sep 6 10:18:25.436435 osafntfd [2242:NtfLogger.cc:0132] T2 notification Id=682 received in logger with size 0 Sep 6 10:18:25.436439 osafntfd [2242:NtfLogger.cc:0135] T2 IS LOCAL, logging Sep 6 10:18:25.436442 osafntfd [2242:NtfLogger.cc:0166] >> checkQueueAndLog Sep 6 10:18:25.436447 osafntfd [2242:NtfLogger.cc:0196] >> logNotification Sep 6 10:18:25.436452 osafntfd [2242:ntfsv_mem.c:0761] >> ntfsv_get_ntf_header Sep 6 10:18:25.436455 osafntfd [2242:ntfsv_mem.c:0782] << ntfsv_get_ntf_header Sep 6 10:18:25.436460 osafntfd [2242:NtfLogger.cc:0231] T2 Logging notification to alarm stream Sep 6 10:18:25.436495 osafntfd [2242:lga_api.c:1151] >> saLogWriteLogAsync Sep 6 10:18:25.436500 osafntfd [2242:lga_api.c:1015] >> handle_log_record Sep 6 10:18:25.436507 osafntfd [2242:lga_api.c:1110] << handle_log_record Sep 6 10:18:25.436518 osafntfd [2242:lga_api.c:1229] TR **saLogWriteLogAsync Node not CLM member or stale client** Sep 6 10:18:25.436524 osafntfd [2242:lga_api.c:1320] << saLogWriteLogAsync Sep 6 10:18:42.472616 osafntfd [2176:ntfs_main.c:0181] >> initialize --- Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is subscribed to https://sourceforge.net/p/opensaf/tickets/ To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/opensaf/admin/tickets/options. Or, if this is a mailing list, you can unsubscribe from the mailing list.-- ___ Opensaf-tickets mailing list Opensaf-tickets@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/opensaf-tickets
[tickets] [opensaf:tickets] #1999 osafntfd on active controller crashed while logging to alarm stream
- **status**: unassigned --> accepted - **assigned_to**: A V Mahesh (AVM) - **Component**: ntf --> log - **Milestone**: 4.7.2 --> 5.1.RC1 - **Comment**: Even linking with New agents A.2.2 code , if client saLogInitialize with A.2.1 , CLM status should be ignored . --- ** [tickets:#1999] osafntfd on active controller crashed while logging to alarm stream** **Status:** accepted **Milestone:** 5.1.RC1 **Created:** Tue Sep 06, 2016 05:15 AM UTC by Srikanth R **Last Updated:** Tue Sep 06, 2016 09:34 AM UTC **Owner:** A V Mahesh (AVM) Environment details -- OS : Suse 64bit Changeset : 7997 ( 5.1.FC) Setup : 5 nodes ( 2 controllers and 3 payloads with headless feature disabled & no PBE ) AMF Application : 2N model with SUs mapped on PL-3,PL-4 Summary : -- NTFD crashed on active controller, while logging notification to alarm stream. Steps followed & Observed behaviour -- -> Initially performed couple of switchovers and tests on AMF application. -> Performed CLM lock operation of standby SC-1 and later unlocked. -> Performed switchover such that SC-1 became active controller. -> Stopped opensafd on PL-4. NTFD on active controller crashed. Sep 6 10:18:25 CONTROLLER-1 osafamfd[2262]: NO Node 'PL-4' left the cluster .. Sep 6 10:18:25 CONTROLLER-1 osafntfd[2242]: osaf_abort(31) called from 0x414d1e with errno=11 Sep 6 10:18:25 CONTROLLER-1 osafamfnd[2272]: NO 'safComp=NTF,safSu=SC-1,safSg=2N,safApp=OpenSAF' faulted due to 'avaDown' : Recovery is 'nodeFailfast' -> Below is the excerpt from the ntfd trace. Sep 6 10:18:25.436394 osafntfd [2242:NtfAdmin.cc:0252] T2 New notification received, id: 682 Sep 6 10:18:25.436398 osafntfd [2242:NtfAdmin.cc:0187] >> processNotification Sep 6 10:18:25.436404 osafntfd [2242:NtfNotification.cc:0045] T3 constructor 0x685790, notId: 682 Sep 6 10:18:25.436409 osafntfd [2242:ntfsv_mem.c:0761] >> ntfsv_get_ntf_header Sep 6 10:18:25.436412 osafntfd [2242:ntfsv_mem.c:0782] << ntfsv_get_ntf_header Sep 6 10:18:25.436425 osafntfd [2242:NtfAdmin.cc:0200] T2 notification 682 with type 16384 added, notificationMap size is 1 Sep 6 10:18:25.436431 osafntfd [2242:NtfLogger.cc:0130] >> log Sep 6 10:18:25.436435 osafntfd [2242:NtfLogger.cc:0132] T2 notification Id=682 received in logger with size 0 Sep 6 10:18:25.436439 osafntfd [2242:NtfLogger.cc:0135] T2 IS LOCAL, logging Sep 6 10:18:25.436442 osafntfd [2242:NtfLogger.cc:0166] >> checkQueueAndLog Sep 6 10:18:25.436447 osafntfd [2242:NtfLogger.cc:0196] >> logNotification Sep 6 10:18:25.436452 osafntfd [2242:ntfsv_mem.c:0761] >> ntfsv_get_ntf_header Sep 6 10:18:25.436455 osafntfd [2242:ntfsv_mem.c:0782] << ntfsv_get_ntf_header Sep 6 10:18:25.436460 osafntfd [2242:NtfLogger.cc:0231] T2 Logging notification to alarm stream Sep 6 10:18:25.436495 osafntfd [2242:lga_api.c:1151] >> saLogWriteLogAsync Sep 6 10:18:25.436500 osafntfd [2242:lga_api.c:1015] >> handle_log_record Sep 6 10:18:25.436507 osafntfd [2242:lga_api.c:1110] << handle_log_record Sep 6 10:18:25.436518 osafntfd [2242:lga_api.c:1229] TR **saLogWriteLogAsync Node not CLM member or stale client** Sep 6 10:18:25.436524 osafntfd [2242:lga_api.c:1320] << saLogWriteLogAsync Sep 6 10:18:42.472616 osafntfd [2176:ntfs_main.c:0181] >> initialize --- Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is subscribed to https://sourceforge.net/p/opensaf/tickets/ To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/opensaf/admin/tickets/options. Or, if this is a mailing list, you can unsubscribe from the mailing list.-- ___ Opensaf-tickets mailing list Opensaf-tickets@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/opensaf-tickets
[tickets] [opensaf:tickets] #1999 osafntfd on active controller crashed while logging to alarm stream
- **summary**: LOG : ntfd on active controller crashed while logging to alarm stream --> osafntfd on active controller crashed while logging to alarm stream - **Component**: log --> ntf - **Comment**: After the integration of LOG with CLM (#1638), all LOG clients should reinitialize after CLM unlock operation. It might be that , NTF as a LOG client is not reinitializing after CLM unlock and got the return value 31. --- ** [tickets:#1999] osafntfd on active controller crashed while logging to alarm stream** **Status:** unassigned **Milestone:** 4.7.2 **Created:** Tue Sep 06, 2016 05:15 AM UTC by Srikanth R **Last Updated:** Tue Sep 06, 2016 08:09 AM UTC **Owner:** nobody Environment details -- OS : Suse 64bit Changeset : 7997 ( 5.1.FC) Setup : 5 nodes ( 2 controllers and 3 payloads with headless feature disabled & no PBE ) AMF Application : 2N model with SUs mapped on PL-3,PL-4 Summary : -- NTFD crashed on active controller, while logging notification to alarm stream. Steps followed & Observed behaviour -- -> Initially performed couple of switchovers and tests on AMF application. -> Performed CLM lock operation of standby SC-1 and later unlocked. -> Performed switchover such that SC-1 became active controller. -> Stopped opensafd on PL-4. NTFD on active controller crashed. Sep 6 10:18:25 CONTROLLER-1 osafamfd[2262]: NO Node 'PL-4' left the cluster .. Sep 6 10:18:25 CONTROLLER-1 osafntfd[2242]: osaf_abort(31) called from 0x414d1e with errno=11 Sep 6 10:18:25 CONTROLLER-1 osafamfnd[2272]: NO 'safComp=NTF,safSu=SC-1,safSg=2N,safApp=OpenSAF' faulted due to 'avaDown' : Recovery is 'nodeFailfast' -> Below is the excerpt from the ntfd trace. Sep 6 10:18:25.436394 osafntfd [2242:NtfAdmin.cc:0252] T2 New notification received, id: 682 Sep 6 10:18:25.436398 osafntfd [2242:NtfAdmin.cc:0187] >> processNotification Sep 6 10:18:25.436404 osafntfd [2242:NtfNotification.cc:0045] T3 constructor 0x685790, notId: 682 Sep 6 10:18:25.436409 osafntfd [2242:ntfsv_mem.c:0761] >> ntfsv_get_ntf_header Sep 6 10:18:25.436412 osafntfd [2242:ntfsv_mem.c:0782] << ntfsv_get_ntf_header Sep 6 10:18:25.436425 osafntfd [2242:NtfAdmin.cc:0200] T2 notification 682 with type 16384 added, notificationMap size is 1 Sep 6 10:18:25.436431 osafntfd [2242:NtfLogger.cc:0130] >> log Sep 6 10:18:25.436435 osafntfd [2242:NtfLogger.cc:0132] T2 notification Id=682 received in logger with size 0 Sep 6 10:18:25.436439 osafntfd [2242:NtfLogger.cc:0135] T2 IS LOCAL, logging Sep 6 10:18:25.436442 osafntfd [2242:NtfLogger.cc:0166] >> checkQueueAndLog Sep 6 10:18:25.436447 osafntfd [2242:NtfLogger.cc:0196] >> logNotification Sep 6 10:18:25.436452 osafntfd [2242:ntfsv_mem.c:0761] >> ntfsv_get_ntf_header Sep 6 10:18:25.436455 osafntfd [2242:ntfsv_mem.c:0782] << ntfsv_get_ntf_header Sep 6 10:18:25.436460 osafntfd [2242:NtfLogger.cc:0231] T2 Logging notification to alarm stream Sep 6 10:18:25.436495 osafntfd [2242:lga_api.c:1151] >> saLogWriteLogAsync Sep 6 10:18:25.436500 osafntfd [2242:lga_api.c:1015] >> handle_log_record Sep 6 10:18:25.436507 osafntfd [2242:lga_api.c:1110] << handle_log_record Sep 6 10:18:25.436518 osafntfd [2242:lga_api.c:1229] TR **saLogWriteLogAsync Node not CLM member or stale client** Sep 6 10:18:25.436524 osafntfd [2242:lga_api.c:1320] << saLogWriteLogAsync Sep 6 10:18:42.472616 osafntfd [2176:ntfs_main.c:0181] >> initialize --- Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is subscribed to https://sourceforge.net/p/opensaf/tickets/ To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/opensaf/admin/tickets/options. Or, if this is a mailing list, you can unsubscribe from the mailing list.-- ___ Opensaf-tickets mailing list Opensaf-tickets@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/opensaf-tickets
