Hi We noticed similar issue last night during PnP PNF tests in ONAP installed in ONAP_5G tenant in TLAB. Here is exception:
2018-10-29T15:48:01.786Z|abefeefc-1b83-4614-a829-d98a6c5335be| org.onap.so.client.RestClient - RestClientSSL using default SSL context! 2018-10-29T15:48:01.793Z|abefeefc-1b83-4614-a829-d98a6c5335be| o.o.so.logging.jaxrs.filter.PayloadLoggingFilter - Making GET request to: https://aai.onap:8443/aai/v14/business/customers/customer/%7Bsome%20subscriber%20id%7D Request Headers: {Authorization=[Basic TVNPOk1TTw==], X-FromAppId=[MSO], X-TransactionId=[], Accept=[application/json], X-ONAP-RequestID=[abefeefc-1b83-4614-a829-d98a6c5335be], X-ONAP-InvocationID=[a4c2c792-0a05-4d3d-be0e-0e161bb30549], X-ONAP-PartnerName=[SO]} 2018-10-29T15:48:01.869Z|abefeefc-1b83-4614-a829-d98a6c5335be| o.o.so.logging.jaxrs.filter.PayloadLoggingFilter - Response from GET: https://aai.onap:8443/aai/v14/business/customers/customer/%7Bsome%20subscriber%20id%7D Response Headers: {connection=[close], Date=[Mon, 29 Oct 2018 15:48:01 GMT], Strict-Transport-Security=[max-age=16000000; includeSubDomains; preload;], WWW-Authenticate=[Basic realm="people.osaaf.org"]}{"requestError":{"policyException":{"messageId":"POL3300","text":"Unauthorized (msg=%1) (ec=%2)","variables":["Unauthorized","ERR.5.1.3300"]}}} 2018-10-29T15:48:01.876Z|abefeefc-1b83-4614-a829-d98a6c5335be| o.o.s.bpmn.servicedecomposition.tasks.BBInputSetup - Error calling A&AI. Request-Id=abefeefc-1b83-4614-a829-d98a6c5335be {"requestError":{"policyException":{"messageId":"POL3300","text":"Unauthorized (msg=%1) (ec=%2)","variables":["Unauthorized","ERR.5.1.3300"]}}} javax.ws.rs.ForbiddenException: Error calling A&AI. Request-Id=abefeefc-1b83-4614-a829-d98a6c5335be {"requestError":{"policyException":{"messageId":"POL3300","text":"Unauthorized (msg=%1) (ec=%2)","variables":["Unauthorized","ERR.5.1.3300"]}}} (...) at java.lang.Thread.run(Thread.java:748) 2018-10-29T15:48:01.878Z|abefeefc-1b83-4614-a829-d98a6c5335be| org.onap.so.client.exception.ExceptionBuilder - Building a WorkflowException for Subflow 2018-10-29T15:48:01.878Z|abefeefc-1b83-4614-a829-d98a6c5335be| org.onap.so.client.exception.ExceptionBuilder - Outgoing WorkflowException is WorkflowException[processKey=ExecuteBuildingBlock,errorCode=7000,errorMessage=Error calling A&AI. Request-Id=abefeefc-1b83-4614-a829-d98a6c5335be {"requestError":{"policyException":{"messageId":"POL3300","text":"Unauthorized (msg=%1) (ec=%2)","variables":["Unauthorized","ERR.5.1.3300"]}}},workStep=*] 2018-10-29T15:48:01.879Z|abefeefc-1b83-4614-a829-d98a6c5335be| org.onap.so.client.exception.ExceptionBuilder - Throwing MSOWorkflowException 2018-10-29T15:48:01.905Z|abefeefc-1b83-4614-a829-d98a6c5335be| o.onap.so.logging.jaxrs.filter.SpringClientFilter - Could not Target Entity: http://so-catalog-db-adapter.onap:8082/rainy_day_handler_macro/search/findOneByFlowNameAndServiceTypeAndVnfTypeAndErrorCodeAndWorkStep?flowName=UnassignServiceInstanceBB&serviceType=%2A&vnfType=%2A&errorCode=7000&workStep=%2A Is that the same issue? br, Krzysztof ________________________________ Od: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> w imieniu użytkownika Ying, Ruoyu <ruoyu.y...@intel.com> Wysłane: wtorek, 30 października 2018 14:55:21 Do: GATHMAN, JONATHAN C; FORSYTH, JAMES; onap-discuss@lists.onap.org DW: Ranganathan, Dileep; Huang, Haibin Temat: Re: [onap-discuss] [OOM][AAI]Request to AAI got access denied Hi all, I am now able to access AAI after restarting the aaf-locate pod. Thanks for your help. But it still maybe a bug here. Best Regards, Ruoyu From: Ying, Ruoyu Sent: Tuesday, October 30, 2018 9:24 PM To: 'GATHMAN, JONATHAN C' <jg1...@att.com>; FORSYTH, JAMES <jf2...@att.com>; onap-discuss@lists.onap.org Cc: Ranganathan, Dileep <dileep.ranganat...@intel.com>; Huang, Haibin <haibin.hu...@intel.com> Subject: RE: [onap-discuss] [OOM][AAI]Request to AAI got access denied Hi Jonathan, We’re having this issue in both OOF and VFC tenant in the integration lab. And I got this issue after redeploying other components(I think AAI may also got upgraded at that time). And I check the aaf-locate service port, it seems fine here. Thanks. Best Regards, Ruoyu From: GATHMAN, JONATHAN C [mailto:jg1...@att.com] Sent: Tuesday, October 30, 2018 9:18 PM To: FORSYTH, JAMES <jf2...@att.com<mailto:jf2...@att.com>>; Ying, Ruoyu <ruoyu.y...@intel.com<mailto:ruoyu.y...@intel.com>>; onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Cc: Ranganathan, Dileep <dileep.ranganat...@intel.com<mailto:dileep.ranganat...@intel.com>>; Huang, Haibin <haibin.hu...@intel.com<mailto:haibin.hu...@intel.com>> Subject: Re: [onap-discuss] [OOM][AAI]Request to AAI got access denied Is this on SB04?, and what time was the connection problem? I have been monitoring SB04 all morning, and it continues to be fine. The “seems to stop sometimes” is because it appears that SB04 is bounced, and there is something different about the Persistence mechanism on SB04, so that it doesn’t come up right all the time. Otherwise, if no-one restarts, it is very stable. I also checked early on “The Dailies” and they are up and functional as well. -- Jonathan Gathman Principled-System Architect ATO Tech Dev/SEAT/Platform Architecture and Technology Management AT&T Services, Inc. 2349 Oaker, Arnold, MO 63010 m 314-550-3312 | jonathan.gath...@us.att.com<mailto:jonathan.gath...@us.att.com> From: "FORSYTH, JAMES" <jf2...@att.com<mailto:jf2...@att.com>> Date: Tuesday, October 30, 2018 at 8:13 AM To: "Ying, Ruoyu" <ruoyu.y...@intel.com<mailto:ruoyu.y...@intel.com>>, "onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>" <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>> Cc: "Ranganathan, Dileep" <dileep.ranganat...@intel.com<mailto:dileep.ranganat...@intel.com>>, "Huang, Haibin" <haibin.hu...@intel.com<mailto:haibin.hu...@intel.com>>, "GATHMAN, JONATHAN C" <jg1...@att.com<mailto:jg1...@att.com>> Subject: Re: [onap-discuss] [OOM][AAI]Request to AAI got access denied Hi, Ruoyu, Yes, we’ve observed that the aaf-locate service stops sometimes and users get access denied in AAI. AAF team, do you more info or a workaround? Thanks, jimmy From: "Ying, Ruoyu" <ruoyu.y...@intel.com<mailto:ruoyu.y...@intel.com>> Date: Tuesday, October 30, 2018 at 9:10 AM To: "FORSYTH, JAMES" <jf2...@att.com<mailto:jf2...@att.com>>, "onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>" <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>> Cc: "Ranganathan, Dileep" <dileep.ranganat...@intel.com<mailto:dileep.ranganat...@intel.com>>, "Huang, Haibin" <haibin.hu...@intel.com<mailto:haibin.hu...@intel.com>> Subject: RE: [onap-discuss] [OOM][AAI]Request to AAI got access denied Hi jimmy, I check the aaf pods, they are running normally. However, I did see an error log inside aai-resources like this: Authenticating Service unavailable from 10.42.192.221:38084 ( No Entries found for 'https://aaf-locate.onap:8095/locate/AAF_NS.service:2.0<https://urldefense.proofpoint.com/v2/url?u=https-3A__aaf-2Dlocate.onap-3A8095_locate_AAF-5FNS.service-3A2.0&d=DwQGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=Oej6QUk5p2KdqNEWySpOHA&m=ppCUj4qlFS8I48q0jwv4CT0RPvB8S_NXSh9SkEVDwWc&s=lN1MYjQy3wcoiCP2w259iCYN-iTtA0WRKRk26AwYxyQ&e=>' ) Any suggestion here? Thanks. Best Regards, Ruoyu From: FORSYTH, JAMES [mailto:jf2...@att.com] Sent: Tuesday, October 30, 2018 9:02 PM To: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>; Ying, Ruoyu <ruoyu.y...@intel.com<mailto:ruoyu.y...@intel.com>> Cc: Ranganathan, Dileep <dileep.ranganat...@intel.com<mailto:dileep.ranganat...@intel.com>>; Huang, Haibin <haibin.hu...@intel.com<mailto:haibin.hu...@intel.com>> Subject: Re: [onap-discuss] [OOM][AAI]Request to AAI got access denied First step – you should verify if AAF is running. If you look at the logs for the aai-resources pod it will usually tell you if it can’t get an answer from AAF. Thanks, -jimmy From: <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>> on behalf of "Ying, Ruoyu" <ruoyu.y...@intel.com<mailto:ruoyu.y...@intel.com>> Reply-To: "onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>" <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>>, "ruoyu.y...@intel.com<mailto:ruoyu.y...@intel.com>" <ruoyu.y...@intel.com<mailto:ruoyu.y...@intel.com>> Date: Tuesday, October 30, 2018 at 9:00 AM To: "onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>" <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>> Cc: "Ranganathan, Dileep" <dileep.ranganat...@intel.com<mailto:dileep.ranganat...@intel.com>>, "Huang, Haibin" <haibin.hu...@intel.com<mailto:haibin.hu...@intel.com>> Subject: [onap-discuss] [OOM][AAI]Request to AAI got access denied Hi AAI team, Got an issue while curling AAI in OOF tenant in the integration lab. With Basic auth enabled and ssl cert verification off, the response of all the requests from AAI looks like this: { "timestamp": 1540900280234, "status": 403, "error": "Forbidden", "message": "Access Denied", "path": "/aai/v14/cloud-infrastructure/complexes/complex/DLLSTX233" } Any solution or workaround to solve it? Thanks. Best Regards, Ruoyu -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#13394): https://lists.onap.org/g/onap-discuss/message/13394 Mute This Topic: https://lists.onap.org/mt/27792495/21656 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-