Venkatesh, When we create a new topic and publish a message, we don't see any issues. But when we publish message to a pre-configured topic, it throws some errors. The issue may be due to the data used to pre configure a Topic . I will investigate the issue and let you know if any changes required in the pre-configured topic data .
Thanks, Sunil From: onap-discuss-boun...@lists.onap.org <onap-discuss-boun...@lists.onap.org> On Behalf Of VENKATESH KUMAR, VIJAY Sent: Wednesday, May 09, 2018 3:58 PM To: FREEMAN, BRIAN D <bf1...@att.com>; HERNANDEZ-HERRERO, JORGE <jh1...@att.com>; onap-discuss@lists.onap.org Subject: Re: [onap-discuss] [dmaap] cannot publish events on dmaap ***Security Advisory: This Message Originated Outside of AT&T *** Reference http://cso.att.com/EmailSecurity/IDSP.html for more information. I have seen similar problem with VES Collector (DCAE) output topic as well. The "unauthenticated.SEC_MEASUREMENT_OUTPUT" fails with same error, but random new topics works. This topic however is involved in the CL flow though - hence need to be resolved. DMAAP Team, Any suggestion on how to fix this? I've seen this problem consistently in the last few OOM deployed instances. Thanks, Vijay From: onap-discuss-boun...@lists.onap.org<mailto:onap-discuss-boun...@lists.onap.org> <onap-discuss-boun...@lists.onap.org<mailto:onap-discuss-boun...@lists.onap.org>> On Behalf Of FREEMAN, BRIAN D Sent: Wednesday, May 09, 2018 2:10 PM To: HERNANDEZ-HERRERO, JORGE <jh1...@att.com<mailto:jh1...@att.com>>; onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: Re: [onap-discuss] [dmaap] cannot publish events on dmaap ***Security Advisory: This Message Originated Outside of AT&T *** Reference http://cso.att.com/EmailSecurity/IDSP.html for more information. OK it seems to be a problem with the pre-created unauthenticated Topics When publising getting an error 404. On the fly created topics work fine on publish and subscribe. POST http://{{mr_port}}/events/PDPD-CONFIGURATION<https://urldefense.proofpoint.com/v2/url?u=http-3A__-257b-257bmr-5Fport-257d-257d_events_PDPD-2DCONFIGURATION&d=DwMFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=6WYcUG7NY-ZxfqWx5MmzVQ&m=F1WWXKQjnm3_131lMqZEnnIqY--A9ajmTwESJaDvuRg&s=jk_8E0rFTVV9N7rpfFvsPfB36UlMnMLVLOKC4LVC0xg&e=> (with fake json payload) { "mrstatus": 5007, "helpURL": "http://onap.readthedocs.io";<https://urldefense.proofpoint.com/v2/url?u=http-3A__onap.readthedocs.io-2522&d=DwQFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=6WYcUG7NY-ZxfqWx5MmzVQ&m=F1WWXKQjnm3_131lMqZEnnIqY--A9ajmTwESJaDvuRg&s=DX085mtO9KY9k81B2r41FjWBMVCoMtzSxZ1HrWq2a4U&e=>, "message": "Error while publishing data to topic.:PDPD-CONFIGURATION.Successfully published number of messages :0.null", "status": 404 } Brian From: onap-discuss-boun...@lists.onap.org<mailto:onap-discuss-boun...@lists.onap.org> <onap-discuss-boun...@lists.onap.org<mailto:onap-discuss-boun...@lists.onap.org>> On Behalf Of HERNANDEZ-HERRERO, JORGE Sent: Tuesday, May 08, 2018 8:06 PM To: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: [onap-discuss] [dmaap] cannot publish events on dmaap ***Security Advisory: This Message Originated Outside of AT&T *** Reference http://cso.att.com/EmailSecurity/IDSP.html for more information. Hello DMaaP/Integration team, I set up a new fresh OOM installation. I can see one of the topics of interest there pre-configured. policy@dev-drools-0:/opt/app/policy/config$ curl --silent -X GET http://message-router:3904/topics/<https://urldefense.proofpoint.com/v2/url?u=http-3A__message-2Drouter-3A3904_topics_&d=DwQFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=e3d1ehx3DI5AoMgDmi2Fzw&m=nGDF8UykjiJP-poPRKNUeiYAgGGGzbkAgcwv9PpkYBY&s=7W8cHjJQCDUDzmeqtqsp37CmcgG5lHN2OWJmZUD5ieo&e=> | grep PDPD "PDPD-CONFIGURATION", I can perform subscribe operations: policy@dev-drools-0:/opt/app/policy/config$ curl --silent -X GET http://message-router:3904/events/PDPD-CONFIGURATION/1/1<https://urldefense.proofpoint.com/v2/url?u=http-3A__message-2Drouter-3A3904_events_PDPD-2DCONFIGURATION_1_1&d=DwQFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=e3d1ehx3DI5AoMgDmi2Fzw&m=nGDF8UykjiJP-poPRKNUeiYAgGGGzbkAgcwv9PpkYBY&s=HgRy9hqPOAMx9q5XuEqq5R370nu8OOAide7zUnlN4_A&e=> [] But I cannot perform publish operations (get 404): policy@dev-drools-0:/opt/app/policy/config$ curl --silent -X POST --header "Content-Type: application/json" -d "{}" http:// message-router:3904/events/PDPD-CONFIGURATION {"mrstatus":5007,"helpURL":"http://onap.readthedocs.io","message":"Error<https://urldefense.proofpoint.com/v2/url?u=http-3A__onap.readthedocs.io-2522-2C-2522message-2522-3A-2522Error&d=DwQFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=e3d1ehx3DI5AoMgDmi2Fzw&m=nGDF8UykjiJP-poPRKNUeiYAgGGGzbkAgcwv9PpkYBY&s=lL5CNZ2jpVaNXKidNZ214SQv4ROdxT_XSvBI-oBQwhY&e=> while publishing data to topic.:PDPD-CONFIGURATION.Successfully published number of messages :0.null","status":404} I see rolling errors in message-router pod: ifiableProperties - Property metadata.broker.list is overridden to message-router-kafka:9092 ""2018-05-08 22:08:36,694 [097a371d-09ce-44d0-b02c-ede05f615dc6--PDPD-CONFIGURATION_dev-drools-1-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property request.timeout.ms is overridden to 30000 ""2018-05-08 22:08:36,694 [097a371d-09ce-44d0-b02c-ede05f615dc6--PDPD-CONFIGURATION_dev-drools-1-leader-finder-thread] INFO kafka.client.ClientUtils$ - Fetching metadata from broker id:0,host:message-router-kafka,port:9092 with correlation id 436 for 1 topic(s) Set(PDPD-CONFIGURATION) ""2018-05-08 22:08:36,694 [8395b334-088e-4b1e-a9eb-aa8f25a6150d--APPC-CL_dev-drools-1-leader-finder-thread] INFO kafka.producer.SyncProducer - Disconnecting from message-router-kafka:9092 ""2018-05-08 22:08:36,694 [8395b334-088e-4b1e-a9eb-aa8f25a6150d--APPC-CL_dev-drools-1-leader-finder-thread] INFO kafka.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1525817225806] Added fetcher for partitions ArrayBuffer() ""2018-05-08 22:08:36,695 [097a371d-09ce-44d0-b02c-ede05f615dc6--PDPD-CONFIGURATION_dev-drools-1-leader-finder-thread] INFO kafka.producer.SyncProducer - Connected to message-router-kafka:9092 for producing ""2018-05-08 22:08:36,695 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Verifying properties ""2018-05-08 22:08:36,695 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property client.id is overridden to a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL ""2018-05-08 22:08:36,695 [097a371d-09ce-44d0-b02c-ede05f615dc6--PDPD-CONFIGURATION_dev-drools-1-leader-finder-thread] INFO kafka.producer.SyncProducer - Disconnecting from message-router-kafka:9092 ""2018-05-08 22:08:36,695 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property metadata.broker.list is overridden to message-router-kafka:9092 ""2018-05-08 22:08:36,695 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property request.timeout.ms is overridden to 30000 ""2018-05-08 22:08:36,695 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.client.ClientUtils$ - Fetching metadata from broker id:0,host:message-router-kafka,port:9092 with correlation id 311 for 1 topic(s) Set(APPC-CL) ""2018-05-08 22:08:36,695 [097a371d-09ce-44d0-b02c-ede05f615dc6--PDPD-CONFIGURATION_dev-drools-1-leader-finder-thread] INFO kafka.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1525817223734] Added fetcher for partitions ArrayBuffer() ""2018-05-08 22:08:36,696 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.producer.SyncProducer - Connected to message-router-kafka:9092 for producing ""2018-05-08 22:08:36,696 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.producer.SyncProducer - Disconnecting from message-router-kafka:9092 ""2018-05-08 22:08:36,696 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1525817251891] Added fetcher for partitions ArrayBuffer() ""2018-05-08 22:08:36,720 [qtp1555093762-111] ERROR com.att.nsa.cambria.backends.kafka.KafkaConsumer - 1a5ee485-a519-4fc5-83c0-49759fb58b7e(dev-drools-3)/PDPD-CONFIGURATION: ConsumerTimeoutException in Kafka consumer; returning null & Exception at nextMessage() : kafka.consumer.ConsumerTimeoutException ""2018-05-08 22:08:36,720 [qtp1555093762-111] ERROR com.att.nsa.cambria.backends.kafka.KafkaConsumer - 1a5ee485-a519-4fc5-83c0-49759fb58b7e(dev-drools-3)/PDPD-CONFIGURATION: ConsumerTimeoutException in Kafka consumer; returning null & Exception at nextMessage() : kafka.consumer.ConsumerTimeoutException "22:08:36.720 [qtp1555093762-111] ERROR com.att.nsa.cambria.backends.kafka.KafkaConsumer - 1a5ee485-a519-4fc5-83c0-49759fb58b7e(dev-drools-3)/PDPD-CONFIGURATION: ConsumerTimeoutException in Kafka consumer; returning null & Exception at nextMessage() : kafka.consumer.ConsumerTimeoutException Pods up: ubuntu@k8sx:~/oom/kubernetes$ kubectl get pods --all-namespaces -o=wide NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE kube-system heapster-76b8cd7b5-hbtdm 1/1 Running 2 12d 10.42.141.193 k8sx kube-system kube-dns-5d7b4487c9-h7z26 3/3 Running 6 12d 10.42.159.123 k8sx kube-system kubernetes-dashboard-f9577fffd-266ww 1/1 Running 4 12d 10.42.116.116 k8sx kube-system monitoring-grafana-997796fcf-ht99z 1/1 Running 2 12d 10.42.168.225 k8sx kube-system monitoring-influxdb-56fdcd96b-8tm6l 1/1 Running 3 12d 10.42.153.214 k8sx kube-system tiller-deploy-54bcc55dd5-srvwq 1/1 Running 2 12d 10.42.32.77 k8sx onap dev-brmsgw-5dbc4c8dc4-bz9mm 1/1 Running 0 3m 10.42.136.217 k8sx onap dev-dbc-pg-0 1/1 Running 0 3m 10.42.118.91 k8sx onap dev-dbc-pg-1 1/1 Running 0 2m 10.42.140.88 k8sx onap dev-dmaap-bus-controller-7675f9b455-kpbpb 1/1 Running 0 3m 10.42.57.51 k8sx onap dev-drools-0 1/1 Running 0 3m 10.42.16.84 k8sx onap dev-drools-1 1/1 Running 0 2m 10.42.42.172 k8sx onap dev-drools-2 1/1 Running 0 1m 10.42.51.123 k8sx onap dev-drools-3 1/1 Running 0 1m 10.42.25.232 k8sx onap dev-kube2msb-579fc77c54-vcqds 1/1 Running 0 3m 10.42.109.32 k8sx onap dev-message-router-b5bdc599c-88grl 1/1 Running 0 3m 10.42.239.7 k8sx onap dev-message-router-kafka-774bcd9886-gnrpf 1/1 Running 0 3m 10.42.110.202 k8sx onap dev-message-router-zookeeper-66f4f9f5b6-n65l4 1/1 Running 0 3m 10.42.181.41 k8sx onap dev-msb-consul-7bc4fcc8-dmxw6 1/1 Running 0 3m 10.42.241.245 k8sx onap dev-msb-discovery-768547bcb-2tlq6 2/2 Running 0 3m 10.42.153.102 k8sx onap dev-msb-eag-5d95686c67-5k5d9 2/2 Running 0 3m 10.42.110.26 k8sx onap dev-msb-iag-675b649848-lrq4r 2/2 Running 0 3m 10.42.218.124 k8sx onap dev-nexus-7d96568f5f-8xqx5 1/1 Running 0 3m 10.42.239.98 k8sx onap dev-pap-8587696769-7x4nr 2/2 Running 0 3m 10.42.149.209 k8sx onap dev-pdp-0 2/2 Running 0 3m 10.42.25.22 k8sx onap dev-pdp-1 2/2 Running 0 1m 10.42.134.116 k8sx onap dev-policydb-587d55bdff-92fgj 1/1 Running 0 3m 10.42.243.156 k8sx onap dev-robot-6bf5f455bb-cx58r 1/1 Running 0 3m 10.42.172.145 k8sx Can you please advice on how to correct this problem? Thank you. Jorge
_______________________________________________ onap-discuss mailing list onap-discuss@lists.onap.org https://lists.onap.org/mailman/listinfo/onap-discuss
