Sunil,

(In reply to Sunil Kumar M S from comment #19)
> patch https://git.opendaylight.org/gerrit/#/c/62792/6 should fix this.

This patch did not seem to help with bug-7826. It also looks to have added
a new exception:

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-ocata-gate-stateful-nitrogen/17/odl1_exception.log.gz

2017-09-19 15:07:08,498 | INFO  | nsole user karaf | core
           | 112 - org.apache.karaf.log.core - 4.0.9 | ROBOT MESSAGE:
Starting test Delete Vm Instances
OptimisticLockFailedException{message=Optimistic lock failed.,
errorList=[RpcError [message=Optimistic lock failed., severity=ERROR,
errorType=APPLICATION, tag=resource-denied, applicationTag=null, info=null,
cause=org.opendaylight.yangtools.yang.data.api.schema.tree.ConflictingModificationAppliedException:
Node was deleted by other transaction.]]}
Caused by:
org.opendaylight.yangtools.yang.data.api.schema.tree.ConflictingModificationAppliedException:
Node was deleted by other transaction.
OptimisticLockFailedException{message=Optimistic lock failed.,
errorList=[RpcError [message=Optimistic lock failed., severity=ERROR,
errorType=APPLICATION, tag=resource-denied, applicationTag=null, info=null,
cause=org.opendaylight.yangtools.yang.data.api.schema.tree.ConflictingModificationAppliedException:
Node was deleted by other transaction.]]}
Caused by:
org.opendaylight.yangtools.yang.data.api.schema.tree.ConflictingModificationAppliedException:
Node was deleted by other transaction.
org.opendaylight.yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException:
Node
/(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[{(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:176078904599989}]/AugmentationIdentifier{childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number,
(urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group,
(urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types,
(urn:opendaylight:flow:inventory?revision=2013-08-19)table,
(urn:opendaylight:flow:inventory?revision=2013-08-19)group,
(urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer,
(urn:opendaylight:flow:inventory?revision=2013-08-19)software,
(urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address,
(urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number,
(urn:opendaylight:flow:inventory?revision=2013-08-19)table-features,
(urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions,
(urn:opendaylight:flow:inventory?revision=2013-08-19)hardware,
(urn:opendaylight:flow:inventory?revision=2013-08-19)description,
(urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features,
(urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions,
(urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter,
(urn:opendaylight:flow:inventory?revision=2013-08-19)meter]}/(urn:opendaylight:flow:inventory?revision=2013-08-19)table/table[{(urn:opendaylight:flow:inventory?revision=2013-08-19)id=44}]/flow
does not exist. Cannot apply modification to its children.
TransactionCommitFailedException{message=Data did not pass validation.,
errorList=[RpcError [message=Data did not pass validation., severity=ERROR,
errorType=APPLICATION, tag=operation-failed, applicationTag=null,
info=null,
cause=org.opendaylight.yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException:
Node
/(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[{(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:176078904599989}]/AugmentationIdentifier{childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number,
(urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group,
(urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types,
(urn:opendaylight:flow:inventory?revision=2013-08-19)table,
(urn:opendaylight:flow:inventory?revision=2013-08-19)group,
(urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer,
(urn:opendaylight:flow:inventory?revision=2013-08-19)software,
(urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address,
(urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number,
(urn:opendaylight:flow:inventory?revision=2013-08-19)table-features,
(urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions,
(urn:opendaylight:flow:inventory?revision=2013-08-19)hardware,
(urn:opendaylight:flow:inventory?revision=2013-08-19)description,
(urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features,
(urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions,
(urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter,
(urn:opendaylight:flow:inventory?revision=2013-08-19)meter]}/(urn:opendaylight:flow:inventory?revision=2013-08-19)table/table[{(urn:opendaylight:flow:inventory?revision=2013-08-19)id=44}]/flow
does not exist. Cannot apply modification to its children.]]}


On Mon, Sep 18, 2017 at 1:47 AM, N Vivekanandan <[email protected]
> wrote:

> Hi Sunil,
>
>
>
> Can you please clarify your ask?
>
>
>
> The error is being thrown in the Operational Inventory Data Store not
> maintained by the Application.
>
> That Data Store is maintained by the OpenFlowplugin.
>
>
>
> So can you please point us to the log link where you see that this could
> be a NetVirt problem?
>
>
>
> --
>
> Thanks,
>
>
>
> Vivek
>
>
>
>
>
>
>
> *From:* Sunil Kumar G
> *Sent:* Monday, September 18, 2017 10:36 AM
> *To:* Sam Hague <[email protected]>
> *Cc:* N Vivekanandan <[email protected]>; openflowplugin-dev <
> [email protected]>; Tomáš Slušný
> <[email protected]>; Swati Udhavrao Niture <
> [email protected]>; Kiran N Upadhyaya <
> [email protected]>
> *Subject:* RE: CSIT Debugging for bug-7826
>
>
>
> Hello Sam,
>
>
>
> As per my observation group was created/present during VM ping test case
> and subsequently deleted during Delete Network test case before the
> tempest. Can someone from application look at this issue why flow is
> referring to a non-existing group, whether it is a stale flow. We can later
> work on next steps once we know where problem exists.
>
>
>
> Regards,
>
> Sunil
>
>
>
> *From:* Sam Hague [mailto:[email protected] <[email protected]>]
> *Sent:* Saturday, September 16, 2017 6:30 PM
> *To:* Sunil Kumar G <[email protected]>
> *Cc:* N Vivekanandan <[email protected]>; openflowplugin-dev <
> [email protected]>; Tomáš Slušný <
> [email protected]>; Swati Udhavrao Niture <swati.udhavrao.niture@
> ericsson.com>; Kiran N Upadhyaya <[email protected]>
> *Subject:* Re: CSIT Debugging for bug-7826
>
>
>
> Sunil, Swati,
>
>
>
> what is the next step here? Do we need more debugging in the logs to track
> where the group is deleted? Other question is it possible the group has not
> been created yet or is this definitely a case where the group was there and
> then was deleted?
>
>
>
> Thanks, Sam
>
>
>
> On Fri, Sep 15, 2017 at 5:11 AM, Sunil Kumar G <[email protected]>
> wrote:
>
> Hello,
>
>
>
> From the test logs, I could analyze from these statements:
>
>
>
> revision=2013-08-19)group/group[{(urn:opendaylight:flow:
> inventory?revision=2013-08-19)*group-id=210004}] does not exist*. Cannot
> apply modification to its children. 
> TransactionCommitFailedException{message=Data
> did not pass validation., errorList=[RpcError [message=Data did not pass
> validation., severity=ERROR, errorType=APPLICATION, tag=operation-failed,
> applicationTag=null, info=null, cause=org.opendaylight.
> yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException:
> Node
>
>
>
> are due to group might have been deleted which the flow might be referring
>
>
>
> {
>
>                                 "barrier": false,
>
>                                 "cookie": 141562762,
>
>                                 "flow-name": "e9ed8652-6c76-4d7b-a646-
> b013a2b25e48",
>
>                                 "hard-timeout": 0,
>
>                                 "id": "525002false",
>
>                                 "idle-timeout": 0,
>
>                                 "installHw": true,
>
>                                 "instructions": {
>
>                                     "instruction": [
>
>                                         {
>
>                                             "order": 0,
>
>                                             "write-actions": {
>
>                                                 "action": [
>
>                                                     {
>
>                                                         "group-action": {
>
>                                                             *"group-id":
> 210004*
>
>                                                         },
>
>                                                         "order": 0
>
>                                                     }
>
>                                                 ]
>
>                                             }
>
>                                         }
>
>                                     ]
>
>                                 },
>
>                                 "match": {
>
>                                     "metadata": {
>
>                                         "metadata": 83919634432,
>
>                                         "metadata-mask": 1099494850561
>
>                                     }
>
>                                 },
>
>                                 "priority": 5,
>
>                                 "strict": false,
>
>                                 "table_id": 52
>
>                             },
>
>
>
> We can analyze further on what are these stale flows that are existing and
> what is the action(edit/delete) performed on the flow to hit the
> situation/exception.
>
>
>
> Regards,
>
> Sunil
>
>
>
> *From:* Sam Hague [mailto:[email protected]]
> *Sent:* Wednesday, September 13, 2017 9:53 PM
> *To:* Sunil Kumar G <[email protected]>; N Vivekanandan <
> [email protected]>; openflowplugin-dev <
> [email protected]>; Tomáš Slušný <
> [email protected]>
> *Subject:* CSIT Debugging for bug-7826
>
>
>
> Sunil,
>
>
>
> pushed a couple jobs below that include the extra debugging for dumping
> the operational inventory. [1] is the full test suite and [2] is just the
> tempest tests.
>
>
>
> The test in the full suite which sporadically has the issue is: Starting
> test Add Interfaces To Router.
>
>
>
> Just about any test in the tempest suite hits the issue.
>
>
>
> Example link to the inventory dump: https://logs.opendaylight.org/releng/
> jenkins092/netvirt-csit-1node-openstack-ocata-upstream-
> stateful-carbon/125/log.html.gz#s1-s1-s2-t12-k3-k2-k1-k2-k33
>
>
>
> Follow the same patch in the log.html file for the jobs below. To see
> which test actually hit the error for bug-7826, open the smaller
> odl1_exception.log: https://logs.opendaylight.org/releng/
> jenkins092/netvirt-csit-1node-openstack-ocata-upstream-
> stateful-carbon/125/odl1_exception.log.gz. From there search for "
> ModifiedNodeDoesNotExistException". And then preceding that look for "ROBOT
> MESSAGE: Starting test " to see what test had the error. From there you
> jump into the log.html specific test to see the debug info.
>
>
>
> Thanks, Sam
>
>
>
>
>
> [1] https://jenkins.opendaylight.org/releng/view/
> netvirt-csit/job/netvirt-csit-1node-openstack-ocata-
> upstream-stateful-carbon/128 and 130
>
>
>
> [2] https://jenkins.opendaylight.org/releng/view/
> netvirt-csit/job/netvirt-csit-1node-openstack-ocata-
> upstream-stateful-carbon/129 and 131
>
>
>
_______________________________________________
openflowplugin-dev mailing list
[email protected]
https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev

Reply via email to