Hi Foucault,
    The fix has already been committed to the 2.1 release. It will be committed 
to previous releases by early next week.
I don’t think there is an easy workaround without picking up the fix.

Raja

From: Foucault de Bonneval 
<[email protected]<mailto:[email protected]>>
Date: Friday, March 27, 2015 at 12:00 PM
Cc: "[email protected]<mailto:[email protected]>" 
<[email protected]<mailto:[email protected]>>
Subject: Re: [opencontrail-dev] mem leak on compute nodes


Raja,

Any progress with our issue ?

Based on the informations you gave, i reproduced the phenomenon with Tsung and 
a webserver.

Ils there a quick fix / workaround de could use to lower the effect ?

Thanks.
Foucault

Le 26 mars 2015 19:22, "Foucault de Bonneval" 
<[email protected]<mailto:[email protected]>> a écrit :

Raja,

Ho yes please backport to 1.10 branch !!!!

Foucault

Le 26 mars 2015 19:16, "Rajagopalan Sivaramakrishnan" 
<[email protected]<mailto:[email protected]>> a écrit :
Hi Foucault,
    We found a memory leak in the vrouter module that could be causing this, 
although we cannot be certain.
The leak is triggered when a new flow is created in vrouter. A fix is in the 
works for the latest release. If
you would like us to port the change to a specific earlier release, please let 
us know.

Thanks,

Raja

From: Foucault de Bonneval 
<[email protected]<mailto:[email protected]>>
Date: Wednesday, March 25, 2015 at 10:40 AM
To: "[email protected]<mailto:[email protected]>" 
<[email protected]<mailto:[email protected]>>
Subject: [opencontrail-dev] mem leak on compute nodes

Hi all,

We actually have an issue on a few compute nodes.

We met a phenomenon last septembre, that was (it seemed) fixed by Sylvain 
Afchain, there :
https://review.opencontrail.org/#/c/4868/

We actually are running last 1.10 with a build from the end of february.

The first symptom is that we have a few hypervisonrs that start swaping.

After investigations, it appears that the command "free" returns normal values.

Seen bellow the swaptop and free -m returns.

After investigations, it appears that we have a huge consuption of "Unreclaim" 
memory.
See the graphs with 1/30 days history.

We are running 3.13.0-44-generic #73~precise1-Ubuntu SMP on Ubuntu precise.

Any clue ? Any things I should add to improve the debug ?


Thanks,
Foucault

#########################################################################
% swaptop
190056 qemu-system-x86 15822
124276 qemu-system-x86 20430
70796 qemu-system-x86 3989
59412 qemu-system-x86 5760
18436 qemu-system-x86 47386
17616 qemu-system-x86 23791

#########################################################################
% free -m
total used free shared buffers cached
Mem: 96638 43614 53024 0 331 33478
-/+ buffers/cache: 9803 86834
Swap: 975 460 515

#########################################################################
% modinfo vrouter
filename:       /lib/modules/3.13.0-44-generic/extra/net/vrouter/vrouter.ko
version:        1.0
license:        GPL
srcversion:     D1BE1580CF8A8DD31B26BC0
depends:
vermagic:       3.13.0-44-generic SMP mod_unload modversions
parm:           vr_flow_entries:int
parm:           vr_oflow_entries:int
parm:           vr_bridge_entries:int
parm:           vr_bridge_oentries:int
parm:           vrouter_dbg:Set 1 for pkt dumping and 0 to disable, default 
value is 0 (int)

#########################################################################
% dropstats
GARP                          0
ARP notme                     752453
Invalid ARPs                  0

Invalid IF                    42
Trap No IF                    0
IF TX Discard                 0
IF Drop                       29780
IF RX Discard                 0

Flow Unusable                 0
Flow No Memory                0
Flow Table Full               0
Flow NAT no rflow             0
Flow Action Drop              5991
Flow Action Invalid           0
Flow Invalid Protocol         0
Flow Queue Limit Exceeded     1

Discards                      539
TTL Exceeded                  0
Mcast Clone Fail              0
Cloned Original               1003

Invalid NH                    62
Invalid Label                 0
Invalid Protocol              0
Rewrite Fail                  0
Invalid Mcast Source          0

Push Fails                    0
Pull Fails                    9
Duplicated                    581
Head Alloc Fails              0
Head Space Reserve Fails      0
PCOW fails                    0
Invalid Packets               0

Misc                          0
Nowhere to go                 0
Checksum errors               73
No Fmd                        0
Ivalid VNID                   0
Fragment errors               14
Invalid Source                388


_______________________________________________
Dev mailing list
[email protected]
http://lists.opencontrail.org/mailman/listinfo/dev_lists.opencontrail.org

Reply via email to