Hi Foucault,
The fix has already been committed to the 2.1 release. It will be committed
to previous releases by early next week.
I don’t think there is an easy workaround without picking up the fix.
Raja
From: Foucault de Bonneval
<[email protected]<mailto:[email protected]>>
Date: Friday, March 27, 2015 at 12:00 PM
Cc: "[email protected]<mailto:[email protected]>"
<[email protected]<mailto:[email protected]>>
Subject: Re: [opencontrail-dev] mem leak on compute nodes
Raja,
Any progress with our issue ?
Based on the informations you gave, i reproduced the phenomenon with Tsung and
a webserver.
Ils there a quick fix / workaround de could use to lower the effect ?
Thanks.
Foucault
Le 26 mars 2015 19:22, "Foucault de Bonneval"
<[email protected]<mailto:[email protected]>> a écrit :
Raja,
Ho yes please backport to 1.10 branch !!!!
Foucault
Le 26 mars 2015 19:16, "Rajagopalan Sivaramakrishnan"
<[email protected]<mailto:[email protected]>> a écrit :
Hi Foucault,
We found a memory leak in the vrouter module that could be causing this,
although we cannot be certain.
The leak is triggered when a new flow is created in vrouter. A fix is in the
works for the latest release. If
you would like us to port the change to a specific earlier release, please let
us know.
Thanks,
Raja
From: Foucault de Bonneval
<[email protected]<mailto:[email protected]>>
Date: Wednesday, March 25, 2015 at 10:40 AM
To: "[email protected]<mailto:[email protected]>"
<[email protected]<mailto:[email protected]>>
Subject: [opencontrail-dev] mem leak on compute nodes
Hi all,
We actually have an issue on a few compute nodes.
We met a phenomenon last septembre, that was (it seemed) fixed by Sylvain
Afchain, there :
https://review.opencontrail.org/#/c/4868/
We actually are running last 1.10 with a build from the end of february.
The first symptom is that we have a few hypervisonrs that start swaping.
After investigations, it appears that the command "free" returns normal values.
Seen bellow the swaptop and free -m returns.
After investigations, it appears that we have a huge consuption of "Unreclaim"
memory.
See the graphs with 1/30 days history.
We are running 3.13.0-44-generic #73~precise1-Ubuntu SMP on Ubuntu precise.
Any clue ? Any things I should add to improve the debug ?
Thanks,
Foucault
#########################################################################
% swaptop
190056 qemu-system-x86 15822
124276 qemu-system-x86 20430
70796 qemu-system-x86 3989
59412 qemu-system-x86 5760
18436 qemu-system-x86 47386
17616 qemu-system-x86 23791
#########################################################################
% free -m
total used free shared buffers cached
Mem: 96638 43614 53024 0 331 33478
-/+ buffers/cache: 9803 86834
Swap: 975 460 515
#########################################################################
% modinfo vrouter
filename: /lib/modules/3.13.0-44-generic/extra/net/vrouter/vrouter.ko
version: 1.0
license: GPL
srcversion: D1BE1580CF8A8DD31B26BC0
depends:
vermagic: 3.13.0-44-generic SMP mod_unload modversions
parm: vr_flow_entries:int
parm: vr_oflow_entries:int
parm: vr_bridge_entries:int
parm: vr_bridge_oentries:int
parm: vrouter_dbg:Set 1 for pkt dumping and 0 to disable, default
value is 0 (int)
#########################################################################
% dropstats
GARP 0
ARP notme 752453
Invalid ARPs 0
Invalid IF 42
Trap No IF 0
IF TX Discard 0
IF Drop 29780
IF RX Discard 0
Flow Unusable 0
Flow No Memory 0
Flow Table Full 0
Flow NAT no rflow 0
Flow Action Drop 5991
Flow Action Invalid 0
Flow Invalid Protocol 0
Flow Queue Limit Exceeded 1
Discards 539
TTL Exceeded 0
Mcast Clone Fail 0
Cloned Original 1003
Invalid NH 62
Invalid Label 0
Invalid Protocol 0
Rewrite Fail 0
Invalid Mcast Source 0
Push Fails 0
Pull Fails 9
Duplicated 581
Head Alloc Fails 0
Head Space Reserve Fails 0
PCOW fails 0
Invalid Packets 0
Misc 0
Nowhere to go 0
Checksum errors 73
No Fmd 0
Ivalid VNID 0
Fragment errors 14
Invalid Source 388
_______________________________________________
Dev mailing list
[email protected]
http://lists.opencontrail.org/mailman/listinfo/dev_lists.opencontrail.org