On 03.08.2016 08:48, René van Dorst wrote: > ... > I also tested wireguard on a router. TP-Link WR1043ND v1.08 with a > Atheros AR9132 400MHz cpu. > Running LEDE 28-july-2016, wireguard & iperf3 via packagemanager.
so you do not observe crashing of the router like we do with the tp-link wr841Nv11 - do you also test iperf with udp packets , around 200 Mbit or so ? acording to openwrt wiki say that 1043v1.xx runs even slower cpu , but have 8Mb of flash TL-WR1043ND v1-v1.11 Atheros AR9132 400 8 32 Atheros AR9100 (integrated) b/g/n 5 1x 2.0 Yes as far as i understand is the lan also on the wifi chip, so this differs .. for the 841v11 it should be QCA9533-AL3A running with 560 MHz with 32 MB Ram Zentel A3S56D40GTP-50L. switch QCA9533-BL3A built-in https://wiki.openwrt.org/toh/TP-Link/tl-wr841nd https://wiki.openwrt.org/toh/TP-Link/tl-wr1043nd sidenode tplink name convention (to prevent confusion): mainly important is running number like 1043 or 841 and the hardware revision like v11, the N or ND are only antenna related, the .123 are factory firmware revision of the specific hardware revision - which is more important for us here On 03.08.2016 08:48, René van Dorst wrote: > Hi Jens, > > I would like to share my results on a MIPS cpu. > > I also tested wireguard on a router. TP-Link WR1043ND v1.08 with a > Atheros AR9132 400MHz cpu. > Running LEDE 28-july-2016, wireguard & iperf3 via packagemanager. > For my test I run wireguard and iperf3 on the same device on both sides. > Other side is a AMD A6-5400 with debian unstable running inside KVM. > Both connected to a gigabit switch. > > My results iperf: > - Plain ~100MBits > - WG ~24Mbits (TCP test) > > Greats, > > René van Dorst. > > Quoting jens <j...@viisauksena.de>: > >> On 27.07.2016 13:05, Jason A. Donenfeld wrote: >> >>> On Wed, Jul 27, 2016 at 12:26 PM, Jens Viisauksena >>> <j...@viisauksena.de> wrote: >>>> It should however not lead to netifd outofmemory, load of 2.6 and the >>>> oomkiller berserking around at all... even if its not directly wg >>>> fault. >>> One thing to try would be removing these lines from src/socket.c: >>> >>> socket.c >>> 386: sk_clear_memalloc(sock); >>> 394: sk_set_memalloc(sock->sk); >>> >>> I'd be interested to learn if that fixes things. >> >> sorry if you waited for answers .. >> we redo the testing with latest kernel >> [ 0.000000] Linux version 4.4.15 (fuzzle@builder) (gcc version 5.4.0 >> (LEDE GCC 5.4.0 r1119) ) #3 Thu Jul 28 01:05:08 UTC 2016 >> build from latest trunk by ourselve, before we use default packages and >> lede like this >> [ 0.000000] Linux version 4.4.15 (buildbot@builds) (gcc version 5.4.0 >> (LEDE GCC 5.4.0 r1114) ) #2 Tue Jul 26 17:57:45 UTC 2016 >> >> and with wireguard source from 27.7. also including your suggestions. >> >> still the same >> >> more detailed : >> >> we got out of memory and big cpuload when testing iperf with udp >> packets, (we forget to notice that before in our first testings which >> mode killed all the memory) >> and from the heavy load and low memory lede/openwrt shut down stuff and >> things broke apart >> (Reminder, Lede/Openwrt on TP link 841 v11 with 650 Mhz CPU and 32Mb >> Ram) >> >> with tcp traffic we got this time stable 16 Mbit, which sounds like a >> reasonable limit for this kind of small cpu without any optimzation. >> Also cpu load was lower. >> >> we wonder how to use more sophisticated tools on our testsetup with 2 >> real tplink routers connected + behind each one laptop to measure >> throughput with iperf3. this maybe is not possible at all without >> getting serial console access >> >> 2 lessons learned: 1. problem arises with upd traffic and result quickly >> in out of memory (with transmission peak at the beginning higher than >> the 15 mbit with tcp packets)) 2. tcp is stable with 15-16 Mbit >> some more thoughts: all this could maybe slightly increased by code >> optimization, slightly different cipher, maybe encrypting is harder than >> decrypting, which means download will be faster - while encryption is >> happen on big servers in Net >> >> to compare again with fastd - this are the numbers we could get fastd >> through the cpu/wire (we didnt did that testing in this special setup, >> maybe some time soon - at least i am curious) >> >> >> >> >> >> ### just the dmesg before crashing >> [ 0.000000] MyLoader: sysp=9fb7db5d, boardp=d56f3f67, parts=bfae9f0c >> [ 0.000000] bootconsole [early0] enabled >> [ 0.000000] CPU0 revision is: 00019374 (MIPS 24Kc) >> [ 0.000000] SoC: Qualcomm Atheros QCA9533 ver 2 rev 0 >> [ 0.000000] Determined physical RAM map: >> [ 0.000000] memory: 02000000 @ 00000000 (usable) >> [ 0.000000] Initrd not found or empty - disabling initrd >> [ 0.000000] No valid device tree found, continuing without >> [ 0.000000] Zone ranges: >> [ 0.000000] Normal [mem 0x0000000000000000-0x0000000001ffffff] >> [ 0.000000] Movable zone start for each node >> [ 0.000000] Early memory node ranges >> [ 0.000000] node 0: [mem 0x0000000000000000-0x0000000001ffffff] >> [ 0.000000] Initmem setup node 0 [mem >> 0x0000000000000000-0x0000000001ffffff] >> [ 0.000000] On node 0 totalpages: 8192 >> [ 0.000000] free_area_init_node: node 0, pgdat 804003d0, node_mem_map >> 81000000 >> [ 0.000000] Normal zone: 64 pages used for memmap >> [ 0.000000] Normal zone: 0 pages reserved >> [ 0.000000] Normal zone: 8192 pages, LIFO batch:0 >> [ 0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 32 >> bytes. >> [ 0.000000] Primary data cache 32kB, 4-way, VIPT, cache aliases, >> linesize 32 bytes >> [ 0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768 >> [ 0.000000] pcpu-alloc: [0] 0 >> [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. >> Total pages: 8128 >> [ 0.000000] Kernel command line: board=TL-WR841N-v11 >> console=ttyS0,115200 rootfstype=squashfs,jffs2 noinitrd >> [ 0.000000] PID hash table entries: 128 (order: -3, 512 bytes) >> [ 0.000000] Dentry cache hash table entries: 4096 (order: 2, 16384 >> bytes) >> [ 0.000000] Inode-cache hash table entries: 2048 (order: 1, 8192 >> bytes) >> [ 0.000000] Writing ErrCtl register=00000000 >> [ 0.000000] Readback ErrCtl register=00000000 >> [ 0.000000] Memory: 27740K/32768K available (2933K kernel code, 151K >> rwdata, 744K rodata, 260K init, 200K bss, 5028K reserved, 0K >> cma-reserved) >> [ 0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, >> Nodes=1 >> [ 0.000000] NR_IRQS:51 >> [ 0.000000] Clocks: CPU:650.000MHz, DDR:393.066MHz, AHB:216.666MHz, >> Ref:25.000MHz >> [ 0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles: >> 0xffffffff, max_idle_ns: 5880801374 ns >> [ 0.000009] sched_clock: 32 bits at 325MHz, resolution 3ns, wraps >> every 6607641598ns >> [ 0.008234] Calibrating delay loop... 432.53 BogoMIPS (lpj=2162688) >> [ 0.071106] pid_max: default: 32768 minimum: 301 >> [ 0.076110] Mount-cache hash table entries: 1024 (order: 0, 4096 >> bytes) >> [ 0.083096] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 >> bytes) >> [ 0.093471] clocksource: jiffies: mask: 0xffffffff max_cycles: >> 0xffffffff, max_idle_ns: 19112604462750000 ns >> [ 0.104645] NET: Registered protocol family 16 >> [ 0.110870] MIPS: machine is TP-LINK TL-WR841N/ND v11 >> [ 0.568855] clocksource: Switched to clocksource MIPS >> [ 0.575559] NET: Registered protocol family 2 >> [ 0.581064] TCP established hash table entries: 1024 (order: 0, 4096 >> bytes) >> [ 0.588427] TCP bind hash table entries: 1024 (order: 0, 4096 bytes) >> [ 0.595202] TCP: Hash tables configured (established 1024 bind 1024) >> [ 0.602025] UDP hash table entries: 256 (order: 0, 4096 bytes) >> [ 0.608200] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes) >> [ 0.615203] NET: Registered protocol family 1 >> [ 0.619896] PCI: CLS 0 bytes, default 32 >> [ 0.620920] futex hash table entries: 256 (order: -1, 3072 bytes) >> [ 0.644082] squashfs: version 4.0 (2009/01/31) Phillip Lougher >> [ 0.650332] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME) >> (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc. >> [ 0.663484] io scheduler noop registered >> [ 0.667635] io scheduler deadline registered (default) >> [ 0.673325] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled >> [ 0.680545] console [ttyS0] disabled >> [ 0.704475] serial8250.0: ttyS0 at MMIO 0x18020000 (irq = 11, >> base_baud = 1562500) is a 16550A >> [ 0.713586] console [ttyS0] enabled >> [ 0.721147] bootconsole [early0] disabled >> [ 0.732999] m25p80 spi0.0: found gd25q32, expected m25p80 >> [ 0.738601] m25p80 spi0.0: gd25q32 (4096 Kbytes) >> [ 0.744708] 5 tp-link partitions found on MTD device spi0.0 >> [ 0.750531] Creating 5 MTD partitions on "spi0.0": >> [ 0.755489] 0x000000000000-0x000000020000 : "u-boot" >> [ 0.762184] 0x000000020000-0x000000162710 : "kernel" >> [ 0.769118] 0x000000162710-0x0000003f0000 : "rootfs" >> [ 0.775937] mtd: device 2 (rootfs) set to be root filesystem >> [ 0.781932] 1 squashfs-split partitions found on MTD device rootfs >> [ 0.788320] 0x000000340000-0x0000003f0000 : "rootfs_data" >> [ 0.795617] 0x0000003f0000-0x000000400000 : "art" >> [ 0.802259] 0x000000020000-0x0000003f0000 : "firmware" >> [ 0.829961] libphy: ag71xx_mdio: probed >> [ 1.421422] ag71xx-mdio.1: Found an AR934X built-in switch >> [ 1.464748] eth0: Atheros AG71xx at 0xba000000, irq 5, mode:GMII >> [ 2.061807] ag71xx ag71xx.0: connected to PHY at ag71xx-mdio.1:04 >> [uid=004dd042, driver=Generic PHY] >> [ 2.072011] eth1: Atheros AG71xx at 0xb9000000, irq 4, mode:MII >> [ 2.080973] NET: Registered protocol family 10 >> [ 2.090540] NET: Registered protocol family 17 >> [ 2.095219] bridge: automatic filtering via arp/ip/ip6tables has been >> deprecated. Update your scripts to load br_netfilter if you need this. >> [ 2.108444] 8021q: 802.1Q VLAN Support v1.8 >> [ 2.121115] VFS: Mounted root (squashfs filesystem) readonly on >> device 31:2. >> [ 2.130267] Freeing unused kernel memory: 260K (8041f000 - 80460000) >> [ 3.221171] init: Console is alive >> [ 3.224937] init: - watchdog - >> [ 4.185893] init: - preinit - >> [ 4.817211] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready >> [ 4.844857] random: procd urandom read with 7 bits of entropy >> available >> [ 6.910299] eth0: link up (1000Mbps/Full duplex) >> [ 6.916280] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready >> [ 8.090413] jffs2_scan_eraseblock(): End of filesystem marker found >> at 0x10000 >> [ 8.097897] jffs2_build_filesystem(): unlocking the mtd device... >> done. >> [ 8.104748] jffs2_build_filesystem(): erasing all blocks after the >> end marker... done. >> [ 10.739288] jffs2: notice: (349) jffs2_build_xattr_subsystem: >> complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan) >> and 0 of xref (0 dead, 0 orphan) found. >> [ 10.756968] mount_root: overlay filesystem has not been fully >> initialized yet >> [ 10.768400] mount_root: switching to jffs2 overlay >> [ 10.999300] urandom-seed: Seed file not found (/etc/urandom.seed) >> [ 11.109948] eth0: link down >> [ 11.125253] procd: - early - >> [ 11.128356] procd: - watchdog - >> [ 11.738352] procd: - ubus - >> [ 11.793781] procd: - init - >> [ 12.094265] tun: Universal TUN/TAP device driver, 1.6 >> [ 12.099567] tun: (C) 1999-2004 Max Krasnyansky <m...@qualcomm.com> >> [ 12.120149] wireguard: WireGuard loaded. See www.wireguard.io for >> information. >> [ 12.127621] wireguard: (C) Copyright 2015-2016 Jason A. Donenfeld >> <ja...@zx2c4.com>. All Rights Reserved. >> [ 12.140039] ip6_tables: (C) 2000-2006 Netfilter Core Team >> [ 12.160019] Loading modules backported from Linux version >> wt-2016-06-20-0-gbc17424 >> [ 12.167850] Backport generated by backports.git >> backports-20160216-7-g5735958 >> [ 12.178703] ip_tables: (C) 2000-2006 Netfilter Core Team >> [ 12.195189] nf_conntrack version 0.5.0 (437 buckets, 1748 max) >> [ 12.244145] xt_time: kernel timezone is -0000 >> [ 12.314522] PPP generic driver version 2.4.2 >> [ 12.321763] NET: Registered protocol family 24 >> [ 12.376518] ath: EEPROM regdomain: 0x0 >> [ 12.376545] ath: EEPROM indicates default country code should be used >> [ 12.376554] ath: doing EEPROM country->regdmn map search >> [ 12.376576] ath: country maps to regdmn code: 0x3a >> [ 12.376587] ath: Country alpha2 being used: US >> [ 12.376595] ath: Regpair used: 0x3a >> [ 12.388362] ieee80211 phy0: Selected rate control algorithm >> 'minstrel_ht' >> [ 12.392478] ieee80211 phy0: Atheros AR9531 Rev:2 mem=0xb8100000, >> irq=47 >> [ 20.576096] device eth0 entered promiscuous mode >> [ 20.599684] IPv6: ADDRCONF(NETDEV_UP): br-lan: link is not ready >> [ 20.645872] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready >> [ 22.270331] eth0: link up (1000Mbps/Full duplex) >> [ 22.275169] br-lan: port 1(eth0) entered forwarding state >> [ 22.280839] br-lan: port 1(eth0) entered forwarding state >> [ 22.322565] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready >> [ 23.352464] eth1: link up (100Mbps/Full duplex) >> [ 23.357197] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready >> [ 24.278939] br-lan: port 1(eth0) entered forwarding state >> [ 77.338893] random: nonblocking pool is initialized >> [ 2545.780086] eth0: link down >> [ 2545.783413] br-lan: port 1(eth0) entered disabled state >> [ 2547.280148] eth0: link up (1000Mbps/Full duplex) >> [ 2547.284988] br-lan: port 1(eth0) entered forwarding state >> [ 2547.290680] br-lan: port 1(eth0) entered forwarding state >> [ 2549.288710] br-lan: port 1(eth0) entered forwarding state >> [ 2751.342810] netifd invoked oom-killer: gfp_mask=0x24201ca, order=0, >> oom_score_adj=0 >> [ 2751.351333] CPU: 0 PID: 695 Comm: netifd Not tainted 4.4.15 #3 >> [ 2751.357358] Stack : 803ba2c4 00000000 00000001 80410000 8197ea80 >> 80400d63 8039b9e4 000002b7 >> [ 2751.357358] 80463798 80febd1c 00000000 00000006 00001b58 >> 800a6820 00000006 ffffffff >> [ 2751.357358] 00000000 00000000 8039f45c 80febbbc 80466542 >> 800a47ec 804003d0 00000000 >> [ 2751.357358] 00000001 801ef300 00000000 00000000 00000000 >> 00000000 00000000 00000000 >> [ 2751.357358] 00000000 00000000 00000000 00000000 00000000 >> 00000000 00000000 00000000 >> [ 2751.357358] ... >> [ 2751.396800] Call Trace: >> [ 2751.399910] [<80071a20>] show_stack+0x50/0x84 >> [ 2751.404425] [<800d2ddc>] dump_header.isra.4+0x48/0x130 >> [ 2751.410546] [<800d31b0>] oom_kill_process+0x98/0x440 >> [ 2751.415683] [<800d38d0>] out_of_memory+0x2f4/0x330 >> [ 2751.421212] [<800d718c>] __alloc_pages_nodemask+0x67c/0x6e8 >> [ 2751.427014] [<800d21d0>] filemap_fault+0x254/0x454 >> [ 2751.432560] [<800ecafc>] __do_fault+0x3c/0xa8 >> [ 2751.437076] [<800efd28>] handle_mm_fault+0x4e0/0xb78 >> [ 2751.442797] [<80076638>] __do_page_fault+0x134/0x474 >> [ 2751.447940] [<80060820>] ret_from_exception+0x0/0x10 >> [ 2751.453625] >> [ 2751.455172] Mem-Info: >> [ 2751.457542] active_anon:246 inactive_anon:4 isolated_anon:0 >> [ 2751.457542] active_file:51 inactive_file:80 isolated_file:0 >> [ 2751.457542] unevictable:0 dirty:0 writeback:0 unstable:0 >> [ 2751.457542] slab_reclaimable:120 slab_unreclaimable:1272 >> [ 2751.457542] mapped:10 shmem:36 pagetables:39 bounce:0 >> [ 2751.457542] free:164 free_pcp:0 free_cma:0 >> [ 2751.490694] Normal free:660kB min:664kB low:828kB high:996kB >> active_anon:984kB inactive_anon:16kB active_file:204kB >> inactive_file:320kB unevictable:0kB isolated(anon):0kB >> isolated(file):0kB present:32768kB managed:28000kB mlocked:0kB dirty:0kB >> writeback:0kB mapped:40kB shmem:144kB slab_reclaimable:480kB >> slab_unreclaimable:5088kB kernel_stack:304kB pagetables:156kB >> unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB >> writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no >> [ 2751.535274] lowmem_reserve[]: 0 0 >> [ 2751.539269] Normal: 3*4kB (U) 41*8kB (UM) 20*16kB (U) 0*32kB 0*64kB >> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 660kB >> [ 2751.551718] 167 total pagecache pages >> [ 2751.555511] 0 pages in swap cache >> [ 2751.559484] Swap cache stats: add 0, delete 0, find 0/0 >> [ 2751.564887] Free swap = 0kB >> [ 2751.567862] Total swap = 0kB >> [ 2751.571632] 8192 pages RAM >> [ 2751.574438] 0 pages HighMem/MovableOnly >> [ 2751.578399] 1192 pages reserved >> [ 2751.582198] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds >> swapents oom_score_adj name >> [ 2751.591592] [ 395] 0 395 294 15 3 >> 0 0 0 ubusd >> [ 2751.601044] [ 396] 0 396 223 10 3 >> 0 0 0 askfirst >> [ 2751.610769] [ 659] 0 659 306 35 3 >> 0 0 0 logd >> [ 2751.620386] [ 695] 0 695 408 40 4 >> 0 0 0 netifd >> [ 2751.629944] [ 722] 0 722 320 21 3 >> 0 0 0 odhcpd >> [ 2751.639492] [ 754] 0 754 264 10 3 >> 0 0 0 dropbear >> [ 2751.648664] [ 856] 0 856 294 15 3 >> 0 0 0 ntpd >> [ 2751.658041] [ 915] 453 915 262 18 4 >> 0 0 0 dnsmasq >> [ 2751.667679] [ 1003] 0 1003 229 11 3 >> 0 0 0 odhcp6c >> [ 2751.677561] [ 1051] 0 1051 281 25 3 >> 0 0 0 dropbear >> [ 2751.687291] [ 1052] 0 1052 295 11 3 >> 0 0 0 ash >> [ 2751.696563] Out of memory: Kill process 695 (netifd) score 6 or >> sacrifice child >> [ 2751.704694] Killed process 1003 (odhcp6c) total-vm:916kB, >> anon-rss:40kB, file-rss:4kB >> root@lede:/tmp# Connection to 192.168.1.1 closed. >> >> _______________________________________________ >> WireGuard mailing list >> WireGuard@lists.zx2c4.com >> http://lists.zx2c4.com/mailman/listinfo/wireguard > > > > _______________________________________________ > WireGuard mailing list > WireGuard@lists.zx2c4.com > http://lists.zx2c4.com/mailman/listinfo/wireguard -- make the world nicer, please use PGP encryption
_______________________________________________ WireGuard mailing list WireGuard@lists.zx2c4.com http://lists.zx2c4.com/mailman/listinfo/wireguard