>You are likely creating a rather large heap here: 2^9 pages for control >data managing the actual heap. What are your parameters to iddp, >size-wise? Something that results in about 64MB? Or even more?
The memory size for each page is 4KB, since "getconf PAGE_SIZE" says "4096". So, I think 2^9 pages are equivalent to 2MB(i.e. 2^9*4KB=2MB), not 64MB. Where am I wrong? And I didn't pass "--mempool-size" option to the program indeed. I think it should use the default heap size. I browsed the source code of xenomai-v3.1. I found that this error is outputted by *low_init() *which is called before the entry of the main function. On one hand, there is no chance to set the parameters of IDDP yet before the entry of the main function, on the other hand, this problem should have some relationships with IDDP since no such errors have been seen under other circumstances without using xddp and iddp. That is what confuses me. As to the parameters of iddp, here is the related code snippet (no other setting operations has been done other than this): * int fd = rt_dev_call(socket, AF_RTIPC, SOCK_DGRAM, IPCPROTO_IDDP); * * snprintf(iddpname, sizeof(iddpname), "iddp-%d", locator.port); * * struct _rtdm_setsockopt_args argOpt; * *struct rtipc_port_label plabel; * *argOpt.level = SOL_IDDP; * *argOpt.optname = IDDP_LABEL; * *argOpt.optval = &plabel; * *argOpt.optlen = sizeof(plabel); * *strcpy(plabel.label, iddpname); * *int ret = rt_dev_call(ioctl, fd, _RTIOC_SETSOCKOPT, &argOpt);* struct _rtdm_setsockaddr_args argbind; struct sockaddr_ipc svrAddr; svrAddr.sipc_family = AF_RTIPC; svrAddr.sipc_port = -1; argbind.addr = (struct sockaddr *)&svrAddr; argbind.addrlen = sizeof(svrAddr); ret = rt_dev_call(ioctl, fd, _RTIOC_BIND, &argbind); Thank you for your attention to this matter. Look forward to hearing from you. Best regards. Jan Kiszka <jan.kis...@siemens.com> 于2020年6月16日周二 下午5:39写道： > On 16.06.20 09:51, 孙世龙 via Xenomai wrote: > > Hi, > > As the subject, I encounter this error when I restarted a realtime > > process that uses *IDDP *on x86 embedded system. I am using xenomai3.1.0 > > and linux4.19.84. > > There are two points need to be emphasized: > > 1. After this error occurred, I could restart the program > successfully > > again. *This is different from the phenomenon I pointed out before which > > still reports the same error when I tried restart it again*(for your > > convenience, *the related email is posted at the footnote*). > > 2. I have seen such errors *many times *when used *XDDP *on the same > > platform. > > > > Thank you for your attention to this matter. > > Look forward to hearing from you. > > > > *The error output from the terminal when restart the program which > uses > > IDDP*: > > BUG_in_low_init(): [main] binding failed: Cannot allocate memory. > > > > *The related kernel log when using IDDP*: > > [22041.387673] HelloWorldExamp: page allocation failure: order:9, > > You are likely creating a rather large heap here: 2^9 pages for control > data managing the actual heap. What are you parameters to iddp, > size-wise? Something that results in about 64MB? Or even more? > > We can likely avoid this by switching from kmalloc to vmalloc in > xnheap_init. > > Jan > > > mode:0x60c0c0(GFP_KERNEL|__GFP_COMP|__GFP_ZERO), nodemask=(null) > > [22041.387678] HelloWorldExamp cpuset=/ mems_allowed=0 > > [22041.387690] CPU: 3 PID: 27737 Comm: HelloWorldExamp Not tainted > > 4.19.84-bros #5 > > [22041.387693] Hardware name: Advantech > UNO-2372G-J021AE/UNO-2372G-J021AE, > > BIOS 5.6.5 09/04/2019 > > [22041.387695] I-pipe domain: Linux > > [22041.387697] Call Trace: > > [22041.387711] dump_stack+0x9e/0xc8 > > [22041.387718] warn_alloc+0x100/0x190 > > [22041.387725] __alloc_pages_slowpath+0xb93/0xbd0 > > [22041.387732] __alloc_pages_nodemask+0x26d/0x2b0 > > [22041.387739] alloc_pages_current+0x6a/0xe0 > > [22041.387744] kmalloc_order+0x18/0x40 > > [22041.387748] kmalloc_order_trace+0x24/0xb0 > > [22041.387754] __kmalloc+0x20e/0x230 > > [22041.387759] ? __vmalloc_node_range+0x171/0x250 > > [22041.387765] xnheap_init+0x87/0x200 > > [22041.387770] ? remove_process+0xc0/0xc0 > > [22041.387775] cobalt_umm_init+0x61/0xb0 > > [22041.387779] cobalt_process_attach+0x64/0x4c0 > > [22041.387784] ? snprintf+0x45/0x70 > > [22041.387790] ? security_capable+0x46/0x60 > > [22041.387794] bind_personality+0x5a/0x120 > > [22041.387798] cobalt_bind_core+0x27/0x60 > > [22041.387803] CoBaLt_bind+0x18a/0x1d0 > > [22041.387812] ? handle_head_syscall+0x3f0/0x3f0 > > [22041.387816] ipipe_syscall_hook+0x119/0x340 > > [22041.387822] __ipipe_notify_syscall+0xd3/0x190 > > [22041.387827] ? __x64_sys_rt_sigaction+0x7b/0xd0 > > [22041.387832] ipipe_handle_syscall+0x3e/0xc0 > > [22041.387837] do_syscall_64+0x3b/0x250 > > [22041.387842] entry_SYSCALL_64_after_hwframe+0x44/0xa9 > > [22041.387847] RIP: 0033:0x7ff3d074e481 > > [22041.387852] Code: 89 c6 48 8b 05 10 6b 21 00 c7 04 24 00 00 00 a4 8b > 38 > > 85 ff 75 43 bb 00 00 00 10 c7 44 24 04 11 00 00 00 48 89 e7 89 d8 0f 05 > > <bf> 04 00 00 00 48 89 c3 e8 e2 e0 ff ff 8d 53 26 83 fa 26 0f 87 46 > > [22041.387855] RSP: 002b:00007ffc62caf210 EFLAGS: 00000246 ORIG_RAX: > > 0000000010000000 > > [22041.387860] RAX: ffffffffffffffda RBX: 0000000010000000 RCX: > > 00007ff3d074e481 > > [22041.387863] RDX: 0000000000000000 RSI: 0000000000000000 RDI: > > 00007ffc62caf210 > > [22041.387865] RBP: 00007ff3d20a3780 R08: 00007ffc62caf160 R09: > > 0000000000000000 > > [22041.387868] R10: 0000000000000008 R11: 0000000000000246 R12: > > 00007ff3d0965b00 > > [22041.387870] R13: 0000000001104320 R14: 00007ff3d0965d40 R15: > > 0000000001104050 > > [22041.387876] Mem-Info: > > [22041.387885] active_anon:56054 inactive_anon:109301 isolated_anon:0 > > active_file:110190 inactive_file:91980 isolated_file:0 > > unevictable:9375 dirty:1 writeback:0 unstable:0 > > slab_reclaimable:22463 slab_unreclaimable:19122 > > mapped:101678 shmem:25642 pagetables:7663 bounce:0 > > free:456443 free_pcp:0 free_cma:0 > > [22041.387891] Node 0 active_anon:224216kB inactive_anon:437204kB > > active_file:440760kB inactive_file:367920kB unevictable:37500kB > > isolated(anon):0kB isolated(file):0kB mapped:406712kB dirty:4kB > > writeback:0kB shmem:102568kB writeback_tmp:0kB unstable:0kB > > all_unreclaimable? no > > [22041.387893] Node 0 DMA free:15892kB min:32kB low:44kB high:56kB > > active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB > > unevictable:0kB writepending:0kB present:15992kB managed:15892kB > > mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB > > local_pcp:0kB free_cma:0kB > > [22041.387901] lowmem_reserve[]: 0 2804 3762 3762 > > [22041.387912] Node 0 DMA32 free:1798624kB min:5836kB low:8704kB > > high:11572kB active_anon:188040kB inactive_anon:219400kB > > active_file:184156kB inactive_file:346776kB unevictable:24900kB > > writepending:0kB present:3017476kB managed:2927216kB mlocked:24900kB > > kernel_stack:1712kB pagetables:7564kB bounce:0kB free_pcp:0kB > local_pcp:0kB > > free_cma:0kB > > [22041.387920] lowmem_reserve[]: 0 0 958 958 > > [22041.387930] Node 0 Normal free:11256kB min:1992kB low:2972kB > high:3952kB > > active_anon:36084kB inactive_anon:218100kB active_file:257220kB > > inactive_file:21148kB unevictable:12600kB writepending:4kB > > present:1048576kB managed:981268kB mlocked:12600kB kernel_stack:5280kB > > pagetables:23088kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB > > [22041.387938] lowmem_reserve[]: 0 0 0 0 > > [22041.387948] Node 0 DMA: 3*4kB (U) 3*8kB (U) 1*16kB (U) 1*32kB (U) > 3*64kB > > (U) 0*128kB 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = > > 15892kB > > [22041.387990] Node 0 DMA32: 14912*4kB (UME) 13850*8kB (UME) 9325*16kB > > (UME) 5961*32kB (UME) 3622*64kB (UME) 2359*128kB (UME) 1128*256kB (UME) > > 524*512kB (M) 194*1024kB (UM) 0*2048kB 0*4096kB = 1799872kB > > [22041.388033] Node 0 Normal: 1643*4kB (UME) 71*8kB (UME) 47*16kB (UM) > > 35*32kB (M) 38*64kB (M) 1*128kB (M) 0*256kB 0*512kB 0*1024kB 0*2048kB > > 0*4096kB = 11572kB > > [22041.388071] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 > > hugepages_size=2048kB > > [22041.388073] 232507 total pagecache pages > > [22041.388077] 7 pages in swap cache > > [22041.388079] Swap cache stats: add 1015, delete 1008, find 0/1 > > [22041.388081] Free swap = 995068kB > > [22041.388083] Total swap = 999420kB > > [22041.388086] 1020511 pages RAM > > [22041.388088] 0 pages HighMem/MovableOnly > > [22041.388090] 39417 pages reserved > > [22041.388092] 0 pages hwpoisoned > > > > > > *For your convenience, here is the former email which reports the > similar > > error when using XDDP.* > > *Hi，* > > * I encounter an error when starts a realtime process on x86 > > embedded system.* > > * The point to be emphasized, all the realtime processes have worked > > well for more than one day. I have terminated the realtime processes, > > started them again now and then.* > > * When I met the error showed below, none realtime process could be > > started again.* > > > > * Thank you for your attention to this matter.* > > * Look forward to hearing from you.* > > > > > > > > > > > > > > > > > > > > *#proceses error logyx@yx:~/Desktop/testfield$ sudo > > /usr/xenomai/demo/cyclictest 0"000.000| BUG in low_init(): [main] > binding > > failed: Cannot allocate memoryyx@yx:~/Desktop/testfield$ sudo > > /usr/xenomai/demo/iddp-label 0"000.000| BUG in low_init(): [main] > binding > > failed: Cannot allocate memoryyx@yx:~/Desktop/testfield$ sudo > > /usr/xenomai/demo/xddp-stream 0"000.000| BUG in low_init(): [main] > > binding failed: Cannot allocate memory* > > *#kernel start log which relates to xenomai* > > > > > > > > > > > > > > > > > > *[ 1.892216] Scanning for low memory corruption every 60 seconds[ > > 1.893662] [Xenomai] scheduling class idle registered.[ 1.893666] > > [Xenomai] scheduling class rt registered.[ 1.893719] [Xenomai] > > SMI-enabled chipset found, but SMI workaround disabled > > (see xenomai.smi parameter). You might encounter > > high latencies![ 1.893825] I-pipe: head domain Xenomai registered.[ > > 2.441991] [Xenomai] Cobalt v3.1* > > > > > > > > > > > > > > > > > > > > > > > > > > *#some information maybe usefullyx@yx:~/Desktop/testfield$ cat > > /proc/xenomai/heap TOTAL FREE NAME 83886080 83875840 system > > heap 83886080 83885952 shared heap yx@yx:~/Desktop/testfield$ free > > total used free shared buff/cache > availableMem: > > 3924376 746036 175456 103176 3002884 > > 2938096Swap: 999420 1280 > > 998140yx@yx:~/Desktop/testfield$* > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > *#related kernel log when process crashesyx@yx:~/Desktop/testfield$ > > dmesg[127458.765120] cyclictest: page allocation failure: order:9, > > mode:0x60c0c0(GFP_KERNEL|__GFP_COMP|__GFP_ZERO), > > nodemask=(null)[127458.765124] cyclictest cpuset=/ > > mems_allowed=0[127458.765136] CPU: 1 PID: 22203 Comm: cyclictest Not > > tainted 4.19.84[127458.765139] Hardware name: [127458.765141] I-pipe > > domain: Linux[127458.765143] Call Trace:[127458.765156] > > dump_stack+0x9e/0xc8[127458.765163] > warn_alloc+0x100/0x190[127458.765170] > > __alloc_pages_slowpath+0xb93/0xbd0[127458.765177] > > __alloc_pages_nodemask+0x26d/0x2b0[127458.765183] > > alloc_pages_current+0x6a/0xe0[127458.765189] > > kmalloc_order+0x18/0x40[127458.765193] > > kmalloc_order_trace+0x24/0xb0[127458.765199] > > __kmalloc+0x20e/0x230[127458.765204] ? > > __vmalloc_node_range+0x171/0x250[127458.765209] > > xnheap_init+0x87/0x200[127458.765214] ? > > remove_process+0xc0/0xc0[127458.765219] > > cobalt_umm_init+0x61/0xb0[127458.765224] > > cobalt_process_attach+0x64/0x4c0[127458.765230] ? > > security_capable+0x46/0x60[127458.765234] > > bind_personality+0x5a/0x120[127458.765238] > > cobalt_bind_core+0x27/0x60[127458.765243] > > CoBaLt_bind+0x18a/0x1d0[127458.765252] ? > > handle_head_syscall+0x3f0/0x3f0[127458.765256] > > ipipe_syscall_hook+0x119/0x340[127458.765262] > > __ipipe_notify_syscall+0xd3/0x190[127458.765267] ? > > __x64_sys_rt_sigaction+0x7b/0xd0[127458.765271] > > ipipe_handle_syscall+0x3e/0xc0[127458.765277] > > do_syscall_64+0x3b/0x250[127458.765282] > > entry_SYSCALL_64_after_hwframe+0x44/0xa9[127458.765287] RIP: > > 0033:0x7f566df60481[127458.765292] Code: 89 c6 48 8b 05 10 6b 21 00 c7 04 > > 24 00 00 00 a4 8b 38 85 ff 75 43 bb 00 00 00 10 c7 44 24 04 11 00 00 00 > 48 > > 89 e7 89 d8 0f 05 <bf> 04 00 00 00 48 89 c3 e8 e2 e0 ff ff 8d 53 26 83 fa > > 26 0f 87 46[127458.765295] RSP: 002b:00007ffc0f2f7260 EFLAGS: 00000246 > > ORIG_RAX: 0000000010000000[127458.765300] RAX: ffffffffffffffda RBX: > > 0000000010000000 RCX: 00007f566df60481[127458.765302] RDX: > 0000000000000000 > > RSI: 0000000000000000 RDI: 00007ffc0f2f7260[127458.765305] RBP: > > 00007f566e383b00 R08: 00007ffc0f2f71b0 R09: > 0000000000000000[127458.765307] > > R10: 0000000000000008 R11: 0000000000000246 R12: > > 00007f566e177b00[127458.765310] R13: 0000000000712650 R14: > 00007f566e177d40 > > R15: 0000000000712440[127458.765315] Mem-Info:[127458.765323] > > active_anon:73467 inactive_anon:73484 isolated_anon:0 > > active_file:280299 inactive_file:358436 isolated_file:0 > > unevictable:8 dirty:2 writeback:0 unstable:0 > > slab_reclaimable:66323 slab_unreclaimable:19884 > > mapped:51606 shmem:25794 pagetables:6947 bounce:0 > > free:25150 free_pcp:0 free_cma:0[127458.765329] Node 0 > > active_anon:293868kB inactive_anon:293936kB active_file:1121196kB > > inactive_file:1433744kB unevictable:32kB isolated(anon):0kB > > isolated(file):0kB mapped:206424kB dirty:8kB writeback:0kB shmem:103176kB > > writeback_tmp:0kB unstable:0kB all_unreclaimable? no[127458.765332] Node > 0 > > DMA free:15080kB min:32kB low:44kB high:56kB active_anon:0kB > > inactive_anon:0kB active_file:240kB inactive_file:548kB unevictable:0kB > > writepending:0kB present:15992kB managed:15892kB mlocked:0kB > > kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB > > free_cma:0kB[127458.765340] lowmem_reserve[]: 0 2805 3764 > > 3764[127458.765350] Node 0 DMA32 free:77852kB min:5840kB low:8712kB > > high:11584kB active_anon:212020kB inactive_anon:81800kB > > active_file:900260kB inactive_file:1349344kB unevictable:0kB > > writepending:4kB present:3017476kB managed:2927216kB mlocked:0kB > > kernel_stack:1296kB pagetables:5452kB bounce:0kB free_pcp:0kB > local_pcp:0kB > > free_cma:0kB[127458.765358] lowmem_reserve[]: 0 0 958 958[127458.765369] > > Node 0 Normal free:7668kB min:1992kB low:2972kB high:3952kB > > active_anon:81592kB inactive_anon:212236kB active_file:220696kB > > inactive_file:84104kB unevictable:32kB writepending:4kB present:1048576kB > > managed:981268kB mlocked:32kB kernel_stack:5088kB pagetables:22336kB > > bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB[127458.765377] > > lowmem_reserve[]: 0 0 0 0[127458.765387] Node 0 DMA: 4*4kB (UM) 5*8kB > (UME) > > 1*16kB (U) 3*32kB (UME) 5*64kB (UME) 2*128kB (ME) 2*256kB (UE) 1*512kB > (E) > > 3*1024kB (UME) 1*2048kB (E) 2*4096kB (M) = 15080kB[127458.765433] Node 0 > > DMA32: 1334*4kB (UME) 443*8kB (UME) 384*16kB (UME) 350*32kB (UME) > 458*64kB > > (UME) 129*128kB (M) 27*256kB (UM) 0*512kB 0*1024kB 0*2048kB 0*4096kB = > > 78960kB[127458.765472] Node 0 Normal: 1024*4kB (UMEH) 225*8kB (UMEH) > > 86*16kB (UMEH) 13*32kB (UME) 4*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB > > 0*2048kB 0*4096kB = 7944kB[127458.765508] Node 0 hugepages_total=0 > > hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB[127458.765510] > > 664534 total pagecache pages[127458.765514] 3 pages in swap > > cache[127458.765516] Swap cache stats: add 148, delete 145, find > > 0/0[127458.765518] Free swap = 998140kB[127458.765520] Total swap = > > 999420kB[127458.765523] 1020511 pages RAM[127458.765524] 0 pages > > HighMem/MovableOnly[127458.765526] 39417 pages reserved[127458.765528] 0 > > pages hwpoisonedyx@yx:~/Desktop/testfield$ * > > > > -- > Siemens AG, Corporate Technology, CT RDA IOT SES-DE > Corporate Competence Center Embedded Linux >
