Writing large build logs to NFS extremely slow?

[Felix Palmen]

Hi all,

I use a -CURRENT bhyve vm for testing port builds with poudriere. As
this vm is only running when needed, but I want to always have access to
the build logs, I use NFS to mount /usr/local/poudriere/data/logs from
the host.

I noticed some few ports take ridiculously long to build while barely
using any CPU time at all. On a closer look, that's all ports producing
a lot of compiler (warning) output, e.g. gcc, gnutls, gtk2, …

So I assume appending to a large file via NFS gets slower and slower. Is
there any mount option I could try to fix this? Right now I only have
`nolockd`, I also tried `noncontigwr` which didn't change anything.

Thinking about alternatives to NFS, are there any news for client-side
9p virtfs? I found  which
still builds with a few minor adaptions, but trying to mount a 9p share
freezes the machine.

Would you suggest a different mailing list to ask?

BR, Felix

-- 
 Dipl.-Inform. Felix Palmen ,.//..
 {web}  http://palmen-it.de  {jabber} [see email]   ,//palmen-it.de
 {pgp public key} http://palmen-it.de/pub.txt   //   """
 {pgp fingerprint} A891 3D55 5F2E 3A74 3965 B997 3EF2 8B0A BC02 DA2A


signature.asc
Description: PGP signature

Re: make buildworld broken on RISC-V.

[Mitchell Horne]

On Wed, Oct 6, 2021 at 7:23 AM Karel Gardas  wrote:
>
>
> Hello,
>
> I'm using 14-CURRENT oprovided qcow2 image from September 30 in
> qemu-system-risc64. It runs fine so I'm testing it with attempting make
> buildworld. This unfortunately fails with:
>
> ===> lib/clang/headers (includes)
> [Creating objdir /usr/obj/usr/src/riscv.riscv64/lib/clang/headers...]
> clang-tblgen -gen-arm-bf16  -I
> /usr/src/contrib/llvm-project/clang/include/clang/Basic -d arm_bf16.h.d
> -o arm_bf16.h
> /usr/src/contrib/llvm-project/clang/include/clang/Basic/arm_bf16.td
> ELF binary type "0" not known.
> /usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: ELF�Т:
> not found
> /usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: @h�a@8:
> not found
> /usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: @@@0�:
> not found
> /usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: �: not
> found
> /usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: 1:
> Syntax error: "(" unexpected
> /usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: 5:
> Syntax error: Error in command substitution
> *** Error code 2
>
> Stop.
> make[5]: stopped in /usr/src/lib/clang/headers
> *** Error code 1
>
> Stop.
> make[4]: stopped in /usr/src/lib/clang
> *** Error code 1
>
> Stop.
> make[3]: stopped in /usr/src/lib
> *** Error code 1
>
> Stop.
> make[2]: stopped in /usr/src
>370.58 real   114.97 user   258.16 sys
> *** Error code 1
>
> Stop.
> make[1]: stopped in /usr/src
> *** Error code 1
>
> Stop.
> make: stopped in /usr/src
>
>
> I'm not sure which from available clang-tblgen is invoked:
>
> # find / -type f -name
> 'clang-tblgen'/usr/obj/usr/src/riscv.riscv64/tmp/legacy/bin/clang-tblgen
> /usr/obj/usr/src/riscv.riscv64/tmp/obj-tools/usr.bin/clang/clang-tblgen/clang-tblgen
>
>
> but both seems to be reasonable file types:
>
> root@freebsd:/usr/src/lib/clang/headers # file
> /usr/obj/usr/src/riscv.riscv64/tmp/legacy/bin/clang-tblgen
> /usr/obj/usr/src/riscv.riscv64/tmp/legacy/bin/clang-tblgen: ELF 64-bit
> LSB executable, UCB RISC-V, version 1 (SYSV), statically linked,
> FreeBSD-style, not stripped
> root@freebsd:/usr/src/lib/clang/headers # file
> /usr/obj/usr/src/riscv.riscv64/tmp/obj-tools/usr.bin/clang/clang-tblgen/clang-tblgen
> /usr/obj/usr/src/riscv.riscv64/tmp/obj-tools/usr.bin/clang/clang-tblgen/clang-tblgen:
> ELF 64-bit LSB executable, UCB RISC-V, version 1 (SYSV), statically
> linked, FreeBSD-style, not stripped
>
>
> Is there any trick how to solve this issue?
>

This has been reported here:
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=258358

There is a workaround provided which allows the build to proceed, see
comment #4 and #6.

Cheers,
Mitchell

> Thanks,
> Karel
>

make buildworld broken on RISC-V.

[Karel Gardas]

Hello,

I'm using 14-CURRENT oprovided qcow2 image from September 30 in 
qemu-system-risc64. It runs fine so I'm testing it with attempting make 
buildworld. This unfortunately fails with:


===> lib/clang/headers (includes)
[Creating objdir /usr/obj/usr/src/riscv.riscv64/lib/clang/headers...]
clang-tblgen -gen-arm-bf16  -I 
/usr/src/contrib/llvm-project/clang/include/clang/Basic -d arm_bf16.h.d 
-o arm_bf16.h 
/usr/src/contrib/llvm-project/clang/include/clang/Basic/arm_bf16.td

ELF binary type "0" not known.
/usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: ELF�Т: 
not found
/usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: @h�a@8: 
not found
/usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: @@@0�: 
not found
/usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: �: not 
found
/usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: 1: 
Syntax error: "(" unexpected
/usr/obj/usr/src/riscv.riscv64/tmp/legacy/usr/sbin/clang-tblgen: 5: 
Syntax error: Error in command substitution

*** Error code 2

Stop.
make[5]: stopped in /usr/src/lib/clang/headers
*** Error code 1

Stop.
make[4]: stopped in /usr/src/lib/clang
*** Error code 1

Stop.
make[3]: stopped in /usr/src/lib
*** Error code 1

Stop.
make[2]: stopped in /usr/src
  370.58 real   114.97 user   258.16 sys
*** Error code 1

Stop.
make[1]: stopped in /usr/src
*** Error code 1

Stop.
make: stopped in /usr/src


I'm not sure which from available clang-tblgen is invoked:

# find / -type f -name 
'clang-tblgen'/usr/obj/usr/src/riscv.riscv64/tmp/legacy/bin/clang-tblgen

/usr/obj/usr/src/riscv.riscv64/tmp/obj-tools/usr.bin/clang/clang-tblgen/clang-tblgen


but both seems to be reasonable file types:

root@freebsd:/usr/src/lib/clang/headers # file 
/usr/obj/usr/src/riscv.riscv64/tmp/legacy/bin/clang-tblgen
/usr/obj/usr/src/riscv.riscv64/tmp/legacy/bin/clang-tblgen: ELF 64-bit 
LSB executable, UCB RISC-V, version 1 (SYSV), statically linked, 
FreeBSD-style, not stripped
root@freebsd:/usr/src/lib/clang/headers # file 
/usr/obj/usr/src/riscv.riscv64/tmp/obj-tools/usr.bin/clang/clang-tblgen/clang-tblgen
/usr/obj/usr/src/riscv.riscv64/tmp/obj-tools/usr.bin/clang/clang-tblgen/clang-tblgen: 
ELF 64-bit LSB executable, UCB RISC-V, version 1 (SYSV), statically 
linked, FreeBSD-style, not stripped



Is there any trick how to solve this issue?

Thanks,
Karel

Re: Bash Static broken with new ncurses update on current

[Baptiste Daroussin]

On Tue, Oct 05, 2021 at 11:46:45AM -0700, Manfred Antar (KN6KBS) wrote:
> After update to current world on 10/5/2021 bash static is broken:
> 
> cc -L./builtins -L/usr/local/lib -L/usr/local/lib -L./lib/glob  -L./lib/tilde 
>  -L./lib/sh  -L/usr/local/lib -fstack-protector-strong -fuse-ld=bfd  -static  
> -O2 -pipe  -DLIBICONV_PLUG -fstack-protector-strong -isystem 
> /usr/local/include -fno-strict-aliasing  -static -o bash shell.o eval.o 
> y.tab.o general.o make_cmd.o print_cmd.o   dispose_cmd.o execute_cmd.o 
> variables.o copy_cmd.o error.o  expr.o flags.o jobs.o subst.o hashcmd.o 
> hashlib.o mailcheck.o  trap.o input.o unwind_prot.o pathexp.o sig.o test.o 
> version.o  alias.o array.o arrayfunc.o assoc.o braces.o bracecomp.o 
> bashhist.o  bashline.o  list.o stringlib.o locale.o findcmd.o redir.o  
> pcomplete.o pcomplib.o syntax.o xmalloc.o  -lbuiltins -lglob -lsh -lreadline 
> -lhistory -lncursesw  -ltilde -L/usr/local/lib
> /usr/local/bin/ld.bfd: ./lib/sh/libsh.a(tmpfile.o): in function 
> `sh_mktmpname':
> tmpfile.c:(.text+0x85): warning: warning: mktemp() possibly used unsafely; 
> consider using mkstemp()
> /usr/local/bin/ld.bfd: /usr/local/lib/libreadline.a(display.o): in function 
> `update_line':
> display.c:(.text+0x4654): undefined reference to `tgoto'
> /usr/local/bin/ld.bfd: display.c:(.text+0x4664): undefined reference to 
> `tputs'
> /usr/local/bin/ld.bfd: display.c:(.text+0x48e1): undefined reference to 
> `tputs'
> /usr/local/bin/ld.bfd: display.c:(.text+0x48ff): undefined reference to 
> `tputs'
> /usr/local/bin/ld.bfd: display.c:(.text+0x4a62): undefined reference to 
> `tgoto'
> /usr/local/bin/ld.bfd: display.c:(.text+0x4a74): undefined reference to 
> `tputs'
> /usr/local/bin/ld.bfd: display.c:(.text+0x4b5d): undefined reference to 
> `tputs'
> /usr/local/bin/ld.bfd: display.c:(.text+0x4b8f): undefined reference to 
> `tputs'
> /usr/local/bin/ld.bfd: display.c:(.text+0x4bc7): undefined reference to 
> `tputs'
> /usr/local/bin/ld.bfd: /usr/local/lib/libreadline.a(display.o): in function 
> `_rl_clear_to_eol':
> display.c:(.text+0x4c15): undefined reference to `tputs'
> /usr/local/bin/ld.bfd: 
> /usr/local/lib/libreadline.a(display.o):display.c:(.text+0x4cf3): more 
> undefined references to `tputs' follow
> /usr/local/bin/ld.bfd: /usr/local/lib/libreadline.a(terminal.o): in function 
> `_rl_get_screen_size':
> terminal.c:(.text+0xd0): undefined reference to `tgetnum'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0x108): undefined reference to 
> `tgetnum'
> /usr/local/bin/ld.bfd: /usr/local/lib/libreadline.a(terminal.o): in function 
> `_rl_init_terminal_io':
> terminal.c:(.text+0x36d): undefined reference to `tgetent'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0x39b): undefined reference to 
> `tgetstr'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0x5b9): undefined reference to `PC'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0x5cc): undefined reference to `BC'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0x5d7): undefined reference to `UP'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0x603): undefined reference to `PC'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0x611): undefined reference to `BC'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0x61f): undefined reference to `UP'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0x63e): undefined reference to 
> `tgetflag'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0x64f): undefined reference to 
> `tgetflag'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0x6a3): undefined reference to 
> `tgetflag'
> /usr/local/bin/ld.bfd: /usr/local/lib/libreadline.a(terminal.o): in function 
> `_rl_backspace':
> terminal.c:(.text+0xa43): undefined reference to `tputs'
> /usr/local/bin/ld.bfd: terminal.c:(.text+0xa62): undefined reference to 
> `tputs'
> /usr/local/bin/ld.bfd: /usr/local/lib/libreadline.a(terminal.o): in function 
> `_rl_cr':
> terminal.c:(.text+0xb37): undefined reference to `tputs'
> /usr/local/bin/ld.bfd: /usr/local/lib/libreadline.a(terminal.o): in function 
> `rl_ding':
> terminal.c:(.text+0xb78): undefined reference to `tputs'
> /usr/local/bin/ld.bfd: /usr/local/lib/libreadline.a(terminal.o): in function 
> `_rl_standout_on':
> terminal.c:(.text+0xbd6): undefined reference to `tputs'
> /usr/local/bin/ld.bfd: 
> /usr/local/lib/libreadline.a(terminal.o):terminal.c:(.text+0xc06): more 
> undefined references to `tputs' follow
> cc: error: linker command failed with exit code 1 (use -v to see invocation)
> *** [bash] Error code 1
> 
> make[2]: stopped in /usr/ports/shells/bash/work/bash-5.1
> 1 error
> 
> make[2]: stopped in /usr/ports/shells/bash/work/bash-5.1
> ===> Compilation failed unexpectedly.
> Try to set MAKE_JOBS_UNSAFE=yes and rebuild before reporting the failure to
> the maintainer.
> *** Error code 1
> 
> Stop.
> make[1]: stopped in /usr/ports/shells/bash
> *** Error code 1
> 
> Stop.
> make: stopped in /usr/ports/shells/bash
> 
> 



Fixed, thank you for reporting

Bapt