Re: [osv-dev] Re: FOSDEM24 Presentation

2024-02-11 Thread 'Nadav Har'El' via OSv Development
On Mon, Feb 5, 2024 at 8:10 PM Waldek Kozaczuk wrote: > In case you cannot play video using this direct link, here is an > alternative - >

Re: [osv-dev] Spam

2023-12-04 Thread 'Nadav Har'El' via OSv Development
On Mon, Dec 4, 2023 at 3:39 PM Nadav Har'El wrote: > Hi, > I have such access, and remove them once in a while, but unfortunately > these accounts usually subscribe and then send 10 spams immediately - so I > can remove them from the archive but it's too late for all the subsc

Re: [osv-dev] Spam

2023-12-04 Thread 'Nadav Har'El' via OSv Development
that :-( In the old days, I ran my own mailing list server (majordomo) and my own spam filtering tools, and had full control - but nowadays I can only hope that Google Groups does good spam filtering - which it usually does but not always :-( -- Nadav Har'El n...@scylladb.com On Mon, Dec 4, 2023 at 3

Re: [osv-dev] Re: Some questions about OSv

2023-11-30 Thread 'Nadav Har'El' via OSv Development
On Tue, Nov 28, 2023 at 12:22 PM ilya meignan-masson wrote: > Hello > I am also working on a similar project about page caching for databases. I > am also faced with similar issues as the OP. I have a workload that > executes for several minutes and the traces that I manage to extract are > only

Re: [osv-dev] Re: Some questions about OSv

2023-11-27 Thread 'Nadav Har'El' via OSv Development
On Tue, Nov 28, 2023 at 8:20 AM Waldek Kozaczuk wrote: > Hi, > > It is great to hear from you. Please see my answers below. > > I hope you also do not mind I reply to the group so others may add > something extra or refine/correct my answers as I am not an original > developer/designer of OSv. >

Re: [osv-dev] Re: [COMMIT osv master] Merge 'Dynamic linker: support loading and processing statically linked executables' from WALDEMAR KOZACZUK

2023-09-19 Thread 'Nadav Har'El' via OSv Development
"run" an object. In this case, the object is just being loaded as a dependency - it is not run - so we shouldn't have cared that it has an entry point. -- Nadav Har'El n...@scylladb.com On Tue, Sep 19, 2023 at 2:53 PM Nadav Har'El wrote: > > On Sun, Sep 10, 2023 at 10:54 PM Wald

Re: [osv-dev] Re: [COMMIT osv master] Merge 'Dynamic linker: support loading and processing statically linked executables' from WALDEMAR KOZACZUK

2023-09-19 Thread 'Nadav Har'El' via OSv Development
his patch: >> >> $ scripts/run.py >> OSv v0.57.0-61-g72ed41c6 >> eth0: 192.168.122.15 >> Booted up in 156.82 ms >> Cmdline: /cli >> >> Statically linked executables are not supported yet! >> >> Why does it think the Lua executable is stat

[osv-dev] Re: [COMMIT osv master] Merge 'Dynamic linker: support loading and processing statically linked executables' from WALDEMAR KOZACZUK

2023-09-10 Thread 'Nadav Har'El' via OSv Development
executables are not supported yet! Why does it think the Lua executable is statically linked? -- Nadav Har'El n...@scylladb.com On Thu, Aug 31, 2023 at 9:51 AM Commit Bot wrote: > From: Nadav Har'El > Committer: Nadav Har'El > Branch: master > > Merge 'Dynamic linker:

Re: [osv-dev] Need advice to how i can profile OSV virtual memory

2023-08-30 Thread 'Nadav Har'El' via OSv Development
On Tue, Aug 29, 2023 at 7:08 PM sangala mballa < sangalamballamic...@gmail.com> wrote: > Hi, > i want to track memory allocation and profile virtual memory. > > 1- I have set some logs in mmu code but it's not working > This is a very general statement, I don't know what you are trying to do or

Re: [osv-dev] Changes to support static executables and dynamically linked executables via Linux dynamic linker

2023-07-17 Thread 'Nadav Har'El' via OSv Development
On Mon, Jul 17, 2023 at 8:00 AM Waldek Kozaczuk wrote: > Hi, > > For the last 2 months or more, I have been quietly working on the changes > to OSv to support static executables and dynamically linked executables via > Linux dynamic linker (aka ld-linux-x86-64.so.2). > > I think I am at the

Re: [osv-dev] scripts/build and fs=ramfs

2023-06-07 Thread 'Nadav Har'El' via OSv Development
On Wed, Jun 7, 2023 at 5:31 PM Luca Abeni wrote: > Hi, > > On Wed, 7 Jun 2023 at 16:21, Nadav Har'El wrote: > > > > > > On Tue, Jun 6, 2023 at 7:25 PM Luca Abeni wrote: > >> > >> > >> So I got the impression that when using the microvm OSv

Re: [osv-dev] scripts/build and fs=ramfs

2023-06-07 Thread 'Nadav Har'El' via OSv Development
On Tue, Jun 6, 2023 at 7:25 PM Luca Abeni wrote: > > So I got the impression that when using the microvm OSv cannot read > the disk image... To confirm this, I tried using ramfs, and I get a > build error: > ./scripts/build image=native-example fs=ramfs > For me, this command works. >

Re: [osv-dev] [V2 3/4] libc: add RT sched API

2023-05-22 Thread 'Nadav Har'El' via OSv Development
On Wed, May 10, 2023 at 12:47 PM Nadav Har'El wrote: > > sched::thread *t; > if (pid == 0) { > t = sched::thread::current(); > } else { > t = sched::thread::find_by_id(pid); > if (!t) { > errno = ESRCH;

Re: [osv-dev] [V2 3/4] libc: add RT sched API

2023-05-22 Thread 'Nadav Har'El' via OSv Development
On Mon, May 22, 2023 at 12:53 AM Luca Abeni wrote: > Hi, > > On Wed, 10 May 2023 at 11:47, Nadav Har'El wrote: > [...] > >> +int sched_setscheduler(pid_t pid, int policy, > >> + const struct sched_param *param) > >> +{ > >>

Re: [osv-dev] Patches for running cyclictest on OSv

2023-05-10 Thread 'Nadav Har'El' via OSv Development
On Wed, May 10, 2023 at 12:07 PM Luca Abeni wrote: > On Wed, 10 May 2023 at 11:04, Nadav Har'El wrote: > > > > On Wed, May 10, 2023 at 12:02 PM Luca Abeni wrote: > >> > >> Hi, > >> > >> I just sent a new version of the patchset (at l

Re: [osv-dev] [V2 4/4] libc/time: add stub for clock_nanosleep

2023-05-10 Thread 'Nadav Har'El' via OSv Development
Thanks. Again, my review inline below. -- Nadav Har'El n...@scylladb.com On Wed, May 10, 2023 at 11:58 AM luca abeni wrote: > From: Claudio Fontana > > we only support CLOCK_MONOTONIC, and we don't support remainder > due to the signal implementation. > > Signed-off-b

Re: [osv-dev] [V2 3/4] libc: add RT sched API

2023-05-10 Thread 'Nadav Har'El' via OSv Development
Thanks! Looks better, but I still have some requests below. -- Nadav Har'El n...@scylladb.com On Wed, May 10, 2023 at 11:58 AM luca abeni wrote: > From: Claudio Fontana > > implement the sched_ API using the OSv realtime scheduler > implementation. > > This includes: >

Re: [osv-dev] [V2 2/4] Define __NEED_size_t in include/api/sched.h

2023-05-10 Thread 'Nadav Har'El' via OSv Development
Reviewed-by: Nadav Har'El -- Nadav Har'El n...@scylladb.com On Wed, May 10, 2023 at 11:58 AM luca abeni wrote: > From: luca abeni > > This header file actually uses size_t (for example, in the definition of > __sched_cpucount()). Hence, including api/sched.h without ha

Re: [osv-dev] Patches for running cyclictest on OSv

2023-05-10 Thread 'Nadav Har'El' via OSv Development
On Wed, May 10, 2023 at 12:02 PM Luca Abeni wrote: > Hi, > > I just sent a new version of the patchset (at least, I hope I sent > it... Using git-send-email with gmail is not fun :). > You can also do a github pull request, should be more fun :-) -- You received this message because you are

Re: [osv-dev] Patches for running cyclictest on OSv

2023-05-10 Thread 'Nadav Har'El' via OSv Development
On Wed, May 10, 2023 at 9:20 AM Luca Abeni wrote: > Hi, > > On Wed, 10 May 2023 at 02:34, Waldek Kozaczuk > wrote: > > > > Luca, > > > > I am not sure you have seen newly updated PR by Nadav that adds low > level support - > > https://github.com/cloudius-systems/osv/pull/1223. You may want to

Re: [osv-dev] Patches for running cyclictest on OSv

2023-05-10 Thread 'Nadav Har'El' via OSv Development
On Wed, May 3, 2023 at 7:40 PM Luca Abeni wrote: > > On Sun, 16 Apr 2023 at 23:29, Luca Abeni wrote: > [...] > > > 2. There is no reason I can see for adding #define __NEED_size_t in > include/api/sched.hh > > > > I think this comes from Claudio's original patch; I'll remove it anyway > > I

Re: [osv-dev] OSv can run dynamically linked executables via Linux dynamic linker - ld-linux-x86-64.so.2

2023-04-30 Thread 'Nadav Har'El' via OSv Development
On Sun, Apr 30, 2023 at 6:17 AM Waldek Kozaczuk wrote: > As you can see we have to explicitly tell OSv to run ld-linux-x86-64.so.2 > as a statically linked PIE and then give control over to it to launch the > hello executable. But going forward we can add a new kernel option to do > so. > Do we

Re: [osv-dev] OSv can run statically linked executable

2023-04-24 Thread 'Nadav Har'El' via OSv Development
On Mon, Apr 24, 2023 at 9:08 PM Waldek Kozaczuk wrote: > > > > >>>1. Fixing a potential bug in handling TCGETS in the console driver. >>> >>> I'm curious what this bug was - I am personally fond of this area of >> this code, as you can see from the history >> lesson in

Re: [osv-dev] OSv can run statically linked executable

2023-04-24 Thread 'Nadav Har'El' via OSv Development
On Mon, Apr 24, 2023 at 6:26 AM Waldek Kozaczuk wrote: > Hi, > > Over the recent week, I have been working to get OSv to run a simple > "hello world" app (aka native-example) built as a position-dependent > statically linked executable. > Nice! > >1. Support the arch_prctl syscall that

Re: [osv-dev] Patches for running cyclictest on OSv

2023-04-17 Thread 'Nadav Har'El' via OSv Development
On Mon, Apr 17, 2023 at 12:30 AM Luca Abeni wrote: > Hi, > > On Sun, 16 Apr 2023 at 18:18, Nadav Har'El wrote: > [...] > > It's hard for me to review the patches this way so next time please > either send them with git send-email or as github pull requests. > > Sorry

Re: [osv-dev] Patches for running cyclictest on OSv

2023-04-16 Thread 'Nadav Har'El' via OSv Development
ented") instead of "assert(0)" - only in the cases which you don't support. In the case we do properly support, there is no need to print a message at all. -- Nadav Har'El n...@scylladb.com On Mon, Apr 10, 2023 at 1:17 PM Luca Abeni wrote: > Hi all, > > I attach the patch

Re: [osv-dev] Syscalls

2023-04-16 Thread 'Nadav Har'El' via OSv Development
On Wed, Apr 12, 2023 at 5:59 AM Waldek Kozaczuk wrote: > Hi, > > I have just documented how OSv handles systems calls, which ones are > implemented and which ones should be trivial to implement (or expose) in > this new wiki page - https://github.com/cloudius-systems/osv/wiki/Syscalls > . > > As

Re: [osv-dev] Re: Build failed in Jenkins: osv-build-nightly #2967

2023-02-19 Thread 'Nadav Har'El' via OSv Development
On Sun, Feb 19, 2023 at 4:29 AM Waldek Kozaczuk wrote: > + exec ./scripts/test.py > TEST java-perms qemu-system-x86_64: -gdb > tcp::1234,server,nowait: Failed to find an available port: Address already > in use > qemu failed. > Test java-perms FAILED > Traceback (most

Re: [osv-dev] OSv talk

2023-02-05 Thread 'Nadav Har'El' via OSv Development
On Sun, Feb 5, 2023 at 10:23 AM Nadav Har'El wrote: > > On Sun, Feb 5, 2023 at 9:56 AM Waldek Kozaczuk > wrote: > >> If you are going to happen to have some time today from 12AM - 1PM >> Brussels time, please watch my talk here at >> https://fosdem.org/20

Re: [osv-dev] OSv talk

2023-02-05 Thread 'Nadav Har'El' via OSv Development
On Sun, Feb 5, 2023 at 9:56 AM Waldek Kozaczuk wrote: > If you are going to happen to have some time today from 12AM - 1PM > Brussels time, please watch my talk here at > https://fosdem.org/2023/schedule/event/osvevolution/. It should be > streamable live. > > Regards, > Waldemar Kozaczuk >

[osv-dev] Re: [PATCH v2] test/tst-feexcept.cc: Fix test for integer division by zero

2023-01-11 Thread 'Nadav Har'El' via OSv Development
Waldek, after my two patches from today, all the tests pass on my Fedora 36 build machine :-) I can also try Fedora 37 later. -- Nadav Har'El n...@scylladb.com On Wed, Jan 11, 2023 at 1:55 PM Nadav Har'El wrote: > tst-feexcept.cc checks several aspects of SIGFPE. One of the things &

[osv-dev] Re: [PATCH] test/tst-feexcept.cc: Fix test for integer division by zero

2023-01-11 Thread 'Nadav Har'El' via OSv Development
oops, forgot the "Fixes" line. Sent a v2. -- Nadav Har'El n...@scylladb.com On Wed, Jan 11, 2023 at 1:53 PM Nadav Har'El wrote: > tst-feexcept.cc checks several aspects of SIGFPE. One of the things > we noticed in the past, and tested, is that division by *integer* zero

[osv-dev] [PATCH v2] test/tst-feexcept.cc: Fix test for integer division by zero

2023-01-11 Thread 'Nadav Har'El' via OSv Development
Gcc 12, 1/0 started to return 0 instead of SIGFPE which broke this test. Changed the test to do division by zero in assembly-language, which still causes a SIGFPE. Fixes #1213 Signed-off-by: Nadav Har'El --- tests/tst-feexcept.cc | 8 ++-- 1 file changed, 6 insertions(+), 2 deletions(-)

[osv-dev] [PATCH] test/tst-feexcept.cc: Fix test for integer division by zero

2023-01-11 Thread 'Nadav Har'El' via OSv Development
Gcc 12, 1/0 started to return 0 instead of SIGFPE which broke this test. Changed the test to do division by zero in assembly-language, which still causes a SIGFPE. Signed-off-by: Nadav Har'El --- tests/tst-feexcept.cc | 8 ++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a

[osv-dev] [PATCH v2] Fix small memmove() implementation on Gcc 12

2023-01-11 Thread 'Nadav Har'El' via OSv Development
mpiler generates optimized copying code, which is surprisingly even (a bit) faster than the old code, and more importantly - correct. The patch also includes a memmove test (written by @wkozaczuk) that reproduces the bug and passes with the fix. Fixes #1212 Signed-off-by: Nadav Har'El --- ar

[osv-dev] Re: [PATCH] Fix small memmove() implementation on Gcc 12

2023-01-11 Thread 'Nadav Har'El' via OSv Development
Oops, sorry about the junk characters in the commit message. I'll resend. -- Nadav Har'El n...@scylladb.com On Wed, Jan 11, 2023 at 12:43 PM Nadav Har'El wrote: > Upgrading to Gcc 12 (e.g., as available on Fedora 36 and 37) broke > some cases of memmove() for overlapping memory areas. &

[osv-dev] [PATCH] Fix small memmove() implementation on Gcc 12

2023-01-11 Thread 'Nadav Har'El' via OSv Development
mpiler generates optimized copying code, which is surprisingly even (a bit) faster than the old code, and more importantly - correct. The patch also includes a memmove test (written by @wkozaczuk) that reproduces the bug and passes with the fix. Fixes #1212 Signed-off-by: Nadav Har'El x

Re: [osv-dev] Build failed in Jenkins: osv-build #1085

2023-01-01 Thread 'Nadav Har'El' via OSv Development
On Sun, Jan 1, 2023 at 11:11 PM Nadav Har'El wrote: > I'm trying now to wipe the working directory and rerunning the test, and > we'll see what happens. > It seemed it didn't help :-( https://jenkins.scylladb.com/view/osv/job/osv-build-nightly/lastBuild/ still builds in a weird wa

Re: [osv-dev] Build failed in Jenkins: osv-build #1085

2023-01-01 Thread 'Nadav Har'El' via OSv Development
I'm trying now to wipe the working directory and rerunning the test, and we'll see what happens. -- Nadav Har'El n...@scylladb.com On Fri, Dec 30, 2022 at 3:53 AM Waldek Kozaczuk wrote: > I wonder if that one failed because previous failures left corrupt > usr.manifest under m

Re: [osv-dev] Build failed in Jenkins: osv-build-nightly #2930

2022-12-29 Thread 'Nadav Har'El' via OSv Development
Opened https://github.com/cloudius-systems/osv/issues/1211 -- Nadav Har'El n...@scylladb.com On Wed, Dec 28, 2022 at 11:59 PM Nadav Har'El wrote: > If I run "make -j4 image=cassandra" on Fedora 36, I get exactly the same > errors as we now get on Jenkins: > > ... > No

Re: [osv-dev] Build failed in Jenkins: osv-build-nightly #2930

2022-12-28 Thread 'Nadav Har'El' via OSv Development
have a "libsunec.so" in usr/lib/jvm/java-17-openjdk-17.0.5.0.8-2.fc36.x86_64. *I searched the DNF repository, and saw that JDK up to version 11 had this "libsunec.so" file but versions above it, like 17, don't.Waldek, *do you remember what this is supposed to be and what we can d

Re: [osv-dev] Re: Please add me to the mailing list

2022-11-21 Thread 'Nadav Har'El' via OSv Development
On Thu, Nov 17, 2022 at 6:34 PM Waldek Kozaczuk wrote: > Hi, > > I think you can add yourself, no? > Indeed, just go to https://groups.google.com/g/osv-dev/ and subscribe to the group. -- You received this message because you are subscribed to the Google Groups "OSv Development" group. To

Re: [osv-dev] [PATCH] memory: move malloc virtual address space below 0x800000000000

2022-10-16 Thread 'Nadav Har'El' via OSv Development
lways have the git history). So I'll test this and commit it as-is. Thanks! -- Nadav Har'El n...@scylladb.com On Fri, Oct 14, 2022 at 3:08 AM Waldemar Kozaczuk wrote: > This patch changes the layout of the virtual address space to make > all virtual memory fit below the 0x8000

Re: [osv-dev] [COMMIT osv master] trace: do not use malloc/free when interrupts are disabled

2022-08-30 Thread 'Nadav Har'El' via OSv Development
On Tue, Aug 30, 2022 at 6:59 PM Commit Bot wrote: > From: Waldemar Kozaczuk > Committer: Waldemar Kozaczuk > Branch: master > > trace: do not use malloc/free when interrupts are disabled > > This patch fixes a subtle bug found when working on lazy stack changes > and trying to establish some

Re: [osv-dev] [COMMIT osv master] aarch64 trace: make compiler pick a register instead of x0

2022-08-30 Thread 'Nadav Har'El' via OSv Development
What a difference one character makes :-) -- Nadav Har'El n...@scylladb.com On Tue, Aug 30, 2022 at 6:59 PM Commit Bot wrote: > From: Waldemar Kozaczuk > Committer: Waldemar Kozaczuk > Branch: master > > aarch64 trace: make compiler pick a register instead of x0 > > Th

Re: [osv-dev] Build failed in Jenkins: osv-build #1077

2022-07-24 Thread Nadav Har'El
Your patch looks good to me, so feel free to apply it, but the commands you listed work also before your patch. -- Nadav Har'El n...@scylladb.com On Sun, Jul 24, 2022 at 6:45 PM Waldek Kozaczuk wrote: > Right. I think this is the right fix: > > diff --git a/Makefile b/Makefil

Re: [osv-dev] Build failed in Jenkins: osv-build #1077

2022-07-24 Thread Nadav Har'El
On second thought, why does zfs_builder.img depend on the size of loader.elf and not zfs_builder.elf? Are you familiar with the Makefile code ("git blame" suggests you wrote it)? Can you please have a look? Maybe this use of "image_size" in that specific code is a mistake

Re: [osv-dev] Build failed in Jenkins: osv-build #1077

2022-07-24 Thread Nadav Har'El
$@) Note how it needs image_size, which runs readelf on loader.elf, but doesn't depend on loader.elf. I'll prepare a patch but am not sure I can reproduce it... -- Nadav Har'El n...@scylladb.com On Sun, Jul 24, 2022 at 6:09 PM Nadav Har'El wrote: > On Mon, Jul 18, 2022 at 6:42 AM Waldek Ko

Re: [osv-dev] Build failed in Jenkins: osv-build #1077

2022-07-24 Thread Nadav Har'El
On Mon, Jul 18, 2022 at 6:42 AM Waldek Kozaczuk wrote: > It is weird. I cannot reproduce it. I assume that the aarch64 build > failed. Is it 'scripts/build -j$(nproc) arch=aarch64' in the Jenkins > machine? > Sort of, you can see in

Re: [osv-dev] [PATCH] routecache: handle case when sent to our non-loopback address

2022-07-24 Thread Nadav Har'El
On Sun, Jul 24, 2022 at 5:11 PM Waldek Kozaczuk wrote: > BTW there are more routecache related patches that I think we can bring in > from Spirent fork which I documented here - > https://github.com/cloudius-systems/osv/issues/1197. > This one looks like a bug fix - >

Re: [osv-dev] [PATCH] routecache: handle case when sent to our non-loopback address

2022-07-24 Thread Nadav Har'El
copy-edited more carefully, I see they have a lot of silly mistakes...), routecache.hh is all about the art of the "good enough", so it makes sense to continue this. -- Nadav Har'El n...@scylladb.com On Sat, Jul 23, 2022 at 9:15 PM Waldemar Kozaczuk wrote: > This patch modifies

Re: [osv-dev] [PATCH] vfs: support mounting ZFS from non-root partition

2022-07-17 Thread Nadav Har'El
Hi, I tried to commit this patch but it did not apply, probably I got the wrong order. Can you please apply this and the other related patches yourself, in the right order? Thanks. -- Nadav Har'El n...@scylladb.com On Sun, Jul 17, 2022 at 8:28 AM Waldemar Kozaczuk wrote: > This patch mai

Re: [osv-dev] [PATCH] vfs: support mounting ZFS from non-root partition

2022-07-17 Thread Nadav Har'El
On Sun, Jul 17, 2022 at 8:28 AM Waldemar Kozaczuk wrote: > This patch mainly enhances VFS layer to support dynamically loading > the ZFS library libsolaris.so from other root filesystem like ROFS and > mounting ZFS filesystem from devices different than /dev/vblk0.1. The > supported scenarios

Re: [osv-dev] Re: [COMMIT osv master] libc: implement getentropy()

2022-06-28 Thread Nadav Har'El
round the Java and just try to build the C++ tests). Maybe if you have time you can try - I'm sure it will be easier for you to fix the Java problems. > > On Sunday, June 26, 2022 at 6:28:34 AM UTC-4 Commit Bot wrote: > >> From: Nadav Har'El >> Committer: Nadav Har'El >

Re: [osv-dev] [PATCH] vfs: implement symlinkat

2022-05-18 Thread Nadav Har'El
On Wed, May 18, 2022 at 6:26 AM Waldemar Kozaczuk wrote: > This patch implements the symlinkat() function and enhances > tst-symlink.cc to unit test it. > > Signed-off-by: Waldemar Kozaczuk > --- > exported_symbols/osv_ld-musl.so.1.symbols | 1 + > exported_symbols/osv_libc.so.6.symbols|

Re: [osv-dev] [PATCH] unlinkat: fill the gaps in the implementation

2022-05-18 Thread Nadav Har'El
On Wed, May 18, 2022 at 6:26 AM Waldemar Kozaczuk wrote: > This patch enhances the unlinkat() implementation to handle > the AT_FDCWD dirfd and AT_REMOVEDIR flags. > > We also enhance tst-remove.cc to test unlinkat. > > Signed-off-by: Waldemar Kozaczuk > --- > fs/vfs/main.cc | 18

Re: [osv-dev] [PATCH] vfs: refactor the *at() functions

2022-05-18 Thread Nadav Har'El
On Wed, May 18, 2022 at 6:25 AM Waldemar Kozaczuk wrote: > The VFS functions like openat(), faccessat() and others alike > take a directory descriptor argument intended to make a filesystem > action happen relative to that directory. > > The implemetations of those function repeat almost the

Re: [osv-dev] Missing _dl_find_object()

2022-05-09 Thread Nadav Har'El
On Sat, May 7, 2022 at 8:32 AM Waldek Kozaczuk wrote: > After upgrading to newest Ubuntu 2022.04 I started seeing following > crashes of programs using libgcc_s.so: > > #0 _dl_find_object (pc1=0x1003f5ca <_Unwind_Resume+58>, > result=0x20200180) at linux.cc:542 > #1 0x100410f6

Re: [osv-dev] Build failed in Jenkins: osv-build #1065

2022-04-03 Thread Nadav Har'El
On Sun, Apr 3, 2022 at 12:54 PM Nadav Har'El wrote: > On Sun, Apr 3, 2022 at 10:47 AM Nadav Har'El wrote: > >> The local disk on muninn, which just has half a terabyte, is mostly >> filled by: >> >> 1. Almost a quarter terabyte of >> /jenkins/.lo

Re: [osv-dev] Build failed in Jenkins: osv-build #1065

2022-04-03 Thread Nadav Har'El
On Sun, Apr 3, 2022 at 10:47 AM Nadav Har'El wrote: > The local disk on muninn, which just has half a terabyte, is mostly filled > by: > > 1. Almost a quarter terabyte of > /jenkins/.local/share/containers/storage/overlay. This appears to be a > stash of ancient docker contai

Re: [osv-dev] Build failed in Jenkins: osv-build #1065

2022-04-03 Thread Nadav Har'El
/lib/docker Those two things account for *almost all *of the disk space used on that machine. I hesitate to clean up things that I don't fully understand, so please let me know if one of the others people on this thread (Beni? Avi?) can do this, or you want me to do this myself. -- Nadav Har'El n

Re: [osv-dev] Build failed in Jenkins: osv-build #1065

2022-04-03 Thread Nadav Har'El
The OSv tests have been failing because of the test machine (muninn) ran out of disk space. I'll see if I can find something conspicuous I can delete to reclaim space. -- Nadav Har'El n...@scylladb.com On Sun, Apr 3, 2022 at 2:33 AM wrote: > See <https://jenkins.scylladb.com/job/osv

Re: [osv-dev] Re: Crash in the FreeBSD networking stack code caused by likely bug in reference counting logic

2022-03-31 Thread Nadav Har'El
On Thu, Mar 31, 2022 at 6:19 AM Waldek Kozaczuk wrote: > BTW I have run more tests to see any performance gains and I failed to > notice any significant differences. So maybe atomics are not that expensive > in this case. But I think my proposal still stands. > > I also noticed that if I bump

Re: [osv-dev] Crash in the FreeBSD networking stack code caused by likely bug in reference counting logic

2022-03-31 Thread Nadav Har'El
took many weeks of work, and I don't think this issue is important enough. -- Nadav Har'El n...@scylladb.com On Tue, Mar 29, 2022 at 4:09 AM Waldek Kozaczuk wrote: > Hi, > > As I was working on a patch to address the issue > https://github.com/cloudius-systems/osv/iss

Re: [osv-dev] [COMMIT osv master] mmap: avoid collisions with linear map

2022-03-31 Thread Nadav Har'El
On Thu, Mar 31, 2022 at 6:36 AM Commit Bot wrote: > From: Waldemar Kozaczuk > Committer: Waldemar Kozaczuk > Branch: master > > mmap: avoid collisions with linear map > > This patch enhances virtual memory mapping code to track both > linear (linear_map) and non-linear (mmap()) virtual memory

Re: [osv-dev] [COMMIT osv master] loader.py: add linear_mmap command

2022-03-31 Thread Nadav Har'El
On Thu, Mar 31, 2022 at 6:29 AM Commit Bot wrote: > From: Waldemar Kozaczuk > Committer: Waldemar Kozaczuk > Branch: master > > loader.py: add linear_mmap command > > Similarly to the patch that adds new pseudo file > /sys/osv/memory/linear_maps, > this one adds new loader.py command that can

Re: [osv-dev] Proposal to change virtual memory layout

2022-03-13 Thread Nadav Har'El
On Fri, Mar 11, 2022 at 7:03 AM Waldek Kozaczuk wrote: > In the last couple of weeks I have been working on various issues related > to aarch64 port. I have managed to make good progress and I will be sending > new patches soon. > > Two issues had to do with making Java run on aarch64 - >

Re: [osv-dev] [PATCH 1/2] add new C-wrappers to expose module API

2022-01-19 Thread Nadav Har'El
Looks good. Just a couple of nitpicks below. On Mon, Jan 17, 2022 at 7:55 AM Waldemar Kozaczuk wrote: > The commit af2d371a61f6ab1eb5a066a0c3e93230faf6611c introduced ability > to build OSv kernel with most symbols but subset of glibc hidden. > The regular Linux glibc apps should run fine on

Re: [osv-dev] tst-tls-pie.so crashes with kernel compiled with most symbols hidden

2022-01-06 Thread Nadav Har'El
On Thu, Jan 6, 2022 at 6:56 AM Waldek Kozaczuk wrote: > Hi, > > When one compiles kernel with most symbols hidden (which also hides > completely STD C++ library), the tst-tls-pie.so crashes like so: > > #0 0x402da5b2 in processor::cli_hlt () at > arch/x64/processor.hh:247 > #1

Re: [osv-dev] Build failed in Jenkins: osv-build #1050

2021-12-22 Thread Nadav Har'El
changes or it's some bad luck that the compiler on Jenkins changed on the same day... -- Nadav Har'El n...@scylladb.com On Wed, Dec 22, 2021 at 3:16 PM wrote: > See <https://jenkins.scylladb.com/job/osv-build/1050/display/redirect> &g

Re: [osv-dev] [PATCH] libc: implement posix_madvise

2021-12-21 Thread Nadav Har'El
If the answer is no, then my question would be if we could at least not duplicate the linker scripts. Can't x86 and aarch have the same list of exported functions? And if two libraries contain the same symbols, could we somehow automatically copy symbols between them? > On Tuesday, December

Re: [osv-dev] [PATCH] libc: implement posix_madvise

2021-12-21 Thread Nadav Har'El
Can you please remind me why we need both OSV_LIBC_API and putting the function name in 5 different files? Isn't there a big risk that later when all this export stuff is less fresh in our mind, we forget one of these 6 places and create a mess? -- Nadav Har'El n...@scylladb.com On Tue, Dec 21

Re: [osv-dev] Roadmap going forward

2021-12-20 Thread Nadav Har'El
On Mon, Dec 20, 2021 at 4:23 AM Waldek Kozaczuk wrote: > Hi, > > It has been a while since the last release but I have only recently found > some time and energy to update the roadmap - > https://github.com/cloudius-systems/osv/wiki/Roadmap. It is meant to be a > "living" document that more-less

Re: [osv-dev] [PATCH V2] Better handle exceptions thrown by dynamic linker:

2021-12-09 Thread Nadav Har'El
On Thu, Dec 9, 2021 at 5:43 PM AubreyTurner wrote: > Use _init_called bool variable in elf object, initialize to false, set to > true > at end of run_init_funcs(), in run_fini_funcs() only call fini functions if > _init_called has been set to true. Avoids page fault case by only calling > fini >

Re: [osv-dev] [PATCH V2 1/2] Better handle exceptions thrown by dynamic linker:

2021-12-09 Thread Nadav Har'El
On Thu, Dec 9, 2021 at 5:09 PM Waldek Kozaczuk wrote: > This seems to be the exact same patch as you sent last time. > Also the title "1/2" suggests this is the first patch in a two-patch series. Is it? I don't see a second patch. > On Thu, Dec 9, 2021 at 2:15 AM AubreyTurner wrote: > >> Use

[osv-dev] Re: [PATCH v2] gdb: fix unique_ptr_get

2021-11-29 Thread Nadav Har'El
it I don't have much understanding on what I did there. I mostly had to guess what to do until I got something working :-( When I get this to work on Fedora 34 I'll continue my upgrade to Fedora 35 and see what breaks there ;-) -- Nadav Har'El n...@scylladb.com On Mon, Nov 29, 2021 at 3:28 PM

[osv-dev] [PATCH v2] gdb: fix unique_ptr_get

2021-11-29 Thread Nadav Har'El
ot;osv info threads" or "make check" on their setup. Fixes #1175 Fixes #1176 Signed-off-by: Nadav Har'El --- scripts/loader.py | 9 - 1 file changed, 8 insertions(+), 1 deletion(-) diff --git a/scripts/loader.py b/scripts/loader.py index 7706ba38..e39299bf 100644 --- a/sc

[osv-dev] [PATCH v2] stdio: fix setvbuf() to not set a weird buf size

2021-11-29 Thread Nadav Har'El
would require much more elaborate changes to Musl's stdio, which I didn't want to do. The code in this patch is a modified version of musl_1.1.24/src/stdio/setvbuf.c. Fixes #1180. Signed-off-by: Nadav Har'El --- Makefile | 2 +- libc/stdio/setvbuf.c | 43

[osv-dev] Re: [PATCH] stdio: fix setvbuf() to not set a weird buf size

2021-11-29 Thread Nadav Har'El
Oops, forgot a Makefile patch. I'll send a v2. -- Nadav Har'El n...@scylladb.com On Mon, Nov 29, 2021 at 2:07 PM Nadav Har'El wrote: > When we upgraded our Musl version, we got a newer version of setvbuf() > changed in Musl commit 0b80a7b04 in 2018. The old version of setvbuf() >

Re: [osv-dev] Re: [PATCH v2] gdb: fix unique_ptr_get

2021-11-29 Thread Nadav Har'El
November 24, 2021 at 5:07:20 PM UTC-5 Nadav Har'El wrote: >> >>> On Wed, Nov 24, 2021 at 5:00 PM Waldek Kozaczuk >>> wrote: >>> >>>> So I applied your patch on my Fedora 33 laptop and I get this error >>>> when running trace test: >>>

[osv-dev] Re: [PATCH] stdio: fix setvbuf() to not set a weird buf size

2021-11-29 Thread Nadav Har'El
Rick, can you please test this patch if it fixes the problem you had with reading the cdrom image? For me, it fixed the assertion failure, but then I saw some other error (about a missing file /usr-data) which I guess is expected, but I don't know how to fully test. -- Nadav Har'El n

[osv-dev] [PATCH] stdio: fix setvbuf() to not set a weird buf size

2021-11-29 Thread Nadav Har'El
would require much more elaborate changes to Musl's stdio, which I didn't want to do. The code in this patch is a modified version of musl_1.1.24/src/stdio/setvbuf.c. Fixes #1180. Signed-off-by: Nadav Har'El --- libc/stdio/setvbuf.c | 43 +++ 1 file changed

Re: [osv-dev] iso-read (cloud-init) issue

2021-11-29 Thread Nadav Har'El
Thanks! I'll try to reproduce it and open an issue. -- Nadav Har'El n...@scylladb.com On Sun, Nov 28, 2021 at 11:40 PM Rick Payne wrote: > > Thanks Nadav, I realise my report was a bit vague (even for me!). > > I'm a bit limited on data here at the moment (slow satellite email &

Re: [osv-dev] Hiding some symbols defined in bsd/* tree

2021-11-28 Thread Nadav Har'El
On Sun, Nov 28, 2021 at 3:15 PM Waldek Kozaczuk wrote: > As Nadav noted when reviewing my patch to hide/expose some libc and other > libraries related symbols, some of those defined in the bsd/ part of the > tree which originate from FreeBSD, may not necessarily "do" what their > Linux

Re: [osv-dev] [PATCH V2] libc: remove/add some aliases

2021-11-28 Thread Nadav Har'El
Looks good, but I have just one trivial comment below. On Fri, Nov 26, 2021 at 10:53 PM Waldemar Kozaczuk wrote: > This patch removes 3 aliases from aliases.ld for symbols that are either > internal musl symbols or are no longer present in glibc shared libraries > OSv dynamic linker advertises.

Re: [osv-dev] iso-read (cloud-init) issue

2021-11-28 Thread Nadav Har'El
g more and then dropping a part of it) but I'm not sure that it should - or why this only started to happen recently - so I don't want to go in this direction unless we know why. -- Nadav Har'El n...@scylladb.com On Sat, Nov 27, 2021 at 12:19 AM Rick Payne wrote: > Hiya, > > Trying to get clo

Re: [osv-dev] Re: [PATCH v2] gdb: fix unique_ptr_get

2021-11-24 Thread Nadav Har'El
t_tracing.py", > line 28, in tracing_smoke_test > assert(subprocess.call([trace_script, 'extract']) == 0) > AssertionError > > My gcc: > gcc --version > gcc (GCC) 10.3.1 20210422 (Red Hat 10.3.1-1) > Copyright (C) 2020 Free Software Foundation, Inc. > >

Re: [osv-dev] [PATCH 3/3] prepare to hide kernel symbols: hide some symbols

2021-11-22 Thread Nadav Har'El
On Sun, Nov 21, 2021 at 11:09 AM Waldemar Kozaczuk wrote: > This last patch in the series annotates some symbols in few > files that need to be hidden regardless if we compile kernel with > non-glibc symbols hidden or not. I see only a couple of these cases. Why did you need to do those

Re: [osv-dev] [PATCH 1/3] prepare to hide kernel symbols: add macros to expose and hide symbols

2021-11-22 Thread Nadav Har'El
On Sun, Nov 21, 2021 at 11:09 AM Waldemar Kozaczuk wrote: > This patch is the first one in the series that annotates relevant > symbols across number of source files in order to expose or hide them > when kernel is compiled to hide non-glibc symbols. Please note that none > of this patches

Re: [osv-dev] [PATCH] libc: remove/add some aliases

2021-11-22 Thread Nadav Har'El
On Sun, Nov 21, 2021 at 10:38 AM Waldemar Kozaczuk wrote: > This patch removes some entries from aliases.ld for symbols > that are not present in glibc shared libraries OSv dynamic linker > advertises. It also adds new entries for symbols that are present in the > same libraries. > >

Re: [osv-dev] [PATCH] libc: remove wrong implementation of setpgid()

2021-11-22 Thread Nadav Har'El
Right. This strange file was added in commit 661b72fe9d5daaf2b95abf88debde0de410311e6: Author: KANATSU Minoru Date: Thu Jun 12 04:20:35 2014 +0900 libc: add sid function for porting CRuby clearly, that commit didn't live up to its promise :-) -- Nadav Har'El n...@scylladb.com On Sun

Re: [osv-dev] [PATCH] libc: add missing sched_getcpu() declaration

2021-11-22 Thread Nadav Har'El
hed_getcpu(), but I guess it doesn't hurt either. -- Nadav Har'El n...@scylladb.com On Sun, Nov 21, 2021 at 9:14 AM Waldemar Kozaczuk wrote: > Signed-off-by: Waldemar Kozaczuk > --- > include/api/sched.h | 1 + > 1 file changed, 1 insertion(+) > > diff --git a/include/api/s

Re: [osv-dev] [PATCH] unit tests: change to use standard glibc and STD C++ constructs

2021-11-22 Thread Nadav Har'El
This patch appears to be corrupt - the line "int tests = 0, fails = 0;" is missing at least a space - and neither "git am" nor "patch" want to accept it. I don't want to try to fix it without knowing what else I might be missing - so can you please resend

[osv-dev] [PATCH v2] gdb: fix unique_ptr_get

2021-11-22 Thread Nadav Har'El
; on different compiler versions. Fixes #1175 Fixes #1176 (but the test fails in a new place, I guess I need to fix another problem). Signed-off-by: Nadav Har'El --- scripts/loader.py | 13 ++--- 1 file changed, 10 insertions(+), 3 deletions(-) diff --git a/scripts/loader.py b/scripts/l

[osv-dev] Re: [PATCH] gdb: fix unique_ptr_get

2021-11-22 Thread Nadav Har'El
On Mon, Nov 22, 2021 at 2:53 PM Nadav Har'El wrote: > In my setup (Fedora 34, gcc 11.2.1), suddenly the gdb scripts' > unique_ptr_get() stopped working in "osv info threads" and also in one > of the tests - see issues #1175 and #1176. > > The following patch, "i

[osv-dev] [PATCH] gdb: fix unique_ptr_get

2021-11-22 Thread Nadav Har'El
; on different compiler versions. Fixes #1175 Fixes #1176 (but the test fails in a new place, I guess I need to fix another problem). Signed-off-by: Nadav Har'El --- scripts/loader.py | 14 +++--- 1 file changed, 11 insertions(+), 3 deletions(-) diff --git a/scripts/loader.py b/scripts/l

Re: [osv-dev] [PATCH] scripts: update trace.py and prof.py to support generating flame graphs

2021-11-14 Thread Nadav Har'El
Hi, thanks. I'll commit this patch but I have a few comments below: On Sat, Nov 13, 2021 at 9:46 AM Waldemar Kozaczuk wrote: > After 4 years of asking in mailing list, this patch adds basic > support of generating flame graph "folded" intermediate format files. > Those files can be then fed to

Re: [osv-dev] [PATCH] scripts/osv/prof.py: update unimportant_prefixes

2021-11-14 Thread Nadav Har'El
I committed this because I assumed you know what you are doing, but I am curious: Why did you remove sched::timer_base::expire() from the list? Has this specific function become more interesting because of recent changes? On Sat, Nov 13, 2021 at 9:46 AM Waldemar Kozaczuk wrote: > Update

Re: [osv-dev] Hiding C++ standard library other non-glibc symbols and its implications to the tests and OSv apps and modules

2021-11-04 Thread Nadav Har'El
On Thu, Nov 4, 2021 at 2:47 AM Waldek Kozaczuk wrote: > Hi, > > I have been pretty quiet on this list since the P99 conference. Partly > because I was taking some time off and partly because I have been working > quietly on designing and implementing the changes to the OSv build system > to

Re: [osv-dev] Another filesystem, maybe ext2/3/4?

2021-10-13 Thread Nadav Har'El
On Wed, Oct 13, 2021 at 12:16 AM Gregory Burd wrote: > Hello OSv-ers, > > I'm a huge fan of ZFS, it's an amazing bit of work and I'm thrilled it's a > core component in OSv. That said, it's not a great choice in all cases, > the overhead of ZFS can outweigh the benefits. I've heard many

  1   2   3   4   5   6   7   8   9   10   >