FreeBSD Quarterly Status Report - Third Quarter 2020
FreeBSD Project Quarterly Status Report - Third Quarter 2020 Introduction This report covers FreeBSD related projects for the period between July and September, and is the third of four planned reports for 2020. This quarter brings a good mix of additions and changes to the FreeBSD Project and community, from a diverse number of teams and people covering everything from architectures, continuous integration, wireless networking and drivers, over drm, desktop and third-party project work, as well as several team reports, along with many other interesting subjects too numerous to mention. As the world is still affected by the epidemic, we hope that this report can also serve as a good reminder that there is good work that can be done by people working together, even if we're apart. We hope you'll be as interested in reading it, as we've been in making it. Daniel Ebdrup Jensen, on behalf of the quarterly team. __ FreeBSD Team Reports * FreeBSD Foundation * FreeBSD Release Engineering Team * Cluster Administration Team * Continuous Integration * Ports Collection * FreeBSD Office team - 3rd quarter 2020 report * FreeBSD Graphics Team status report Projects * FreeBSD on Microsoft HyperV and Azure * Building FreeBSD on non-FreeBSD hosts * Git Migration Working Group * Linux compatibility layer update * LLDB Debugger Improvements * Lua usage in FreeBSD * NFS over TLS implementation * syzkaller on FreeBSD Kernel * DRM Drivers Update * DTS Update * DesignWare Ethernet adapter driver improvements * Google Summer of Code'20 Project - eBPF XDP Hooks * ENA FreeBSD Driver Update * IPSec Extended Sequence Number (ESN) support * NXP ARM64 SoC support * Addition of PowerPC64LE Architecture * ure - USB 3.0 Gigabit Ethernet Driver update * Stateless hardware offloads for VXLANs * Wireless updates * ZSTD Compression in ZFS Architectures * CheriBSD 2020 Q3 * FreeBSD/RISC-V Project Ports * Update to grub-bhyve * KDE on FreeBSD Documentation * DOCNG on FreeBSD Third-Party Projects * Potluck - Flavour & Image Repository for pot __ FreeBSD Team Reports Entries from the various official and semi-official teams, as found in the Administration Page. FreeBSD Foundation Contact: Deb Goodkin The FreeBSD Foundation is a 501(c)(3) non-profit organization dedicated to supporting and promoting the FreeBSD Project and community worldwide. Funding comes from individual and corporate donations and is used to fund and manage software development projects, conferences and developer summits, and provide travel grants to FreeBSD contributors. The Foundation purchases and supports hardware to improve and maintain FreeBSD infrastructure and provides resources to improve security, quality assurance, and release engineering efforts; publishes marketing material to promote, educate, and advocate for the FreeBSD Project; facilitates collaboration between commercial vendors and FreeBSD developers; and finally, represents the FreeBSD Project in executing contracts, license agreements, and other legal arrangements that require a recognized legal entity. Here are some highlights of what we did to help FreeBSD last quarter: COVID-19 Impact to the Foundation Like other organizations, we put policies in place for all of our staff members to work from home. We also put a temporary ban on travel for staff members. We are continuing our work supporting the community and Project, but some of our work and responses may be delayed because of changes in some of our priorities and the impact of limited childcare for a few of our staff members. Partnerships and Commercial User Support We help facilitate collaboration between commercial users and FreeBSD developers. We also meet with companies to discuss their needs and bring that information back to the Project. Not surprisingly, the stay at home orders, combined with our company ban on travel during Q3 made in-person meetings non-existent. However, the team was able to continue meeting with our partners and commercial users virtually. These meetings help us understand some of the applications where FreeBSD is used. We are currently scheduling Zoom company meetings for Q4, please reach out if you would like to schedule a meeting with us. Fundraising Efforts Last quarter we raised $192,874.43! Thank you to the individuals and organizations that stepped in, to help fund our efforts. We'd like to thank Arm for their large contribution last quarter, which helped bring our 2020 fundraising effort to $521k. We hope other organizations will follow
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Thanks for the tip! I've fixed the issue following the following steps: 1) added two new disks with the same size: da3 and da4 2) Made a partition for both: gpart create -s gpt da3 gpart create -s gpt da4 gpart add -t freebsd-zfs da3 gpart add -t freebsd-zfs da4 3) replace both disks on pool zpool replace zroot da2 da3p1 zpool replace zroot da3 da4p1 4) rebuild bootcode gpart boocode -b /boot/pmbr -p /boot/gptzfsboot -i 1 da0 Done! I rebooted and everything is working again. Thank you guys for the support. On Wed, Oct 21, 2020 at 5:36 PM Walter Cramer wrote: > I very much doubt that there's any remotely sane way to re-partition da1 & > da2 while they are in the pool. > > If you carefully edit the output of the 'gpart backup' command, you > probably can use 'gpart restore' to partition da1 and da2. Read the > 'gpart' man page very carefully, if you aren't familiar with that. Also, > you'll probably want to install bootstrap code on da1 & da2 with 'gpart > bootstrap'. > > -Walter > > On Wed, 21 Oct 2020, Cassiano Peixoto wrote: > > > Walter, > > Yes, gpt/disk0 is da0. I can do the partition backup booting from livecd. > But is there a way to make the partition of da1 and da2 since both are > already inserted on pool? I think it's not allowed... > > Thanks. > > > On Wed, Oct 21, 2020 at 5:18 PM Walter Cramer wrote: > > > My guess - there is a work-around or two, but you'll face a lot more > > grief, long-term, if you don't do things the right way (aka do a bunch of > > re-install work) now. > > > > I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to > > see how the original disk is partitioned. Then duplicate that > > partitioning on da1 and da2. > > > > -Walter > > > > On Wed, 21 Oct 2020, Cassiano Peixoto wrote: > > > > > Hi guys, > > > > Thank your for your answer. > > > > @Ricchard First of all I didn't have a chance to run zpool upgrade, > because > > after the system update reboot i ran into the issue. > > > > @Walter and @mike Regarding making a partition, I never see any > > recommendation about this, I've been always using the entire disk on a > pool > > to expand it. Until FreeBSD 11.2 it worked fine. > > > > Is there a workaround for this or should I reinstall the entire pool? > > > > On Wed, Oct 21, 2020 at 4:45 PM mike tancsa wrote: > > > > > Just a guess, Is your VM still trying to boot from whatever gpt/disk0 > is > > > ? Or is it perhaps trying to boot from da1 or da2 which does not have > > > boot info ? Generally its not recommended to use the entire disk as > > > part of a pool. Create a partition scheme first > > > > > > gpart create -s gpt da1 > > > > > > gpart add -t freebsd-zfs da1 > > > > > > then add da1p1 to the pool > > > > > > ---Mike > > > > > > > > > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > > > > Hi there, > > > > > > > > Anyone can help please? I've many servers with this same issue. > Thanks > > > > > > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < > > > peixotocassi...@gmail.com> > > > > wrote: > > > > > > > >> Hi there, > > > >> > > > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I > > > added two more disks to expand my pool. BTW I already did it many time > > with > > > no issues. > > > >> > > > >> I ran: > > > >> > > > >> # zpool status > > > >> pool: zroot > > > >> state: ONLINE > > > >> status: Some supported features are not enabled on the pool. The > pool > > > can > > > >> still be used, but some features are unavailable. > > > >> action: Enable all features using 'zpool upgrade'. Once this is > done, > > > >> the pool may no longer be accessible by software that does not > > > support > > > >> the features. See zpool-features(7) for details. > > > >> scan: none requested > > > >> config: > > > >> > > > >> NAME STATE READ WRITE CKSUM > > > >> zrootONLINE 0 0 0 > > > >>gpt/disk0 ONLINE 0 0 0 > > > >> > > > >> errors: No known data errors > > > >> > > > >> # zpool add -f zroot da1 > > > >> # zpool add -f zroot da2 > > > >> # zpool status > > > >> pool: zroot > > > >> state: ONLINE > > > >> scan: none requested > > > >> config: > > > >> > > > >> NAME STATE READ WRITE CKSUM > > > >> zrootONLINE 0 0 0 > > > >>gpt/disk0 ONLINE 0 0 0 > > > >>da1ONLINE 0 0 0 > > > >>da2ONLINE 0 0 0 > > > >> > > > >> errors: No known data errors > > > >> # reboot > > > >> > > > >> Then my system doesn’t boot anymore, i got the following error: > > > >> > > > >> gptzfsboot: error 4 lba 2038346899 > > > >> gptzfsboot: error 4 lba 1361327267 > > > >> /boot/config: -Dh > > > >> > > > >> BTX loader 1.00 BTX version is 1.02 > > > >> Consoles: internal video/keyboard serial port > > > >> BIOS drive A: is fd0 > > > >> BIOS drive C: is disk0 > > > >> BIOS drive D: is disk1 > > > >> BIOS drive E: is disk2
Re: Zpool doesn't boot anymore after FreeBSD 12.1
I very much doubt that there's any remotely sane way to re-partition da1 & da2 while they are in the pool. If you carefully edit the output of the 'gpart backup' command, you probably can use 'gpart restore' to partition da1 and da2. Read the 'gpart' man page very carefully, if you aren't familiar with that. Also, you'll probably want to install bootstrap code on da1 & da2 with 'gpart bootstrap'. -Walter On Wed, 21 Oct 2020, Cassiano Peixoto wrote: Walter, Yes, gpt/disk0 is da0. I can do the partition backup booting from livecd. But is there a way to make the partition of da1 and da2 since both are already inserted on pool? I think it's not allowed... Thanks. On Wed, Oct 21, 2020 at 5:18 PM Walter Cramer wrote: My guess - there is a work-around or two, but you'll face a lot more grief, long-term, if you don't do things the right way (aka do a bunch of re-install work) now. I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to see how the original disk is partitioned. Then duplicate that partitioning on da1 and da2. -Walter On Wed, 21 Oct 2020, Cassiano Peixoto wrote: > Hi guys, Thank your for your answer. @Ricchard First of all I didn't have a chance to run zpool upgrade, because after the system update reboot i ran into the issue. @Walter and @mike Regarding making a partition, I never see any recommendation about this, I've been always using the entire disk on a pool to expand it. Until FreeBSD 11.2 it worked fine. Is there a workaround for this or should I reinstall the entire pool? On Wed, Oct 21, 2020 at 4:45 PM mike tancsa wrote: > Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is > ? Or is it perhaps trying to boot from da1 or da2 which does not have > boot info ? Generally its not recommended to use the entire disk as > part of a pool. Create a partition scheme first > > gpart create -s gpt da1 > > gpart add -t freebsd-zfs da1 > > then add da1p1 to the pool > > ---Mike > > > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > > Hi there, > > > > Anyone can help please? I've many servers with this same issue. Thanks > > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < > peixotocassi...@gmail.com> > > wrote: > > > >> Hi there, > >> > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I > added two more disks to expand my pool. BTW I already did it many time with > no issues. > >> > >> I ran: > >> > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> status: Some supported features are not enabled on the pool. The pool > can > >> still be used, but some features are unavailable. > >> action: Enable all features using 'zpool upgrade'. Once this is done, > >> the pool may no longer be accessible by software that does not > support > >> the features. See zpool-features(7) for details. > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zrootONLINE 0 0 0 > >>gpt/disk0 ONLINE 0 0 0 > >> > >> errors: No known data errors > >> > >> # zpool add -f zroot da1 > >> # zpool add -f zroot da2 > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zrootONLINE 0 0 0 > >>gpt/disk0 ONLINE 0 0 0 > >>da1ONLINE 0 0 0 > >>da2ONLINE 0 0 0 > >> > >> errors: No known data errors > >> # reboot > >> > >> Then my system doesn???t boot anymore, i got the following error: > >> > >> gptzfsboot: error 4 lba 2038346899 > >> gptzfsboot: error 4 lba 1361327267 > >> /boot/config: -Dh > >> > >> BTX loader 1.00 BTX version is 1.02 > >> Consoles: internal video/keyboard serial port > >> BIOS drive A: is fd0 > >> BIOS drive C: is disk0 > >> BIOS drive D: is disk1 > >> BIOS drive E: is disk2 > >> BIOS drive F: is disk3 > >> BIOS drive G: is disk4 > >> BIOS drive H: is disk5 > >> ZFS: i/o error - all block copies unavailable > >> ZFS: failed to read pool zroot directory object > >> BIOS 638kB/3143616kB available memory > >> > >> FreeBSD/x86 bootstrap loader, Revision 1.1 > >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. > >> > >> Type '?' for list of commands, 'help' for more datailed help. > >> OK > >> > >> I can import my pool with no problems using the lived, but I could not > fix it. > >> > >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? > >> > >> Thanks. > >> > >> > >> > >> > > ___ > > freebsd-stable@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to " freebsd-stable-unsubscr...@freebsd.org > " > > > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Walter, Yes, gpt/disk0 is da0. I can do the partition backup booting from livecd. But is there a way to make the partition of da1 and da2 since both are already inserted on pool? I think it's not allowed... Thanks. On Wed, Oct 21, 2020 at 5:18 PM Walter Cramer wrote: > My guess - there is a work-around or two, but you'll face a lot more > grief, long-term, if you don't do things the right way (aka do a bunch of > re-install work) now. > > I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to > see how the original disk is partitioned. Then duplicate that > partitioning on da1 and da2. > > -Walter > > On Wed, 21 Oct 2020, Cassiano Peixoto wrote: > > > Hi guys, > > Thank your for your answer. > > @Ricchard First of all I didn't have a chance to run zpool upgrade, because > after the system update reboot i ran into the issue. > > @Walter and @mike Regarding making a partition, I never see any > recommendation about this, I've been always using the entire disk on a pool > to expand it. Until FreeBSD 11.2 it worked fine. > > Is there a workaround for this or should I reinstall the entire pool? > > On Wed, Oct 21, 2020 at 4:45 PM mike tancsa wrote: > > > Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is > > ? Or is it perhaps trying to boot from da1 or da2 which does not have > > boot info ? Generally its not recommended to use the entire disk as > > part of a pool. Create a partition scheme first > > > > gpart create -s gpt da1 > > > > gpart add -t freebsd-zfs da1 > > > > then add da1p1 to the pool > > > > ---Mike > > > > > > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > > > Hi there, > > > > > > Anyone can help please? I've many servers with this same issue. Thanks > > > > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < > > peixotocassi...@gmail.com> > > > wrote: > > > > > >> Hi there, > > >> > > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I > > added two more disks to expand my pool. BTW I already did it many time > with > > no issues. > > >> > > >> I ran: > > >> > > >> # zpool status > > >> pool: zroot > > >> state: ONLINE > > >> status: Some supported features are not enabled on the pool. The pool > > can > > >> still be used, but some features are unavailable. > > >> action: Enable all features using 'zpool upgrade'. Once this is done, > > >> the pool may no longer be accessible by software that does not > > support > > >> the features. See zpool-features(7) for details. > > >> scan: none requested > > >> config: > > >> > > >> NAME STATE READ WRITE CKSUM > > >> zrootONLINE 0 0 0 > > >>gpt/disk0 ONLINE 0 0 0 > > >> > > >> errors: No known data errors > > >> > > >> # zpool add -f zroot da1 > > >> # zpool add -f zroot da2 > > >> # zpool status > > >> pool: zroot > > >> state: ONLINE > > >> scan: none requested > > >> config: > > >> > > >> NAME STATE READ WRITE CKSUM > > >> zrootONLINE 0 0 0 > > >>gpt/disk0 ONLINE 0 0 0 > > >>da1ONLINE 0 0 0 > > >>da2ONLINE 0 0 0 > > >> > > >> errors: No known data errors > > >> # reboot > > >> > > >> Then my system doesn’t boot anymore, i got the following error: > > >> > > >> gptzfsboot: error 4 lba 2038346899 > > >> gptzfsboot: error 4 lba 1361327267 > > >> /boot/config: -Dh > > >> > > >> BTX loader 1.00 BTX version is 1.02 > > >> Consoles: internal video/keyboard serial port > > >> BIOS drive A: is fd0 > > >> BIOS drive C: is disk0 > > >> BIOS drive D: is disk1 > > >> BIOS drive E: is disk2 > > >> BIOS drive F: is disk3 > > >> BIOS drive G: is disk4 > > >> BIOS drive H: is disk5 > > >> ZFS: i/o error - all block copies unavailable > > >> ZFS: failed to read pool zroot directory object > > >> BIOS 638kB/3143616kB available memory > > >> > > >> FreeBSD/x86 bootstrap loader, Revision 1.1 > > >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. > > >> > > >> Type '?' for list of commands, 'help' for more datailed help. > > >> OK > > >> > > >> I can import my pool with no problems using the lived, but I could not > > fix it. > > >> > > >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? > > >> > > >> Thanks. > > >> > > >> > > >> > > >> > > > ___ > > > freebsd-stable@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > > To unsubscribe, send any mail to " > freebsd-stable-unsubscr...@freebsd.org > > " > > > > > > ___ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/list
Re: Zpool doesn't boot anymore after FreeBSD 12.1
My guess - there is a work-around or two, but you'll face a lot more grief, long-term, if you don't do things the right way (aka do a bunch of re-install work) now. I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to see how the original disk is partitioned. Then duplicate that partitioning on da1 and da2. -Walter On Wed, 21 Oct 2020, Cassiano Peixoto wrote: Hi guys, Thank your for your answer. @Ricchard First of all I didn't have a chance to run zpool upgrade, because after the system update reboot i ran into the issue. @Walter and @mike Regarding making a partition, I never see any recommendation about this, I've been always using the entire disk on a pool to expand it. Until FreeBSD 11.2 it worked fine. Is there a workaround for this or should I reinstall the entire pool? On Wed, Oct 21, 2020 at 4:45 PM mike tancsa wrote: Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is ? Or is it perhaps trying to boot from da1 or da2 which does not have boot info ? Generally its not recommended to use the entire disk as part of a pool. Create a partition scheme first gpart create -s gpt da1 gpart add -t freebsd-zfs da1 then add da1p1 to the pool ---Mike On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > Hi there, > > Anyone can help please? I've many servers with this same issue. Thanks > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < peixotocassi...@gmail.com> > wrote: > >> Hi there, >> >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I added two more disks to expand my pool. BTW I already did it many time with no issues. >> >> I ran: >> >> # zpool status >> pool: zroot >> state: ONLINE >> status: Some supported features are not enabled on the pool. The pool can >> still be used, but some features are unavailable. >> action: Enable all features using 'zpool upgrade'. Once this is done, >> the pool may no longer be accessible by software that does not support >> the features. See zpool-features(7) for details. >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> zrootONLINE 0 0 0 >>gpt/disk0 ONLINE 0 0 0 >> >> errors: No known data errors >> >> # zpool add -f zroot da1 >> # zpool add -f zroot da2 >> # zpool status >> pool: zroot >> state: ONLINE >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> zrootONLINE 0 0 0 >>gpt/disk0 ONLINE 0 0 0 >>da1ONLINE 0 0 0 >>da2ONLINE 0 0 0 >> >> errors: No known data errors >> # reboot >> >> Then my system doesn???t boot anymore, i got the following error: >> >> gptzfsboot: error 4 lba 2038346899 >> gptzfsboot: error 4 lba 1361327267 >> /boot/config: -Dh >> >> BTX loader 1.00 BTX version is 1.02 >> Consoles: internal video/keyboard serial port >> BIOS drive A: is fd0 >> BIOS drive C: is disk0 >> BIOS drive D: is disk1 >> BIOS drive E: is disk2 >> BIOS drive F: is disk3 >> BIOS drive G: is disk4 >> BIOS drive H: is disk5 >> ZFS: i/o error - all block copies unavailable >> ZFS: failed to read pool zroot directory object >> BIOS 638kB/3143616kB available memory >> >> FreeBSD/x86 bootstrap loader, Revision 1.1 >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. >> >> Type '?' for list of commands, 'help' for more datailed help. >> OK >> >> I can import my pool with no problems using the lived, but I could not fix it. >> >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? >> >> Thanks. >> >> >> >> > ___ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org " > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Hi guys, Thank your for your answer. @Ricchard First of all I didn't have a chance to run zpool upgrade, because after the system update reboot i ran into the issue. @Walter and @mike Regarding making a partition, I never see any recommendation about this, I've been always using the entire disk on a pool to expand it. Until FreeBSD 11.2 it worked fine. Is there a workaround for this or should I reinstall the entire pool? On Wed, Oct 21, 2020 at 4:45 PM mike tancsa wrote: > Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is > ? Or is it perhaps trying to boot from da1 or da2 which does not have > boot info ? Generally its not recommended to use the entire disk as > part of a pool. Create a partition scheme first > > gpart create -s gpt da1 > > gpart add -t freebsd-zfs da1 > > then add da1p1 to the pool > > ---Mike > > > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > > Hi there, > > > > Anyone can help please? I've many servers with this same issue. Thanks > > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < > peixotocassi...@gmail.com> > > wrote: > > > >> Hi there, > >> > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I > added two more disks to expand my pool. BTW I already did it many time with > no issues. > >> > >> I ran: > >> > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> status: Some supported features are not enabled on the pool. The pool > can > >> still be used, but some features are unavailable. > >> action: Enable all features using 'zpool upgrade'. Once this is done, > >> the pool may no longer be accessible by software that does not > support > >> the features. See zpool-features(7) for details. > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zrootONLINE 0 0 0 > >>gpt/disk0 ONLINE 0 0 0 > >> > >> errors: No known data errors > >> > >> # zpool add -f zroot da1 > >> # zpool add -f zroot da2 > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zrootONLINE 0 0 0 > >>gpt/disk0 ONLINE 0 0 0 > >>da1ONLINE 0 0 0 > >>da2ONLINE 0 0 0 > >> > >> errors: No known data errors > >> # reboot > >> > >> Then my system doesn’t boot anymore, i got the following error: > >> > >> gptzfsboot: error 4 lba 2038346899 > >> gptzfsboot: error 4 lba 1361327267 > >> /boot/config: -Dh > >> > >> BTX loader 1.00 BTX version is 1.02 > >> Consoles: internal video/keyboard serial port > >> BIOS drive A: is fd0 > >> BIOS drive C: is disk0 > >> BIOS drive D: is disk1 > >> BIOS drive E: is disk2 > >> BIOS drive F: is disk3 > >> BIOS drive G: is disk4 > >> BIOS drive H: is disk5 > >> ZFS: i/o error - all block copies unavailable > >> ZFS: failed to read pool zroot directory object > >> BIOS 638kB/3143616kB available memory > >> > >> FreeBSD/x86 bootstrap loader, Revision 1.1 > >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. > >> > >> Type '?' for list of commands, 'help' for more datailed help. > >> OK > >> > >> I can import my pool with no problems using the lived, but I could not > fix it. > >> > >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? > >> > >> Thanks. > >> > >> > >> > >> > > ___ > > freebsd-stable@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org > " > > > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is ? Or is it perhaps trying to boot from da1 or da2 which does not have boot info ? Generally its not recommended to use the entire disk as part of a pool. Create a partition scheme first gpart create -s gpt da1 gpart add -t freebsd-zfs da1 then add da1p1 to the pool ---Mike On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > Hi there, > > Anyone can help please? I've many servers with this same issue. Thanks > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto > wrote: > >> Hi there, >> >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I added >> two more disks to expand my pool. BTW I already did it many time with no >> issues. >> >> I ran: >> >> # zpool status >> pool: zroot >> state: ONLINE >> status: Some supported features are not enabled on the pool. The pool can >> still be used, but some features are unavailable. >> action: Enable all features using 'zpool upgrade'. Once this is done, >> the pool may no longer be accessible by software that does not support >> the features. See zpool-features(7) for details. >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> zrootONLINE 0 0 0 >>gpt/disk0 ONLINE 0 0 0 >> >> errors: No known data errors >> >> # zpool add -f zroot da1 >> # zpool add -f zroot da2 >> # zpool status >> pool: zroot >> state: ONLINE >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> zrootONLINE 0 0 0 >>gpt/disk0 ONLINE 0 0 0 >>da1ONLINE 0 0 0 >>da2ONLINE 0 0 0 >> >> errors: No known data errors >> # reboot >> >> Then my system doesn’t boot anymore, i got the following error: >> >> gptzfsboot: error 4 lba 2038346899 >> gptzfsboot: error 4 lba 1361327267 >> /boot/config: -Dh >> >> BTX loader 1.00 BTX version is 1.02 >> Consoles: internal video/keyboard serial port >> BIOS drive A: is fd0 >> BIOS drive C: is disk0 >> BIOS drive D: is disk1 >> BIOS drive E: is disk2 >> BIOS drive F: is disk3 >> BIOS drive G: is disk4 >> BIOS drive H: is disk5 >> ZFS: i/o error - all block copies unavailable >> ZFS: failed to read pool zroot directory object >> BIOS 638kB/3143616kB available memory >> >> FreeBSD/x86 bootstrap loader, Revision 1.1 >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. >> >> Type '?' for list of commands, 'help' for more datailed help. >> OK >> >> I can import my pool with no problems using the lived, but I could not fix >> it. >> >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? >> >> Thanks. >> >> >> >> > ___ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: mmap and MAP_STACK
On Wed, 21 Oct 2020 18:28:44 +0300 Konstantin Belousov wrote: > > > > kdump with MAP_STACK. > > > > 87183 polyimport CALL > > mmap(0,0x1000,0x3,0x1402,0x,0,0) > > 87183 polyimport RET mmap -1 errno 22 Invalid argument > So it is anything but 'insufficient memory' (I suspected ENOMEM). > EINVAL there is because sysctl security.bsd.stack_guard_page default value > is 1, which means that at least one page of the stack is reserved as guard. > Kernel does not allow to map stack that would have no data pages (all pages > are guard). > > Your mapping request is for one page, and one page is due to guard, so > you get EINVAL. Generally MAP_STACK is magic and requires caller to know > what it does. Thanks! ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: mmap and MAP_STACK
On Wed, Oct 21, 2020 at 06:18:50PM +0300, Nick Kostirya via freebsd-stable wrote: > On Wed, 21 Oct 2020 17:16:57 +0300 > Konstantin Belousov wrote: > > > On Wed, Oct 21, 2020 at 04:53:11PM +0300, Nick Kostirya via freebsd-stable > > wrote: > > > Hello. > > > I have question about mmap. > > > > > > void *OSMem::AllocateDataArea(size_t &space) > > > { > > > // Round up to an integral number of pages. > > > space = (space + pageSize-1) & ~(pageSize-1); > > > int fd = -1; // This value is required by FreeBSD. Linux doesn't care > > > int flags = MAP_PRIVATE | MAP_ANON; > > > #ifdef MAP_STACK > > > if (memUsage == UsageStack) flags |= MAP_STACK; // OpenBSD seems to > > > require this > > > #endif > > > void *result = mmap(0, space, PROT_READ|PROT_WRITE, flags, fd, 0); > > > // Convert MAP_FAILED (-1) into NULL > > > if (result == MAP_FAILED) > > > return 0; > > > return result; > > > } > > > > > > > > > When MAP_STACK is used, "insufficient memory" error occurs. > > > When MAP_STACK removed, it is all right. > > > > > > Please tell me why. > > Show ktrace/kdump output of the mmap(2) without and with MAP_STACK. > > > > Or provide a minimal self-contained C source that demonstrates your > > issue. > > kdump with MAP_STACK. > > 87183 polyimport CALL > mmap(0,0x1000,0x3,0x1402,0x,0,0) > 87183 polyimport RET mmap -1 errno 22 Invalid argument So it is anything but 'insufficient memory' (I suspected ENOMEM). EINVAL there is because sysctl security.bsd.stack_guard_page default value is 1, which means that at least one page of the stack is reserved as guard. Kernel does not allow to map stack that would have no data pages (all pages are guard). Your mapping request is for one page, and one page is due to guard, so you get EINVAL. Generally MAP_STACK is magic and requires caller to know what it does. > > > kdump without MAP_STACK. > > 93712 polyimport CALL > mmap(0,0x1000,0x3,0x1002,0x,0,0) > 93712 polyimport RET mmap 547053568/0x209b6000 > > > > ___ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: mmap and MAP_STACK
On Wed, 21 Oct 2020 17:16:57 +0300 Konstantin Belousov wrote: > On Wed, Oct 21, 2020 at 04:53:11PM +0300, Nick Kostirya via freebsd-stable > wrote: > > Hello. > > I have question about mmap. > > > > void *OSMem::AllocateDataArea(size_t &space) > > { > > // Round up to an integral number of pages. > > space = (space + pageSize-1) & ~(pageSize-1); > > int fd = -1; // This value is required by FreeBSD. Linux doesn't care > > int flags = MAP_PRIVATE | MAP_ANON; > > #ifdef MAP_STACK > > if (memUsage == UsageStack) flags |= MAP_STACK; // OpenBSD seems to > > require this > > #endif > > void *result = mmap(0, space, PROT_READ|PROT_WRITE, flags, fd, 0); > > // Convert MAP_FAILED (-1) into NULL > > if (result == MAP_FAILED) > > return 0; > > return result; > > } > > > > > > When MAP_STACK is used, "insufficient memory" error occurs. > > When MAP_STACK removed, it is all right. > > > > Please tell me why. > Show ktrace/kdump output of the mmap(2) without and with MAP_STACK. > > Or provide a minimal self-contained C source that demonstrates your > issue. kdump with MAP_STACK. 87183 polyimport CALL mmap(0,0x1000,0x3,0x1402,0x,0,0) 87183 polyimport RET mmap -1 errno 22 Invalid argument kdump without MAP_STACK. 93712 polyimport CALL mmap(0,0x1000,0x3,0x1002,0x,0,0) 93712 polyimport RET mmap 547053568/0x209b6000 ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: mmap and MAP_STACK
On Wed, Oct 21, 2020 at 04:53:11PM +0300, Nick Kostirya via freebsd-stable wrote: > Hello. > I have question about mmap. > > void *OSMem::AllocateDataArea(size_t &space) > { > // Round up to an integral number of pages. > space = (space + pageSize-1) & ~(pageSize-1); > int fd = -1; // This value is required by FreeBSD. Linux doesn't care > int flags = MAP_PRIVATE | MAP_ANON; > #ifdef MAP_STACK > if (memUsage == UsageStack) flags |= MAP_STACK; // OpenBSD seems to > require this > #endif > void *result = mmap(0, space, PROT_READ|PROT_WRITE, flags, fd, 0); > // Convert MAP_FAILED (-1) into NULL > if (result == MAP_FAILED) > return 0; > return result; > } > > > When MAP_STACK is used, "insufficient memory" error occurs. > When MAP_STACK removed, it is all right. > > Please tell me why. Show ktrace/kdump output of the mmap(2) without and with MAP_STACK. Or provide a minimal self-contained C source that demonstrates your issue. ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
mmap and MAP_STACK
Hello. I have question about mmap. void *OSMem::AllocateDataArea(size_t &space) { // Round up to an integral number of pages. space = (space + pageSize-1) & ~(pageSize-1); int fd = -1; // This value is required by FreeBSD. Linux doesn't care int flags = MAP_PRIVATE | MAP_ANON; #ifdef MAP_STACK if (memUsage == UsageStack) flags |= MAP_STACK; // OpenBSD seems to require this #endif void *result = mmap(0, space, PROT_READ|PROT_WRITE, flags, fd, 0); // Convert MAP_FAILED (-1) into NULL if (result == MAP_FAILED) return 0; return result; } When MAP_STACK is used, "insufficient memory" error occurs. When MAP_STACK removed, it is all right. Please tell me why. ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Hi there, Anyone can help please? I've many servers with this same issue. Thanks On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto wrote: > Hi there, > > I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I added > two more disks to expand my pool. BTW I already did it many time with no > issues. > > I ran: > > # zpool status > pool: zroot > state: ONLINE > status: Some supported features are not enabled on the pool. The pool can > still be used, but some features are unavailable. > action: Enable all features using 'zpool upgrade'. Once this is done, > the pool may no longer be accessible by software that does not support > the features. See zpool-features(7) for details. > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > zrootONLINE 0 0 0 > gpt/disk0 ONLINE 0 0 0 > > errors: No known data errors > > # zpool add -f zroot da1 > # zpool add -f zroot da2 > # zpool status > pool: zroot > state: ONLINE > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > zrootONLINE 0 0 0 > gpt/disk0 ONLINE 0 0 0 > da1ONLINE 0 0 0 > da2ONLINE 0 0 0 > > errors: No known data errors > # reboot > > Then my system doesn’t boot anymore, i got the following error: > > gptzfsboot: error 4 lba 2038346899 > gptzfsboot: error 4 lba 1361327267 > /boot/config: -Dh > > BTX loader 1.00 BTX version is 1.02 > Consoles: internal video/keyboard serial port > BIOS drive A: is fd0 > BIOS drive C: is disk0 > BIOS drive D: is disk1 > BIOS drive E: is disk2 > BIOS drive F: is disk3 > BIOS drive G: is disk4 > BIOS drive H: is disk5 > ZFS: i/o error - all block copies unavailable > ZFS: failed to read pool zroot directory object > BIOS 638kB/3143616kB available memory > > FreeBSD/x86 bootstrap loader, Revision 1.1 > ERROR: cannot open /boot/lua/loader.lua: invalid argument. > > Type '?' for list of commands, 'help' for more datailed help. > OK > > I can import my pool with no problems using the lived, but I could not fix it. > > Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? > > Thanks. > > > > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"