Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-22 Thread Cassiano Peixoto
Ok, thanks. Please keep me posted.

On Thu, Oct 22, 2020 at 5:37 PM Toomas Soome  wrote:

>
>
> On 22. Oct 2020, at 23:29, Cassiano Peixoto 
> wrote:
>
>
> Hi Toomas,
>
> Thank you for this patch. Can I know when it will be MFCed? I'd like to
> try.
>
>
>
> MFC will take a bit because I need to bring it together with asize
> updates, so we would need to do a bit of cherry-picking and testing.
>
> rgds,
> toomas
>
>
>
>
> Hi!
>
> Please try 366951:) I think, it should get things better for you.
>
> rgds,
> toomas
>
> On Thu, Oct 22, 2020 at 3:04 PM Cassiano Peixoto <
> peixotocassi...@gmail.com> wrote:
>
>> Sergey,
>>
>> I agree with you. The best thing is to revert the commit on zfsloader.
>> Many people didn't realize this issue yet, but they will run into a big
>> problem soon.
>>
>> On Thu, Oct 22, 2020 at 2:41 PM Sergey V. Dyatko 
>> wrote:
>>
>>> On Thu, 22 Oct 2020 16:42:16 +0300
>>> Andriy Gapon  wrote:
>>>
>>> > On 22/10/2020 16:39, Cassiano Peixoto wrote:
>>> > > Hi Andriy,
>>> > >
>>> > > I've just tried copying my zfsloader from 11.2-STABLE (R350026) to
>>> FreeBSD
>>> > > 12.1 and 12.2 (STABLE) and fixed the issue.
>>> > >
>>> > > I also tried to use zfsloader of 11.3 but didn't work and the same
>>> issue
>>> > > happened.
>>> > >
>>> > > So it seems that something has changed on zfsloader after 11.2 that
>>> brings
>>> > > this issue.
>>> > >
>>> > > My question is: Should it be expected or is it a bug to be fixed?
>>> > >
>>> >
>>> > In my opinion it's a bug.
>>> > zfsloader should not require that disks must be partitioned.
>>> >
>>>
>>> +1
>>> That's why I have terribly outdated 13-CURRENT on bunch of servers and
>>> can't
>>> update them.
>>>
>>> Most of them look like this:
>>> [tiger@st25]:~>zpool status
>>>   pool: st25
>>>  state: ONLINE
>>>   scan: none requested
>>> config:
>>>
>>> NAMESTATE READ WRITE CKSUM
>>> st25   ONLINE   0 0 0
>>>   mirror-0  ONLINE   0 0 0
>>> ada0ONLINE   0 0 0
>>> ada1ONLINE   0 0 0
>>>   mirror-1  ONLINE   0 0 0
>>> ada2ONLINE   0 0 0
>>> ada3ONLINE   0 0 0
>>>   mirror-2  ONLINE   0 0 0
>>> ada4ONLINE   0 0 0
>>> ada5ONLINE   0 0 0
>>>   mirror-3  ONLINE   0 0 0
>>> ada6ONLINE   0 0 0
>>> ada7ONLINE   0 0 0
>>>
>>> errors: No known data errors
>>>
>>> They haven't separate boot device and have from 7 to 30+ Tb of data that
>>> I
>>> can't backup anywhere for re-install server with disk partitioning. Some
>>> time
>>> ago I managed to get aroud this reverting 2 commits (  r342151 + don't
>>> remember revision) but then there where some other improvements after
>>> which I
>>> lost the opportunity to revert this commits
>>>
>>> --
>>> wbr, Sergey
>>>
>>> ___
>>> freebsd-stable@freebsd.org mailing list
>>> https://lists.freebsd.org/mailman/listinfo/freebsd-stable
>>> To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org
>>> "
>>>
>>
>
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-22 Thread Sergey V. Dyatko
On Thu, 22 Oct 2020 23:04:09 +0300
Toomas Soome  wrote: 

> Hi!
> 
> Please try 366951:) I think, it should get things better for you.
> 
> rgds,
> toomas
> 

Thanks! I'll try as soon as I can find 7-8Tb for backup :) 
btw, can I update my head@r324614 to 366951 at once ?

> > On 22. Oct 2020, at 20:37, Sergey V. Dyatko  wrote:
> > 
> > On Thu, 22 Oct 2020 16:42:16 +0300
> > Andriy Gapon  wrote: 
> > 
> >> On 22/10/2020 16:39, Cassiano Peixoto wrote:
> >>> Hi Andriy,
> >>> 
> >>> I've just tried copying my zfsloader from 11.2-STABLE (R350026) to FreeBSD
> >>> 12.1 and 12.2 (STABLE) and fixed the issue.
> >>> 
> >>> I also tried to use zfsloader of 11.3 but didn't work and the same issue
> >>> happened.
> >>> 
> >>> So it seems that something has changed on zfsloader after 11.2 that brings
> >>> this issue.
> >>> 
> >>> My question is: Should it be expected or is it a bug to be fixed?
> >>> 
> >> 
> >> In my opinion it's a bug.
> >> zfsloader should not require that disks must be partitioned.
> >> 
> > 
> > +1
> > That's why I have terribly outdated 13-CURRENT on bunch of servers and can't
> > update them. 
> > 
> > Most of them look like this:
> > [tiger@st25]:~>zpool status
> >  pool: st25
> > state: ONLINE
> >  scan: none requested
> > config:
> > 
> >NAMESTATE READ WRITE CKSUM
> >st25   ONLINE   0 0 0
> >  mirror-0  ONLINE   0 0 0
> >ada0ONLINE   0 0 0
> >ada1ONLINE   0 0 0
> >  mirror-1  ONLINE   0 0 0
> >ada2ONLINE   0 0 0
> >ada3ONLINE   0 0 0
> >  mirror-2  ONLINE   0 0 0
> >ada4ONLINE   0 0 0
> >ada5ONLINE   0 0 0
> >  mirror-3  ONLINE   0 0 0
> >ada6ONLINE   0 0 0
> >ada7ONLINE   0 0 0
> > 
> > errors: No known data errors
> > 
> > They haven't separate boot device and have from 7 to 30+ Tb of data that I
> > can't backup anywhere for re-install server with disk partitioning. Some
> > time ago I managed to get aroud this reverting 2 commits (  r342151 + don't
> > remember revision) but then there where some other improvements after which
> > I lost the opportunity to revert this commits
> > 
> > --
> > wbr, Sergey
> > 
> > ___
> > freebsd-curr...@freebsd.org mailing list
> > https://lists.freebsd.org/mailman/listinfo/freebsd-current
> > To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
> 



--
wbr, Sergey

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-22 Thread Cassiano Peixoto
Hi Toomas,

Thank you for this patch. Can I know when it will be MFCed? I'd like to try.


Hi!

Please try 366951:) I think, it should get things better for you.

rgds,
toomas

On Thu, Oct 22, 2020 at 3:04 PM Cassiano Peixoto 
wrote:

> Sergey,
>
> I agree with you. The best thing is to revert the commit on zfsloader.
> Many people didn't realize this issue yet, but they will run into a big
> problem soon.
>
> On Thu, Oct 22, 2020 at 2:41 PM Sergey V. Dyatko 
> wrote:
>
>> On Thu, 22 Oct 2020 16:42:16 +0300
>> Andriy Gapon  wrote:
>>
>> > On 22/10/2020 16:39, Cassiano Peixoto wrote:
>> > > Hi Andriy,
>> > >
>> > > I've just tried copying my zfsloader from 11.2-STABLE (R350026) to
>> FreeBSD
>> > > 12.1 and 12.2 (STABLE) and fixed the issue.
>> > >
>> > > I also tried to use zfsloader of 11.3 but didn't work and the same
>> issue
>> > > happened.
>> > >
>> > > So it seems that something has changed on zfsloader after 11.2 that
>> brings
>> > > this issue.
>> > >
>> > > My question is: Should it be expected or is it a bug to be fixed?
>> > >
>> >
>> > In my opinion it's a bug.
>> > zfsloader should not require that disks must be partitioned.
>> >
>>
>> +1
>> That's why I have terribly outdated 13-CURRENT on bunch of servers and
>> can't
>> update them.
>>
>> Most of them look like this:
>> [tiger@st25]:~>zpool status
>>   pool: st25
>>  state: ONLINE
>>   scan: none requested
>> config:
>>
>> NAMESTATE READ WRITE CKSUM
>> st25   ONLINE   0 0 0
>>   mirror-0  ONLINE   0 0 0
>> ada0ONLINE   0 0 0
>> ada1ONLINE   0 0 0
>>   mirror-1  ONLINE   0 0 0
>> ada2ONLINE   0 0 0
>> ada3ONLINE   0 0 0
>>   mirror-2  ONLINE   0 0 0
>> ada4ONLINE   0 0 0
>> ada5ONLINE   0 0 0
>>   mirror-3  ONLINE   0 0 0
>> ada6ONLINE   0 0 0
>> ada7ONLINE   0 0 0
>>
>> errors: No known data errors
>>
>> They haven't separate boot device and have from 7 to 30+ Tb of data that I
>> can't backup anywhere for re-install server with disk partitioning. Some
>> time
>> ago I managed to get aroud this reverting 2 commits (  r342151 + don't
>> remember revision) but then there where some other improvements after
>> which I
>> lost the opportunity to revert this commits
>>
>> --
>> wbr, Sergey
>>
>> ___
>> freebsd-stable@freebsd.org mailing list
>> https://lists.freebsd.org/mailman/listinfo/freebsd-stable
>> To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
>>
>
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-22 Thread Cassiano Peixoto
Sergey,

I agree with you. The best thing is to revert the commit on zfsloader. Many
people didn't realize this issue yet, but they will run into a big problem
soon.

On Thu, Oct 22, 2020 at 2:41 PM Sergey V. Dyatko 
wrote:

> On Thu, 22 Oct 2020 16:42:16 +0300
> Andriy Gapon  wrote:
>
> > On 22/10/2020 16:39, Cassiano Peixoto wrote:
> > > Hi Andriy,
> > >
> > > I've just tried copying my zfsloader from 11.2-STABLE (R350026) to
> FreeBSD
> > > 12.1 and 12.2 (STABLE) and fixed the issue.
> > >
> > > I also tried to use zfsloader of 11.3 but didn't work and the same
> issue
> > > happened.
> > >
> > > So it seems that something has changed on zfsloader after 11.2 that
> brings
> > > this issue.
> > >
> > > My question is: Should it be expected or is it a bug to be fixed?
> > >
> >
> > In my opinion it's a bug.
> > zfsloader should not require that disks must be partitioned.
> >
>
> +1
> That's why I have terribly outdated 13-CURRENT on bunch of servers and
> can't
> update them.
>
> Most of them look like this:
> [tiger@st25]:~>zpool status
>   pool: st25
>  state: ONLINE
>   scan: none requested
> config:
>
> NAMESTATE READ WRITE CKSUM
> st25   ONLINE   0 0 0
>   mirror-0  ONLINE   0 0 0
> ada0ONLINE   0 0 0
> ada1ONLINE   0 0 0
>   mirror-1  ONLINE   0 0 0
> ada2ONLINE   0 0 0
> ada3ONLINE   0 0 0
>   mirror-2  ONLINE   0 0 0
> ada4ONLINE   0 0 0
> ada5ONLINE   0 0 0
>   mirror-3  ONLINE   0 0 0
> ada6ONLINE   0 0 0
> ada7ONLINE   0 0 0
>
> errors: No known data errors
>
> They haven't separate boot device and have from 7 to 30+ Tb of data that I
> can't backup anywhere for re-install server with disk partitioning. Some
> time
> ago I managed to get aroud this reverting 2 commits (  r342151 + don't
> remember revision) but then there where some other improvements after
> which I
> lost the opportunity to revert this commits
>
> --
> wbr, Sergey
>
> ___
> freebsd-stable@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
>
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-22 Thread Sergey V. Dyatko
On Thu, 22 Oct 2020 16:42:16 +0300
Andriy Gapon  wrote: 

> On 22/10/2020 16:39, Cassiano Peixoto wrote:
> > Hi Andriy,
> > 
> > I've just tried copying my zfsloader from 11.2-STABLE (R350026) to FreeBSD
> > 12.1 and 12.2 (STABLE) and fixed the issue.
> > 
> > I also tried to use zfsloader of 11.3 but didn't work and the same issue
> > happened.
> > 
> > So it seems that something has changed on zfsloader after 11.2 that brings
> > this issue.
> > 
> > My question is: Should it be expected or is it a bug to be fixed?
> >   
> 
> In my opinion it's a bug.
> zfsloader should not require that disks must be partitioned.
> 

+1
That's why I have terribly outdated 13-CURRENT on bunch of servers and can't
update them. 

Most of them look like this:
[tiger@st25]:~>zpool status
  pool: st25
 state: ONLINE
  scan: none requested
config:

NAMESTATE READ WRITE CKSUM
st25   ONLINE   0 0 0
  mirror-0  ONLINE   0 0 0
ada0ONLINE   0 0 0
ada1ONLINE   0 0 0
  mirror-1  ONLINE   0 0 0
ada2ONLINE   0 0 0
ada3ONLINE   0 0 0
  mirror-2  ONLINE   0 0 0
ada4ONLINE   0 0 0
ada5ONLINE   0 0 0
  mirror-3  ONLINE   0 0 0
ada6ONLINE   0 0 0
ada7ONLINE   0 0 0

errors: No known data errors

They haven't separate boot device and have from 7 to 30+ Tb of data that I
can't backup anywhere for re-install server with disk partitioning. Some time
ago I managed to get aroud this reverting 2 commits (  r342151 + don't
remember revision) but then there where some other improvements after which I
lost the opportunity to revert this commits

--
wbr, Sergey

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Custom kernel breaks py-glances in 12.2

2020-10-22 Thread Mike Jakubik
Hi,



When i compile a non GENERIC kernel (which mainly removes some debugging and 
devices i do not have) the Python program glances fails with the following 
message.



[root@jailer ~]# glances 

Traceback (most recent call last):

  File "/usr/local/bin/glances", line 8, in 

    sys.exit(main())

  File "/usr/local/lib/python3.9/site-packages/glances/__init__.py", line 143, 
in main

    start(config=config, args=args)

  File "/usr/local/lib/python3.9/site-packages/glances/__init__.py", line 108, 
in start

    mode = GlancesMode(config=config, args=args)

  File "/usr/local/lib/python3.9/site-packages/glances/standalone.py", line 78, 
in __init__

    self.stats.update()

  File "/usr/local/lib/python3.9/site-packages/glances/stats.py", line 234, in 
update

    self._plugins[p].update()

  File 
"/usr/local/lib/python3.9/site-packages/glances/plugins/glances_plugin.py", 
line 925, in wrapper

    ret = fct(self, *args, **kw)

  File 
"/usr/local/lib/python3.9/site-packages/glances/plugins/glances_plugin.py", 
line 935, in wrapper

    ret = fct(*args, **kw)

  File "/usr/local/lib/python3.9/site-packages/glances/plugins/glances_cpu.py", 
line 84, in update

    stats = self.update_local()

  File "/usr/local/lib/python3.9/site-packages/glances/plugins/glances_cpu.py", 
line 118, in update_local

    cpu_stats = psutil.cpu_stats()

  File "/usr/local/lib/python3.9/site-packages/psutil/__init__.py", line 1866, 
in cpu_stats

    return _psplatform.cpu_stats()

  File "/usr/local/lib/python3.9/site-packages/psutil/_psbsd.py", line 293, in 
cpu_stats

    ctxsw, intrs, soft_intrs, syscalls, traps = cext.cpu_stats()

OSError: [Errno 12] Cannot allocate memory (originated from 
sysctlbyname('vm.stats.sys.v_soft'))



[root@jailer ~]# sysctl vm.stats.sys.v_soft

vm.stats.sys.v_soft: 3101



[root@jailer ~]# uname -a 

FreeBSD jailer.local 12.2-STABLE FreeBSD 12.2-STABLE r366936 JAILER  amd64



I don't understand what is breaking it as everything else works fine and i only 
removed the usual stuff i do. Below is the custom kernel config.



Thanks.



# $FreeBSD: stable/12/sys/amd64/conf/GENERIC 365612 2020-09-10 20:46:16Z erj $ 



cpu HAMMER

ident   JAILER



options SCHED_ULE   # ULE scheduler

options NUMA    # Non-Uniform Memory Architecture 
support

options PREEMPTION  # Enable kernel thread preemption

options VIMAGE  # Subsystem virtualization, e.g. VNET

options INET    # InterNETworking

options INET6   # IPv6 communications protocols

options IPSEC   # IP (v4/v6) security

options IPSEC_SUPPORT   # Allow kldload of ipsec and tcpmd5

options TCP_OFFLOAD # TCP offload

options TCP_BLACKBOX    # Enhanced TCP event logging

options TCP_HHOOK   # hhook(9) framework for TCP

options TCP_RFC7413 # TCP Fast Open

options SCTP    # Stream Control Transmission Protocol

options FFS # Berkeley Fast Filesystem

options SOFTUPDATES # Enable FFS soft updates support

options UFS_ACL # Support for access control lists

options UFS_DIRHASH # Improve performance on big directories

options PROCFS  # Process filesystem (requires PSEUDOFS)

options PSEUDOFS    # Pseudo-filesystem framework

options GEOM_LABEL  # Provides labelization

options EFIRT   # EFI Runtime Services support

options SCSI_DELAY=5000 # Delay (in ms) before probing SCSI

options KTRACE  # ktrace(1) support

options STACK   # stack(9) support

options SYSVSHM # SYSV-style shared memory

options SYSVMSG # SYSV-style message queues

options SYSVSEM # SYSV-style semaphores

options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time 
extensions

options PRINTF_BUFR_SIZE=128    # Prevent printf output being 
interspersed.

options KBD_INSTALL_CDEV    # install a CDEV entry in /dev

options HWPMC_HOOKS # Necessary kernel hooks for hwpmc(4)

options AUDIT   # Security event auditing

options CAPABILITY_MODE # Capsicum capability mode

options CAPABILITIES    # Capsicum capabilities

options MAC # TrustedBSD MAC Framework

options DDB_CTF # Kernel ELF linker loads CTF data

options INCLUDE_CONFIG_FILE # Include this file in kernel

options RACCT   # Resource accounting framework

options RACCT_DEFAULT_TO_DISABLED # Set kern.racct.enable=0 by defaul

Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-22 Thread Cassiano Peixoto
Hi Andriy,

I've just tried copying my zfsloader from 11.2-STABLE (R350026) to FreeBSD
12.1 and 12.2 (STABLE) and fixed the issue.

I also tried to use zfsloader of 11.3 but didn't work and the same issue
happened.

So it seems that something has changed on zfsloader after 11.2 that brings
this issue.

My question is: Should it be expected or is it a bug to be fixed?

Thanks.

On Thu, Oct 22, 2020 at 4:39 AM Andriy Gapon  wrote:

> On 21/10/2020 15:20, Cassiano Peixoto wrote:
> > Hi there,
> >
> > Anyone can help please? I've many servers with this same issue. Thanks
>
> Can you try to replace /boot/zfsloader with zfsloader from other FreeBSD
> versions?
> E.g., 12.0, 12.2-RC, 11.4, recent snapshot of the CURRENT?
>
> > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto <
> peixotocassi...@gmail.com>
> > wrote:
> >
> >> Hi there,
> >>
> >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I
> added two more disks to expand my pool. BTW I already did it many time with
> no issues.
> >>
> >> I ran:
> >>
> >> # zpool status
> >>   pool: zroot
> >>  state: ONLINE
> >> status: Some supported features are not enabled on the pool. The pool
> can
> >>  still be used, but some features are unavailable.
> >> action: Enable all features using 'zpool upgrade'. Once this is done,
> >>  the pool may no longer be accessible by software that does not
> support
> >>  the features. See zpool-features(7) for details.
> >>   scan: none requested
> >> config:
> >>
> >>  NAME STATE READ WRITE CKSUM
> >>  zrootONLINE   0 0 0
> >>gpt/disk0  ONLINE   0 0 0
> >>
> >> errors: No known data errors
> >>
> >> # zpool add -f zroot da1
> >> # zpool add -f zroot da2
> >> # zpool status
> >>   pool: zroot
> >>  state: ONLINE
> >>   scan: none requested
> >> config:
> >>
> >>  NAME STATE READ WRITE CKSUM
> >>  zrootONLINE   0 0 0
> >>gpt/disk0  ONLINE   0 0 0
> >>da1ONLINE   0 0 0
> >>da2ONLINE   0 0 0
> >>
> >> errors: No known data errors
> >> # reboot
> >>
> >> Then my system doesn’t boot anymore, i got the following error:
> >>
> >> gptzfsboot: error 4 lba 2038346899
> >> gptzfsboot: error 4 lba 1361327267
> >> /boot/config: -Dh
> >>
> >> BTX loader 1.00  BTX version is 1.02
> >> Consoles: internal video/keyboard serial port
> >> BIOS drive A: is fd0
> >> BIOS drive C: is disk0
> >> BIOS drive D: is disk1
> >> BIOS drive E: is disk2
> >> BIOS drive F: is disk3
> >> BIOS drive G: is disk4
> >> BIOS drive H: is disk5
> >> ZFS: i/o error - all block copies unavailable
> >> ZFS: failed to read pool zroot directory object
> >> BIOS 638kB/3143616kB available memory
> >>
> >> FreeBSD/x86 bootstrap loader, Revision 1.1
> >> ERROR: cannot open /boot/lua/loader.lua: invalid argument.
> >>
> >> Type '?' for list of commands, 'help' for more datailed help.
> >> OK
> >>
> >> I can import my pool with no problems using the lived, but I could not
> fix it.
> >>
> >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that?
> >>
> >> Thanks.
> >>
> >>
> >>
> >>
> > ___
> > freebsd-stable@freebsd.org mailing list
> > https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org
> "
> >
>
>
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"