[Kernel-packages] [Bug 1949286] Re: [MIR]: Include dwarves-dfsg-hwe package into Bionic and Focal

2021-11-04 Thread Rafael David Tinoco
We don't, like we've spoken on IRC. Thanks a lot for the information. I
missed the SRUs and I'm very glad they were done.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1949286

Title:
  [MIR]: Include dwarves-dfsg-hwe package into Bionic and Focal

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  Incomplete
Status in linux source package in Focal:
  Incomplete

Bug description:
  This is a follow-on request of bug:

  HWE kernels should support eBPF CO-RE
  https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330

  [Availability]

  - Package is already available in all Ubuntu versions.
  - This is a backported version (Impish) to Bionic and Focal

  [Rationale]

  - Current package dwarves-dfsg is old in Ubuntu Bionic and Focal.
  - HWE kernel compilation needs recent "pahole" binary to encode BTF[1] 
information.
  - After talking to SRU team members, updating dwarves-dfsg seemed risky.
  - Creating a new package containing only the new "pahole" tool binary is the 
best option. 
  - Kernel HWE compilations will need to use this package, so it has to be in 
main repository (as kernels builds depend on main only).

  [Security]

  - This package is already stable and exists in Ubuntu.

  
  [Quality assurance]

  - This package is already stable and exists in Ubuntu.

  [Dependencies]

  - Same dependencies as dwarves-dfsg package (already satisfied).

  [Standards compliance]

  - This package is already stable and exists in Ubuntu.

  [Maintenance]

  - SRUs for dwarves-dfsg package within Impish should be applied to
  this package as well.

  [Background information]

  Bug: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330
  contains more information about why this is needed.

  I have been maintaining BTFHUB
  (https://github.com/aquasecurity/btfhub) in order to generate BTF
  files to each existing Ubuntu kernel but I feel that a simple change,
  like adding a recent pahole tool to the main archive in Bionic and
  Focal, is enough to resolve a VERY BIG problem for eBPF applications
  to run in HWE kernels in those Ubuntu versions.

  A very complete explanation on why BTF is needed for eBPF to be
  portable among different kernels currently exists at:
  https://github.com/aquasecurity/btfhub/tree/main/tools.

  Projects that would already benefit from this change:

  - Microsoft: Sysmon Tools for Linux
  - Microsoft: Inspektor Gadge
  - Elastic: They're working together with us upstream
  - Aqua Security: libbpfgo & tracee-ebpf
  - All BCC libbpf-tools

  and many more.

  
  [1] https://www.kernel.org/doc/html/latest/bpf/btf.html

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1949286/+subscriptions


-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1926330] Re: HWE kernels should support eBPF CO-RE

2021-10-31 Thread Rafael David Tinoco
** Changed in: dwarves-dfsg (Ubuntu Bionic)
   Status: Won't Fix => Confirmed

** Changed in: linux (Ubuntu Bionic)
   Status: Won't Fix => Confirmed

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1926330

Title:
  HWE kernels should support eBPF CO-RE

Status in dwarves-dfsg package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  Fix Released
Status in dwarves-dfsg source package in Bionic:
  Confirmed
Status in linux source package in Bionic:
  Confirmed
Status in dwarves-dfsg source package in Focal:
  Confirmed
Status in linux source package in Focal:
  Confirmed
Status in dwarves-dfsg source package in Groovy:
  Fix Released
Status in linux source package in Groovy:
  Fix Released

Bug description:
  I had recent discussion with kernel team regarding support or not BTF
  in HWE kernels (Bionic and Focal). Having CONFIG_DEBUG_INFO_BTF option
  enabled for HWE kernels (v4.4 and v.4.8) would allow eBPF based code
  (powered by libbpf or not) to be RO.CE
  (https://github.com/rafaeldtinoco/portablebpf for more information).

  By allowing runtime relocations, using provided BTF, libbpf binaries
  might end up running, without modifications, in different kernel
  versions (from Bionic HWE v5.4 kernel to Hirsute v5.11).

  A good example would be to support tools such as:
  
https://github.com/aquasecurity/tracee/discussions/713#discussioncomment-665641
  An ebpf powered backend for a containers security solution.

  Considering:

  $ rmadisonb dwarves
   dwarves | 1.9-1  | precise/universe | amd64
   dwarves | 1.10-2 | trusty   | amd64
   dwarves | 1.10-2.1   | xenial/universe  | amd64
   dwarves | 1.10-2.1build1 | bionic/universe  | amd64
   dwarves | 1.15-2 | focal/universe   | amd64
   dwarves | 1.17-1 | groovy/universe  | amd64
   dwarves | 1.20-1 | hirsute/universe | amd64
   dwarves | 1.20-1 | impish/universe  | amd64

  And the fact that the 'pahole' binary, from dwarves package, is the
  one to blame, not to have CONFIG_DEBUG_INFO_BTF available, for this
  bug to be solved we would have to provide a backport of dwarves (at
  least 1.17-1) to Bionic and Focal. It could have another name (not to
  mess with original dwarves package and its dependencies) and it is
  unclear if it needs to be in [main] or [universe].

  Question: Would have dwarves backported in -backports be enough for
  Bionic and Focal HWE kernels compilation to have CONFIG_DEBUG_INFO_BTF
  enabled ?

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/dwarves-dfsg/+bug/1926330/+subscriptions


-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1949286] Re: [MIR]: Include dwarves-dfsg-hwe package into Bionic and Focal

2021-10-31 Thread Rafael David Tinoco
After this MIR, the kernel HWE source code will have to use "pahole-btf"
tool to do the BTF encoding in the HWE kernel builds from then on.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1949286

Title:
  [MIR]: Include dwarves-dfsg-hwe package into Bionic and Focal

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  Confirmed
Status in linux source package in Focal:
  Confirmed

Bug description:
  This is a follow-on request of bug:

  HWE kernels should support eBPF CO-RE
  https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330

  [Availability]

  - Package is already available in all Ubuntu versions.
  - This is a backported version (Impish) to Bionic and Focal

  [Rationale]

  - Current package dwarves-dfsg is old in Ubuntu Bionic and Focal.
  - HWE kernel compilation needs recent "pahole" binary to encode BTF[1] 
information.
  - After talking to SRU team members, updating dwarves-dfsg seemed risky.
  - Creating a new package containing only the new "pahole" tool binary is the 
best option. 
  - Kernel HWE compilations will need to use this package, so it has to be in 
main repository (as kernels builds depend on main only).

  [Security]

  - This package is already stable and exists in Ubuntu.

  
  [Quality assurance]

  - This package is already stable and exists in Ubuntu.

  [Dependencies]

  - Same dependencies as dwarves-dfsg package (already satisfied).

  [Standards compliance]

  - This package is already stable and exists in Ubuntu.

  [Maintenance]

  - SRUs for dwarves-dfsg package within Impish should be applied to
  this package as well.

  [Background information]

  Bug: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330
  contains more information about why this is needed.

  I have been maintaining BTFHUB
  (https://github.com/aquasecurity/btfhub) in order to generate BTF
  files to each existing Ubuntu kernel but I feel that a simple change,
  like adding a recent pahole tool to the main archive in Bionic and
  Focal, is enough to resolve a VERY BIG problem for eBPF applications
  to run in HWE kernels in those Ubuntu versions.

  A very complete explanation on why BTF is needed for eBPF to be
  portable among different kernels currently exists at:
  https://github.com/aquasecurity/btfhub/tree/main/tools.

  Projects that would already benefit from this change:

  - Microsoft: Sysmon Tools for Linux
  - Microsoft: Inspektor Gadge
  - Elastic: They're working together with us upstream
  - Aqua Security: libbpfgo & tracee-ebpf
  - All BCC libbpf-tools

  and many more.

  
  [1] https://www.kernel.org/doc/html/latest/bpf/btf.html

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1949286/+subscriptions


-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1926330] Re: HWE kernels should support eBPF CO-RE

2021-10-31 Thread Rafael David Tinoco
I have placed a MIR for "pahole-btf" package (a backport of Impish's
dwarves-dfsg package to Bionic and Focal) at:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1949286. This way,
the kernel builds may depend on "pahole-btf" binary package, from main,
and finally include BTF debug information into Bionic and Focal HWE
kernels.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1926330

Title:
  HWE kernels should support eBPF CO-RE

Status in dwarves-dfsg package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  Fix Released
Status in dwarves-dfsg source package in Bionic:
  Won't Fix
Status in linux source package in Bionic:
  Won't Fix
Status in dwarves-dfsg source package in Focal:
  Confirmed
Status in linux source package in Focal:
  Confirmed
Status in dwarves-dfsg source package in Groovy:
  Fix Released
Status in linux source package in Groovy:
  Fix Released

Bug description:
  I had recent discussion with kernel team regarding support or not BTF
  in HWE kernels (Bionic and Focal). Having CONFIG_DEBUG_INFO_BTF option
  enabled for HWE kernels (v4.4 and v.4.8) would allow eBPF based code
  (powered by libbpf or not) to be RO.CE
  (https://github.com/rafaeldtinoco/portablebpf for more information).

  By allowing runtime relocations, using provided BTF, libbpf binaries
  might end up running, without modifications, in different kernel
  versions (from Bionic HWE v5.4 kernel to Hirsute v5.11).

  A good example would be to support tools such as:
  
https://github.com/aquasecurity/tracee/discussions/713#discussioncomment-665641
  An ebpf powered backend for a containers security solution.

  Considering:

  $ rmadisonb dwarves
   dwarves | 1.9-1  | precise/universe | amd64
   dwarves | 1.10-2 | trusty   | amd64
   dwarves | 1.10-2.1   | xenial/universe  | amd64
   dwarves | 1.10-2.1build1 | bionic/universe  | amd64
   dwarves | 1.15-2 | focal/universe   | amd64
   dwarves | 1.17-1 | groovy/universe  | amd64
   dwarves | 1.20-1 | hirsute/universe | amd64
   dwarves | 1.20-1 | impish/universe  | amd64

  And the fact that the 'pahole' binary, from dwarves package, is the
  one to blame, not to have CONFIG_DEBUG_INFO_BTF available, for this
  bug to be solved we would have to provide a backport of dwarves (at
  least 1.17-1) to Bionic and Focal. It could have another name (not to
  mess with original dwarves package and its dependencies) and it is
  unclear if it needs to be in [main] or [universe].

  Question: Would have dwarves backported in -backports be enough for
  Bionic and Focal HWE kernels compilation to have CONFIG_DEBUG_INFO_BTF
  enabled ?

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/dwarves-dfsg/+bug/1926330/+subscriptions


-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1949286] Re: [MIR]: Include dwarves-dfsg-hwe package into Bionic and Focal

2021-10-31 Thread Rafael David Tinoco
The proposed package is at:

https://launchpad.net/~rafaeldtinoco/+archive/ubuntu/pahole-btf

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1949286

Title:
  [MIR]: Include dwarves-dfsg-hwe package into Bionic and Focal

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  Confirmed
Status in linux source package in Focal:
  Confirmed

Bug description:
  This is a follow-on request of bug:

  HWE kernels should support eBPF CO-RE
  https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330

  [Availability]

  - Package is already available in all Ubuntu versions.
  - This is a backported version (Impish) to Bionic and Focal

  [Rationale]

  - Current package dwarves-dfsg is old in Ubuntu Bionic and Focal.
  - HWE kernel compilation needs recent "pahole" binary to encode BTF[1] 
information.
  - After talking to SRU team members, updating dwarves-dfsg seemed risky.
  - Creating a new package containing only the new "pahole" tool binary is the 
best option. 
  - Kernel HWE compilations will need to use this package, so it has to be in 
main repository (as kernels builds depend on main only).

  [Security]

  - This package is already stable and exists in Ubuntu.

  
  [Quality assurance]

  - This package is already stable and exists in Ubuntu.

  [Dependencies]

  - Same dependencies as dwarves-dfsg package (already satisfied).

  [Standards compliance]

  - This package is already stable and exists in Ubuntu.

  [Maintenance]

  - SRUs for dwarves-dfsg package within Impish should be applied to
  this package as well.

  [Background information]

  Bug: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330
  contains more information about why this is needed.

  I have been maintaining BTFHUB
  (https://github.com/aquasecurity/btfhub) in order to generate BTF
  files to each existing Ubuntu kernel but I feel that a simple change,
  like adding a recent pahole tool to the main archive in Bionic and
  Focal, is enough to resolve a VERY BIG problem for eBPF applications
  to run in HWE kernels in those Ubuntu versions.

  A very complete explanation on why BTF is needed for eBPF to be
  portable among different kernels currently exists at:
  https://github.com/aquasecurity/btfhub/tree/main/tools.

  Projects that would already benefit from this change:

  - Microsoft: Sysmon Tools for Linux
  - Microsoft: Inspektor Gadge
  - Elastic: They're working together with us upstream
  - Aqua Security: libbpfgo & tracee-ebpf
  - All BCC libbpf-tools

  and many more.

  
  [1] https://www.kernel.org/doc/html/latest/bpf/btf.html

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1949286/+subscriptions


-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1949286] Re: [MIR]: Include dwarves-dfsg-hwe package into Bionic and Focal

2021-10-31 Thread Rafael David Tinoco
** Description changed:

  This is a follow-on request of bug:
  
  HWE kernels should support eBPF CO-RE
  https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330
  
  [Availability]
  
  - Package is already available in all Ubuntu versions.
  - This is a backported version (Impish) to Bionic and Focal
  
  [Rationale]
  
- - Current package dwarves-dfsg is old in Ubuntu Bionic and Focal
- - HWE kernel compilation needs recent "pahole" binary to encode BTF[1] 
information
- - After talking to SRU team members, updating dwarves-dfsg seemed risky
- - Creating a new package for a more recent version of dwarves seems 
appropriate 
+ - Current package dwarves-dfsg is old in Ubuntu Bionic and Focal.
+ - HWE kernel compilation needs recent "pahole" binary to encode BTF[1] 
information.
+ - After talking to SRU team members, updating dwarves-dfsg seemed risky.
+ - Creating a new package containing only the new "pahole" tool binary is the 
best option. 
+ - Kernel HWE compilations will need to use this package, so it has to be in 
main repository (as kernels builds depend on main only).
  
  [Security]
  
+ - This package is already stable and exists in Ubuntu.
+ 
+ 
  [Quality assurance]
  
- [UI standards]
+ - This package is already stable and exists in Ubuntu.
  
  [Dependencies]
  
+ - Same dependencies as dwarves-dfsg package (already satisfied).
+ 
  [Standards compliance]
+ 
+ - This package is already stable and exists in Ubuntu.
  
  [Maintenance]
  
+ - SRUs for dwarves-dfsg package within Impish should be applied to this
+ package as well.
+ 
  [Background information]
  
+ Bug: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330
+ contains more information about why this is needed.
+ 
+ I have been maintaining BTFHUB (https://github.com/aquasecurity/btfhub)
+ in order to generate BTF files to each existing Ubuntu kernel but I feel
+ that a simple change, like adding a recent pahole tool to the main
+ archive in Bionic and Focal, is enough to resolve a VERY BIG problem for
+ eBPF applications to run in HWE kernels in those Ubuntu versions.
+ 
+ A very complete explanation on why BTF is needed for eBPF to be portable
+ among different kernels currently exists at:
+ https://github.com/aquasecurity/btfhub/tree/main/tools.
+ 
+ Projects that would already benefit from this change:
+ 
+ - Microsoft: Sysmon Tools for Linux
+ - Microsoft: Inspektor Gadge
+ - Elastic: They're working together with us upstream
+ - Aqua Security: libbpfgo & tracee-ebpf
+ - All BCC libbpf-tools
+ 
+ and many more.
  
  
  [1] https://www.kernel.org/doc/html/latest/bpf/btf.html

** Also affects: linux (Ubuntu Focal)
   Importance: Undecided
   Status: New

** Also affects: linux (Ubuntu Bionic)
   Importance: Undecided
   Status: New

** Changed in: linux (Ubuntu)
   Status: New => Fix Released

** Changed in: linux (Ubuntu Bionic)
   Importance: Undecided => High

** Changed in: linux (Ubuntu Focal)
   Importance: Undecided => High

** Changed in: linux (Ubuntu Bionic)
   Status: New => Confirmed

** Changed in: linux (Ubuntu Focal)
   Status: New => Confirmed

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1949286

Title:
  [MIR]: Include dwarves-dfsg-hwe package into Bionic and Focal

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  Confirmed
Status in linux source package in Focal:
  Confirmed

Bug description:
  This is a follow-on request of bug:

  HWE kernels should support eBPF CO-RE
  https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330

  [Availability]

  - Package is already available in all Ubuntu versions.
  - This is a backported version (Impish) to Bionic and Focal

  [Rationale]

  - Current package dwarves-dfsg is old in Ubuntu Bionic and Focal.
  - HWE kernel compilation needs recent "pahole" binary to encode BTF[1] 
information.
  - After talking to SRU team members, updating dwarves-dfsg seemed risky.
  - Creating a new package containing only the new "pahole" tool binary is the 
best option. 
  - Kernel HWE compilations will need to use this package, so it has to be in 
main repository (as kernels builds depend on main only).

  [Security]

  - This package is already stable and exists in Ubuntu.

  
  [Quality assurance]

  - This package is already stable and exists in Ubuntu.

  [Dependencies]

  - Same dependencies as dwarves-dfsg package (already satisfied).

  [Standards compliance]

  - This package is already stable and exists in Ubuntu.

  [Maintenance]

  - SRUs for dwarves-dfsg package within Impish should be applied to
  this package as well.

  [Background information]

  Bug: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330
  contains more information about why this is needed.

  I have been maintaining BTFHUB
  (https://github.com/aquasecurity/btfhub) in order to generate BTF
  files 

[Kernel-packages] [Bug 1949286] [NEW] [MIR]: Include dwarves-dfsg-hwe package into Bionic and Focal

2021-10-31 Thread Rafael David Tinoco
Public bug reported:

This is a follow-on request of bug:

HWE kernels should support eBPF CO-RE
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330

[Availability]

- Package is already available in all Ubuntu versions.
- This is a backported version (Impish) to Bionic and Focal

[Rationale]

- Current package dwarves-dfsg is old in Ubuntu Bionic and Focal.
- HWE kernel compilation needs recent "pahole" binary to encode BTF[1] 
information.
- After talking to SRU team members, updating dwarves-dfsg seemed risky.
- Creating a new package containing only the new "pahole" tool binary is the 
best option. 
- Kernel HWE compilations will need to use this package, so it has to be in 
main repository (as kernels builds depend on main only).

[Security]

- This package is already stable and exists in Ubuntu.


[Quality assurance]

- This package is already stable and exists in Ubuntu.

[Dependencies]

- Same dependencies as dwarves-dfsg package (already satisfied).

[Standards compliance]

- This package is already stable and exists in Ubuntu.

[Maintenance]

- SRUs for dwarves-dfsg package within Impish should be applied to this
package as well.

[Background information]

Bug: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330
contains more information about why this is needed.

I have been maintaining BTFHUB (https://github.com/aquasecurity/btfhub)
in order to generate BTF files to each existing Ubuntu kernel but I feel
that a simple change, like adding a recent pahole tool to the main
archive in Bionic and Focal, is enough to resolve a VERY BIG problem for
eBPF applications to run in HWE kernels in those Ubuntu versions.

A very complete explanation on why BTF is needed for eBPF to be portable
among different kernels currently exists at:
https://github.com/aquasecurity/btfhub/tree/main/tools.

Projects that would already benefit from this change:

- Microsoft: Sysmon Tools for Linux
- Microsoft: Inspektor Gadge
- Elastic: They're working together with us upstream
- Aqua Security: libbpfgo & tracee-ebpf
- All BCC libbpf-tools

and many more.


[1] https://www.kernel.org/doc/html/latest/bpf/btf.html

** Affects: linux (Ubuntu)
 Importance: Undecided
 Status: New

** Affects: linux (Ubuntu Bionic)
 Importance: Undecided
 Status: New

** Affects: linux (Ubuntu Focal)
 Importance: Undecided
 Status: New

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1949286

Title:
  [MIR]: Include dwarves-dfsg-hwe package into Bionic and Focal

Status in linux package in Ubuntu:
  New
Status in linux source package in Bionic:
  New
Status in linux source package in Focal:
  New

Bug description:
  This is a follow-on request of bug:

  HWE kernels should support eBPF CO-RE
  https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330

  [Availability]

  - Package is already available in all Ubuntu versions.
  - This is a backported version (Impish) to Bionic and Focal

  [Rationale]

  - Current package dwarves-dfsg is old in Ubuntu Bionic and Focal.
  - HWE kernel compilation needs recent "pahole" binary to encode BTF[1] 
information.
  - After talking to SRU team members, updating dwarves-dfsg seemed risky.
  - Creating a new package containing only the new "pahole" tool binary is the 
best option. 
  - Kernel HWE compilations will need to use this package, so it has to be in 
main repository (as kernels builds depend on main only).

  [Security]

  - This package is already stable and exists in Ubuntu.

  
  [Quality assurance]

  - This package is already stable and exists in Ubuntu.

  [Dependencies]

  - Same dependencies as dwarves-dfsg package (already satisfied).

  [Standards compliance]

  - This package is already stable and exists in Ubuntu.

  [Maintenance]

  - SRUs for dwarves-dfsg package within Impish should be applied to
  this package as well.

  [Background information]

  Bug: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1926330
  contains more information about why this is needed.

  I have been maintaining BTFHUB
  (https://github.com/aquasecurity/btfhub) in order to generate BTF
  files to each existing Ubuntu kernel but I feel that a simple change,
  like adding a recent pahole tool to the main archive in Bionic and
  Focal, is enough to resolve a VERY BIG problem for eBPF applications
  to run in HWE kernels in those Ubuntu versions.

  A very complete explanation on why BTF is needed for eBPF to be
  portable among different kernels currently exists at:
  https://github.com/aquasecurity/btfhub/tree/main/tools.

  Projects that would already benefit from this change:

  - Microsoft: Sysmon Tools for Linux
  - Microsoft: Inspektor Gadge
  - Elastic: They're working together with us upstream
  - Aqua Security: libbpfgo & tracee-ebpf
  - All BCC libbpf-tools

  and many more.

  
  [1] 

[Kernel-packages] [Bug 1926330] Re: HWE kernels should enable BTF support to enable eBPF CO-RE support

2021-10-31 Thread Rafael David Tinoco
** Summary changed:

- HWE kernels should enable BTF support to enable eBPF RO.CE support
+ HWE kernels should enable BTF support to enable eBPF CO-RE support

** Summary changed:

- HWE kernels should enable BTF support to enable eBPF CO-RE support
+ HWE kernels should support eBPF CO-RE

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1926330

Title:
  HWE kernels should support eBPF CO-RE

Status in dwarves-dfsg package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  Fix Released
Status in dwarves-dfsg source package in Bionic:
  Won't Fix
Status in linux source package in Bionic:
  Won't Fix
Status in dwarves-dfsg source package in Focal:
  Confirmed
Status in linux source package in Focal:
  Confirmed
Status in dwarves-dfsg source package in Groovy:
  Fix Released
Status in linux source package in Groovy:
  Fix Released

Bug description:
  I had recent discussion with kernel team regarding support or not BTF
  in HWE kernels (Bionic and Focal). Having CONFIG_DEBUG_INFO_BTF option
  enabled for HWE kernels (v4.4 and v.4.8) would allow eBPF based code
  (powered by libbpf or not) to be RO.CE
  (https://github.com/rafaeldtinoco/portablebpf for more information).

  By allowing runtime relocations, using provided BTF, libbpf binaries
  might end up running, without modifications, in different kernel
  versions (from Bionic HWE v5.4 kernel to Hirsute v5.11).

  A good example would be to support tools such as:
  
https://github.com/aquasecurity/tracee/discussions/713#discussioncomment-665641
  An ebpf powered backend for a containers security solution.

  Considering:

  $ rmadisonb dwarves
   dwarves | 1.9-1  | precise/universe | amd64
   dwarves | 1.10-2 | trusty   | amd64
   dwarves | 1.10-2.1   | xenial/universe  | amd64
   dwarves | 1.10-2.1build1 | bionic/universe  | amd64
   dwarves | 1.15-2 | focal/universe   | amd64
   dwarves | 1.17-1 | groovy/universe  | amd64
   dwarves | 1.20-1 | hirsute/universe | amd64
   dwarves | 1.20-1 | impish/universe  | amd64

  And the fact that the 'pahole' binary, from dwarves package, is the
  one to blame, not to have CONFIG_DEBUG_INFO_BTF available, for this
  bug to be solved we would have to provide a backport of dwarves (at
  least 1.17-1) to Bionic and Focal. It could have another name (not to
  mess with original dwarves package and its dependencies) and it is
  unclear if it needs to be in [main] or [universe].

  Question: Would have dwarves backported in -backports be enough for
  Bionic and Focal HWE kernels compilation to have CONFIG_DEBUG_INFO_BTF
  enabled ?

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/dwarves-dfsg/+bug/1926330/+subscriptions


-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1926330] Re: HWE kernels should enable BTF support to enable eBPF RO.CE support

2021-10-30 Thread Rafael David Tinoco
** No longer affects: dwarves-dfsg (Ubuntu Hirsute)

** No longer affects: linux (Ubuntu Hirsute)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1926330

Title:
  HWE kernels should enable BTF support to enable eBPF RO.CE support

Status in dwarves-dfsg package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  Fix Released
Status in dwarves-dfsg source package in Bionic:
  Won't Fix
Status in linux source package in Bionic:
  Won't Fix
Status in dwarves-dfsg source package in Focal:
  Confirmed
Status in linux source package in Focal:
  Confirmed
Status in dwarves-dfsg source package in Groovy:
  Fix Released
Status in linux source package in Groovy:
  Fix Released

Bug description:
  I had recent discussion with kernel team regarding support or not BTF
  in HWE kernels (Bionic and Focal). Having CONFIG_DEBUG_INFO_BTF option
  enabled for HWE kernels (v4.4 and v.4.8) would allow eBPF based code
  (powered by libbpf or not) to be RO.CE
  (https://github.com/rafaeldtinoco/portablebpf for more information).

  By allowing runtime relocations, using provided BTF, libbpf binaries
  might end up running, without modifications, in different kernel
  versions (from Bionic HWE v5.4 kernel to Hirsute v5.11).

  A good example would be to support tools such as:
  
https://github.com/aquasecurity/tracee/discussions/713#discussioncomment-665641
  An ebpf powered backend for a containers security solution.

  Considering:

  $ rmadisonb dwarves
   dwarves | 1.9-1  | precise/universe | amd64
   dwarves | 1.10-2 | trusty   | amd64
   dwarves | 1.10-2.1   | xenial/universe  | amd64
   dwarves | 1.10-2.1build1 | bionic/universe  | amd64
   dwarves | 1.15-2 | focal/universe   | amd64
   dwarves | 1.17-1 | groovy/universe  | amd64
   dwarves | 1.20-1 | hirsute/universe | amd64
   dwarves | 1.20-1 | impish/universe  | amd64

  And the fact that the 'pahole' binary, from dwarves package, is the
  one to blame, not to have CONFIG_DEBUG_INFO_BTF available, for this
  bug to be solved we would have to provide a backport of dwarves (at
  least 1.17-1) to Bionic and Focal. It could have another name (not to
  mess with original dwarves package and its dependencies) and it is
  unclear if it needs to be in [main] or [universe].

  Question: Would have dwarves backported in -backports be enough for
  Bionic and Focal HWE kernels compilation to have CONFIG_DEBUG_INFO_BTF
  enabled ?

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/dwarves-dfsg/+bug/1926330/+subscriptions


-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1926330] Re: HWE kernels should enable BTF support to enable eBPF RO.CE support

2021-04-27 Thread Rafael David Tinoco
** Changed in: linux (Ubuntu)
   Status: Incomplete => Confirmed

** Changed in: dwarves-dfsg (Ubuntu)
   Status: New => Confirmed

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1926330

Title:
  HWE kernels should enable BTF support to enable eBPF RO.CE support

Status in dwarves-dfsg package in Ubuntu:
  Confirmed
Status in linux package in Ubuntu:
  Confirmed
Status in dwarves-dfsg source package in Bionic:
  Confirmed
Status in linux source package in Bionic:
  Confirmed
Status in dwarves-dfsg source package in Focal:
  Confirmed
Status in linux source package in Focal:
  Confirmed
Status in dwarves-dfsg source package in Groovy:
  Fix Released
Status in linux source package in Groovy:
  Fix Released

Bug description:
  I had recent discussion with kernel team regarding support or not BTF
  in HWE kernels (Bionic and Focal). Having CONFIG_DEBUG_INFO_BTF option
  enabled for HWE kernels (v4.4 and v.4.8) would allow eBPF based code
  (powered by libbpf or not) to be RO.CE
  (https://github.com/rafaeldtinoco/portablebpf for more information).

  By allowing runtime relocations, using provided BTF, libbpf binaries
  might end up running, without modifications, in different kernel
  versions (from Bionic HWE v5.4 kernel to Hirsute v5.11).

  A good example would be to support tools such as:
  
https://github.com/aquasecurity/tracee/discussions/713#discussioncomment-665641
  An ebpf powered backend for a containers security solution.

  Considering:

  $ rmadisonb dwarves
   dwarves | 1.9-1  | precise/universe | amd64
   dwarves | 1.10-2 | trusty   | amd64
   dwarves | 1.10-2.1   | xenial/universe  | amd64
   dwarves | 1.10-2.1build1 | bionic/universe  | amd64
   dwarves | 1.15-2 | focal/universe   | amd64
   dwarves | 1.17-1 | groovy/universe  | amd64
   dwarves | 1.20-1 | hirsute/universe | amd64
   dwarves | 1.20-1 | impish/universe  | amd64

  And the fact that the 'pahole' binary, from dwarves package, is the
  one to blame, not to have CONFIG_DEBUG_INFO_BTF available, for this
  bug to be solved we would have to provide a backport of dwarves (at
  least 1.17-1) to Bionic and Focal. It could have another name (not to
  mess with original dwarves package and its dependencies) and it is
  unclear if it needs to be in [main] or [universe].

  Question: Would have dwarves backported in -backports be enough for
  Bionic and Focal HWE kernels compilation to have CONFIG_DEBUG_INFO_BTF
  enabled ?

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/dwarves-dfsg/+bug/1926330/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1926330] [NEW] HWE kernels should enable BTF support to enable eBPF RO.CE support

2021-04-27 Thread Rafael David Tinoco
Public bug reported:

I had recent discussion with kernel team regarding support or not BTF in
HWE kernels (Bionic and Focal). Having CONFIG_DEBUG_INFO_BTF option
enabled for HWE kernels (v4.4 and v.4.8) would allow eBPF based code
(powered by libbpf or not) to be RO.CE
(https://github.com/rafaeldtinoco/portablebpf for more information).

By allowing runtime relocations, using provided BTF, libbpf binaries
might end up running, without modifications, in different kernel
versions (from Bionic HWE v5.4 kernel to Hirsute v5.11).

A good example would be to support tools such as:
https://github.com/aquasecurity/tracee/discussions/713#discussioncomment-665641
An ebpf powered backend for a containers security solution.

Considering:

$ rmadisonb dwarves
 dwarves | 1.9-1  | precise/universe | amd64
 dwarves | 1.10-2 | trusty   | amd64
 dwarves | 1.10-2.1   | xenial/universe  | amd64
 dwarves | 1.10-2.1build1 | bionic/universe  | amd64
 dwarves | 1.15-2 | focal/universe   | amd64
 dwarves | 1.17-1 | groovy/universe  | amd64
 dwarves | 1.20-1 | hirsute/universe | amd64
 dwarves | 1.20-1 | impish/universe  | amd64

And the fact that the 'pahole' binary, from dwarves package, is the one
to blame, not to have CONFIG_DEBUG_INFO_BTF available, for this bug to
be solved we would have to provide a backport of dwarves (at least
1.17-1) to Bionic and Focal. It could have another name (not to mess
with original dwarves package and its dependencies) and it is unclear if
it needs to be in [main] or [universe].

Question: Would have dwarves backported in -backports be enough for
Bionic and Focal HWE kernels compilation to have CONFIG_DEBUG_INFO_BTF
enabled ?

** Affects: dwarves-dfsg (Ubuntu)
 Importance: Undecided
 Status: New

** Affects: linux (Ubuntu)
 Importance: Undecided
 Status: Incomplete

** Affects: dwarves-dfsg (Ubuntu Bionic)
 Importance: Undecided
 Status: Confirmed

** Affects: linux (Ubuntu Bionic)
 Importance: Undecided
 Status: Confirmed

** Affects: dwarves-dfsg (Ubuntu Focal)
 Importance: Undecided
 Status: Confirmed

** Affects: linux (Ubuntu Focal)
 Importance: Undecided
 Status: Confirmed

** Affects: dwarves-dfsg (Ubuntu Groovy)
 Importance: Undecided
 Status: Fix Released

** Affects: linux (Ubuntu Groovy)
 Importance: Undecided
 Status: Fix Released

** Also affects: linux (Ubuntu Focal)
   Importance: Undecided
   Status: New

** Also affects: linux (Ubuntu Groovy)
   Importance: Undecided
   Status: New

** Also affects: linux (Ubuntu Bionic)
   Importance: Undecided
   Status: New

** Changed in: linux (Ubuntu Groovy)
   Status: New => Fix Committed

** Changed in: linux (Ubuntu Groovy)
   Status: Fix Committed => Fix Released

** Changed in: linux (Ubuntu Focal)
   Status: New => Confirmed

** Changed in: linux (Ubuntu Bionic)
   Status: New => Confirmed

** Summary changed:

- HWE kernels should enable BTF support to enable new eBPF based code
+ HWE kernels should enable BTF support to enable eBPF RO.CE support

** Also affects: dwarves-dfsg (Ubuntu)
   Importance: Undecided
   Status: New

** Changed in: dwarves-dfsg (Ubuntu Groovy)
   Status: New => Fix Released

** Changed in: dwarves-dfsg (Ubuntu Focal)
   Status: New => Confirmed

** Changed in: dwarves-dfsg (Ubuntu Bionic)
   Status: New => Confirmed

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1926330

Title:
  HWE kernels should enable BTF support to enable eBPF RO.CE support

Status in dwarves-dfsg package in Ubuntu:
  New
Status in linux package in Ubuntu:
  Incomplete
Status in dwarves-dfsg source package in Bionic:
  Confirmed
Status in linux source package in Bionic:
  Confirmed
Status in dwarves-dfsg source package in Focal:
  Confirmed
Status in linux source package in Focal:
  Confirmed
Status in dwarves-dfsg source package in Groovy:
  Fix Released
Status in linux source package in Groovy:
  Fix Released

Bug description:
  I had recent discussion with kernel team regarding support or not BTF
  in HWE kernels (Bionic and Focal). Having CONFIG_DEBUG_INFO_BTF option
  enabled for HWE kernels (v4.4 and v.4.8) would allow eBPF based code
  (powered by libbpf or not) to be RO.CE
  (https://github.com/rafaeldtinoco/portablebpf for more information).

  By allowing runtime relocations, using provided BTF, libbpf binaries
  might end up running, without modifications, in different kernel
  versions (from Bionic HWE v5.4 kernel to Hirsute v5.11).

  A good example would be to support tools such as:
  
https://github.com/aquasecurity/tracee/discussions/713#discussioncomment-665641
  An ebpf powered backend for a containers security solution.

  Considering:

  $ rmadisonb dwarves
   dwarves | 1.9-1  | precise/universe | amd64

[Kernel-packages] [Bug 1913187] Re: iproute2 segfaults when filtering sockets

2021-01-28 Thread Rafael David Tinoco
# verfication

$ dpkg -l iproute2 | grep ii
ii  iproute2   4.15.0-2ubuntu1.3 amd64networking and traffic 
control tools

$ ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1 && echo 
worked
worked

good to migrate. thank you.

-rafaeldtinoco

** Tags removed: verification-needed verification-needed-bionic
** Tags added: verification-done verification-done-bionic

** Changed in: iproute2 (Ubuntu Bionic)
 Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to iproute2 in Ubuntu.
Matching subscriptions: iproute2
https://bugs.launchpad.net/bugs/1913187

Title:
  iproute2 segfaults when filtering sockets

Status in iproute2 package in Ubuntu:
  Fix Released
Status in iproute2 source package in Bionic:
  Fix Committed

Bug description:
  [Impact]

   * The ss tool crashes when a query returns no results (seg fault)

  [Test Case]

   * $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 
127.0.0.1
  Segmentation fault

   * PPA with the fix:
  https://launchpad.net/~rafaeldtinoco/+archive/ubuntu/lp1913187

  [Where problems could occur]

   * The ss tool is impacted and it has its code changed for the fix.

   * The fix is a clean cherry-pick and straightforward (moving
  declaration after a NULL check).

  [Other Info]

  When in Ubuntu Bionic, if one calls:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp  00   
127.0.0.1:58910 127.0.0.1:22   
users:(("ssh",pid=11672,fd=3)) timer:(keepalive,119min,0)

  it works. Just like when in Groovy:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp   00  
127.0.0.1:58908 127.0.0.1:22   
users:(("ssh",pid=1488591,fd=3)) timer:(keepalive,119min,0)

  but.. if there is nothing to show, in Bionic we get a segfault:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  Segmentation fault

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/iproute2/+bug/1913187/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1913187] Re: iproute2 segfaults when filtering sockets

2021-01-26 Thread Rafael David Tinoco
$ git-ubuntu tag --upload

$ git describe
upload/4.15.0-2ubuntu1.3

$ git push pkg upload/4.15.0-2ubuntu1.3
Counting objects: 11, done.
Delta compression using up to 24 threads.
Compressing objects: 100% (11/11), done.
Writing objects: 100% (11/11), 2.07 KiB | 176.00 KiB/s, done.
Total 11 (delta 7), reused 0 (delta 0)
To ssh://git.launchpad.net/ubuntu/+source/iproute2
 * [new tag] upload/4.15.0-2ubuntu1.3 -> upload/4.15.0-2ubuntu1.3

$ debdiff *.dsc | diffstat
 changelog | 7 +++
 patches/lp1913187-ss-fix-NULL-dereference-when-rendering.patch | 40 

 patches/series | 1 +
 3 files changed, 48 insertions(+)

[rafaeldtinoco@iproute2issue ubuntu]$ dput ubuntu 
./iproute2_4.15.0-2ubuntu1.3_source.changes
Checking signature on .changes
gpg: ./iproute2_4.15.0-2ubuntu1.3_source.changes: Valid signature from 
A93E0E0AD83C0D0F
Checking signature on .dsc
gpg: ./iproute2_4.15.0-2ubuntu1.3.dsc: Valid signature from A93E0E0AD83C0D0F
Uploading to ubuntu (via ftp to upload.ubuntu.com):
  Uploading iproute2_4.15.0-2ubuntu1.3.dsc: done.
  Uploading iproute2_4.15.0-2ubuntu1.3.debian.tar.xz: done.
  Uploading iproute2_4.15.0-2ubuntu1.3_source.buildinfo: done.
  Uploading iproute2_4.15.0-2ubuntu1.3_source.changes: done.
Successfully uploaded packages.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to iproute2 in Ubuntu.
Matching subscriptions: iproute2
https://bugs.launchpad.net/bugs/1913187

Title:
  iproute2 segfaults when filtering sockets

Status in iproute2 package in Ubuntu:
  Fix Released
Status in iproute2 source package in Bionic:
  Confirmed

Bug description:
  [Impact]

   * The ss tool crashes when a query returns no results (seg fault)

  [Test Case]

   * $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 
127.0.0.1
  Segmentation fault

   * PPA with the fix:
  https://launchpad.net/~rafaeldtinoco/+archive/ubuntu/lp1913187

  [Where problems could occur]

   * The ss tool is impacted and it has its code changed for the fix.

   * The fix is a clean cherry-pick and straightforward (moving
  declaration after a NULL check).

  [Other Info]

  When in Ubuntu Bionic, if one calls:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp  00   
127.0.0.1:58910 127.0.0.1:22   
users:(("ssh",pid=11672,fd=3)) timer:(keepalive,119min,0)

  it works. Just like when in Groovy:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp   00  
127.0.0.1:58908 127.0.0.1:22   
users:(("ssh",pid=1488591,fd=3)) timer:(keepalive,119min,0)

  but.. if there is nothing to show, in Bionic we get a segfault:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  Segmentation fault

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/iproute2/+bug/1913187/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1913187] Re: iproute2 segfaults when filtering sockets

2021-01-26 Thread Rafael David Tinoco
MP: 
https://code.launchpad.net/~rafaeldtinoco/ubuntu/+source/iproute2/+git/iproute2/+merge/396921
PPA: https://launchpad.net/~rafaeldtinoco/+archive/ubuntu/lp1913187

** Description changed:

+ [Impact]
+ 
+  * The ss tool crashes when a query returns no results (seg fault)
+ 
+ [Test Case]
+ 
+  * $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 
127.0.0.1
+ Segmentation fault
+ 
+ [Where problems could occur]
+ 
+  * The ss tool is impacted and it has its code changed for the fix.
+ 
+  * The fix is a clean cherry-pick and straightforward (moving
+ declaration after a NULL check).
+ 
+ [Other Info]
+  
  When in Ubuntu Bionic, if one calls:
  
  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp  00   
127.0.0.1:58910 127.0.0.1:22   
users:(("ssh",pid=11672,fd=3)) timer:(keepalive,119min,0)
  
  it works. Just like when in Groovy:
  
  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp   00  
127.0.0.1:58908 127.0.0.1:22   
users:(("ssh",pid=1488591,fd=3)) timer:(keepalive,119min,0)
  
  but.. if there is nothing to show, in Bionic we get a segfault:
  
  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  Segmentation fault

** Description changed:

  [Impact]
  
-  * The ss tool crashes when a query returns no results (seg fault)
+  * The ss tool crashes when a query returns no results (seg fault)
  
  [Test Case]
  
-  * $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 
127.0.0.1
- Segmentation fault
+  * $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 
127.0.0.1
+ Segmentation fault
+ 
+  * PPA with the fix:
+ https://launchpad.net/~rafaeldtinoco/+archive/ubuntu/lp1913187
  
  [Where problems could occur]
  
-  * The ss tool is impacted and it has its code changed for the fix.
+  * The ss tool is impacted and it has its code changed for the fix.
  
-  * The fix is a clean cherry-pick and straightforward (moving
+  * The fix is a clean cherry-pick and straightforward (moving
  declaration after a NULL check).
  
  [Other Info]
-  
+ 
  When in Ubuntu Bionic, if one calls:
  
  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp  00   
127.0.0.1:58910 127.0.0.1:22   
users:(("ssh",pid=11672,fd=3)) timer:(keepalive,119min,0)
  
  it works. Just like when in Groovy:
  
  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp   00  
127.0.0.1:58908 127.0.0.1:22   
users:(("ssh",pid=1488591,fd=3)) timer:(keepalive,119min,0)
  
  but.. if there is nothing to show, in Bionic we get a segfault:
  
  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  Segmentation fault

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to iproute2 in Ubuntu.
Matching subscriptions: iproute2
https://bugs.launchpad.net/bugs/1913187

Title:
  iproute2 segfaults when filtering sockets

Status in iproute2 package in Ubuntu:
  Fix Released
Status in iproute2 source package in Bionic:
  Confirmed

Bug description:
  [Impact]

   * The ss tool crashes when a query returns no results (seg fault)

  [Test Case]

   * $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 
127.0.0.1
  Segmentation fault

   * PPA with the fix:
  https://launchpad.net/~rafaeldtinoco/+archive/ubuntu/lp1913187

  [Where problems could occur]

   * The ss tool is impacted and it has its code changed for the fix.

   * The fix is a clean cherry-pick and straightforward (moving
  declaration after a NULL check).

  [Other Info]

  When in Ubuntu Bionic, if one calls:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp  00   
127.0.0.1:58910 127.0.0.1:22   
users:(("ssh",pid=11672,fd=3)) timer:(keepalive,119min,0)

  it works. Just like when in Groovy:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp   00  
127.0.0.1:58908 127.0.0.1:22   
users:(("ssh",pid=1488591,fd=3)) timer:(keepalive,119min,0)

  but.. if there is nothing to show, in Bionic we get a segfault:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  Segmentation fault

To manage notifications about this bug go to:

[Kernel-packages] [Bug 1913187] Re: iproute2 segfaults when filtering sockets

2021-01-26 Thread Rafael David Tinoco
[rafaeldtinoco@iproute2issue iproute2]$ git unfixed
eb8559eff124221bfbafe934c4dbfe30f20604c0 is the first bad commit
commit eb8559eff124221bfbafe934c4dbfe30f20604c0
Author: Jean-Philippe Brucker 
Date:   Sat Mar 3 16:59:44 2018 +

ss: fix NULL dereference when rendering without header

When ss is invoked with the no-header flag, if the query doesn't return
any result, render() is called with 'buffer' uninitialized. This
currently leads to a segfault. Ensure that buffer is initialized before
rendering.

The bug can be triggered with: ss -H sport = 10

Signed-off-by: Jean-Philippe Brucker 
Acked-by: Stefano Brivio 
Signed-off-by: Stephen Hemminger 

:04 04 bf8f626f1c0b85bd690dab60d4f74db292ac8e65
6174ebf0728edab46c62b713f6aee495eef81cb5 M  misc

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to iproute2 in Ubuntu.
Matching subscriptions: iproute2
https://bugs.launchpad.net/bugs/1913187

Title:
  iproute2 segfaults when filtering sockets

Status in iproute2 package in Ubuntu:
  Fix Released
Status in iproute2 source package in Bionic:
  Confirmed

Bug description:
  When in Ubuntu Bionic, if one calls:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp  00   
127.0.0.1:58910 127.0.0.1:22   
users:(("ssh",pid=11672,fd=3)) timer:(keepalive,119min,0)

  it works. Just like when in Groovy:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp   00  
127.0.0.1:58908 127.0.0.1:22   
users:(("ssh",pid=1488591,fd=3)) timer:(keepalive,119min,0)

  but.. if there is nothing to show, in Bionic we get a segfault:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  Segmentation fault

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/iproute2/+bug/1913187/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1913187] Re: iproute2 segfaults when filtering sockets

2021-01-26 Thread Rafael David Tinoco
It only affects Bionic:

[rafaeldtinoco@iproute2issue iproute2]$ git describe 
eb8559eff124221bfbafe934c4dbfe30f20604c0
v4.15.0-103-geb8559ef

[rafaeldtinoco@iproute2issue ~]$ rmadison iproute2
 iproute2 | 3.12.0-2  | trusty   | source
 iproute2 | 3.12.0-2ubuntu1.2 | trusty-updates   | source
 iproute2 | 4.3.0-1ubuntu3| xenial   | source
 iproute2 | 4.3.0-1ubuntu3.16.04.5| xenial-updates   | source
 iproute2 | 4.15.0-2ubuntu1   | bionic   | source
 iproute2 | 4.15.0-2ubuntu1.1 | bionic-security  | source
 iproute2 | 4.15.0-2ubuntu1.2 | bionic-updates   | source
 iproute2 | 4.18.0-1ubuntu2~ubuntu18.04.1 | bionic-backports | source
 iproute2 | 5.5.0-1ubuntu1| focal| source
 iproute2 | 5.7.0-1ubuntu1| groovy   | source
 iproute2 | 5.9.0-1ubuntu1| hirsute  | source
 iproute2 | 5.10.0-2ubuntu1   | hirsute-proposed | source

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to iproute2 in Ubuntu.
Matching subscriptions: iproute2
https://bugs.launchpad.net/bugs/1913187

Title:
  iproute2 segfaults when filtering sockets

Status in iproute2 package in Ubuntu:
  Fix Released
Status in iproute2 source package in Bionic:
  Confirmed

Bug description:
  When in Ubuntu Bionic, if one calls:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp  00   
127.0.0.1:58910 127.0.0.1:22   
users:(("ssh",pid=11672,fd=3)) timer:(keepalive,119min,0)

  it works. Just like when in Groovy:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp   00  
127.0.0.1:58908 127.0.0.1:22   
users:(("ssh",pid=1488591,fd=3)) timer:(keepalive,119min,0)

  but.. if there is nothing to show, in Bionic we get a segfault:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  Segmentation fault

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/iproute2/+bug/1913187/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1913187] Re: iproute2 segfaults when filtering sockets

2021-01-25 Thread Rafael David Tinoco
workaround:

sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst
127.0.0.1 | cat -

by not trying to control terminal WIDTH, segfault does not occur.

** Changed in: iproute2 (Ubuntu Bionic)
   Importance: Undecided => Low

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to iproute2 in Ubuntu.
Matching subscriptions: iproute2
https://bugs.launchpad.net/bugs/1913187

Title:
  iproute2 segfaults when filtering sockets

Status in iproute2 package in Ubuntu:
  Fix Released
Status in iproute2 source package in Bionic:
  Confirmed

Bug description:
  When in Ubuntu Bionic, if one calls:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp  00   
127.0.0.1:58910 127.0.0.1:22   
users:(("ssh",pid=11672,fd=3)) timer:(keepalive,119min,0)

  it works. Just like when in Groovy:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp   00  
127.0.0.1:58908 127.0.0.1:22   
users:(("ssh",pid=1488591,fd=3)) timer:(keepalive,119min,0)

  but.. if there is nothing to show, in Bionic we get a segfault:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  Segmentation fault

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/iproute2/+bug/1913187/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1913187] Re: iproute2 segfaults when filtering sockets

2021-01-25 Thread Rafael David Tinoco
Issues comes from:

(gdb) bt
#0  render (screen_width=144) at ss.c:1204
#1  main (argc=, argv=) at ss.c:4974

render (screen_width=144) at ss.c:1204

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to iproute2 in Ubuntu.
Matching subscriptions: iproute2
https://bugs.launchpad.net/bugs/1913187

Title:
  iproute2 segfaults when filtering sockets

Status in iproute2 package in Ubuntu:
  Fix Released
Status in iproute2 source package in Bionic:
  Confirmed

Bug description:
  When in Ubuntu Bionic, if one calls:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp  00   
127.0.0.1:58910 127.0.0.1:22   
users:(("ssh",pid=11672,fd=3)) timer:(keepalive,119min,0)

  it works. Just like when in Groovy:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp   00  
127.0.0.1:58908 127.0.0.1:22   
users:(("ssh",pid=1488591,fd=3)) timer:(keepalive,119min,0)

  but.. if there is nothing to show, in Bionic we get a segfault:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  Segmentation fault

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/iproute2/+bug/1913187/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1913187] [NEW] iproute2 segfaults when filtering sockets

2021-01-25 Thread Rafael David Tinoco
Public bug reported:

When in Ubuntu Bionic, if one calls:

$ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
tcp  00   
127.0.0.1:58910 127.0.0.1:22   
users:(("ssh",pid=11672,fd=3)) timer:(keepalive,119min,0)

it works. Just like when in Groovy:

$ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
tcp   00  
127.0.0.1:58908 127.0.0.1:22   
users:(("ssh",pid=1488591,fd=3)) timer:(keepalive,119min,0)

but.. if there is nothing to show, in Bionic we get a segfault:

$ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
Segmentation fault

** Affects: iproute2 (Ubuntu)
 Importance: Undecided
 Status: Fix Released

** Affects: iproute2 (Ubuntu Bionic)
 Importance: Undecided
     Assignee: Rafael David Tinoco (rafaeldtinoco)
 Status: Confirmed

** Changed in: iproute2 (Ubuntu)
   Status: New => Confirmed

** Also affects: iproute2 (Ubuntu Bionic)
   Importance: Undecided
   Status: New

** Changed in: iproute2 (Ubuntu Bionic)
   Status: New => Confirmed

** Changed in: iproute2 (Ubuntu)
   Status: Confirmed => Fix Released

** Changed in: iproute2 (Ubuntu Bionic)
     Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to iproute2 in Ubuntu.
Matching subscriptions: iproute2
https://bugs.launchpad.net/bugs/1913187

Title:
  iproute2 segfaults when filtering sockets

Status in iproute2 package in Ubuntu:
  Fix Released
Status in iproute2 source package in Bionic:
  Confirmed

Bug description:
  When in Ubuntu Bionic, if one calls:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp  00   
127.0.0.1:58910 127.0.0.1:22   
users:(("ssh",pid=11672,fd=3)) timer:(keepalive,119min,0)

  it works. Just like when in Groovy:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  tcp   00  
127.0.0.1:58908 127.0.0.1:22   
users:(("ssh",pid=1488591,fd=3)) timer:(keepalive,119min,0)

  but.. if there is nothing to show, in Bionic we get a segfault:

  $ sudo ss -Hnp -o state established 'dport = 22' src 127.0.0.1 dst 127.0.0.1
  Segmentation fault

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/iproute2/+bug/1913187/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1895526] Re: ocfs2 file system no longer write - "disk full" despite lots of free space

2020-09-22 Thread Rafael David Tinoco
Thanks a lot for catching up with this @mfo. And Richard for all the
tests.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1895526

Title:
  ocfs2 file system no longer write - "disk full" despite lots of free
  space

Status in linux package in Ubuntu:
  Incomplete
Status in ocfs2-tools package in Ubuntu:
  Confirmed

Bug description:
  Fairly new server on Ubuntu 20.04.1 LTS, 5.4.0-47-generic kernel, DRBD device 
across 2 sites with one server in each site, ocfs2 filesystem on DRBD device, 
shared to local network using Samba (and also Samba-AD-DC for network). All 
packages from "normal" Ubuntu repositories. ocfs2-tools is Installed: 
1.8.6-2ubuntu1. The filesystem is around 3.3 TB. Stored data amounted to 24% of 
this filesystem.
  Recent updates applied and server restarted Wed 9th Sept after which staff 
started reporting inability to save to server shares. Checked Samba settings as 
Windows error messages were at first showing permission issues, but following 
various checks no wrong Samba settings were found so restarted their server 
after which the errors were "no space left on disk". Checked on the server 
terminal and couldn't even "touch" an empty file but got "no space left on 
disk". Found an article describing limitations caused by ocfs2 cluster size, so 
copied all data out to a backup machine, recreated the ocfs2 file system using
  mkfs.ocfs2 -C 64K /dev/drbd0
  but again the "no disk space" error keeps happening despite this now being an 
empty file system. Perhaps it wasn't a cluster size problem in the first 
instance.

  ProblemType: Bug
  DistroRelease: Ubuntu 20.04
  Package: ocfs2-tools 1.8.6-2ubuntu1
  ProcVersionSignature: Ubuntu 5.4.0-47.51-generic 5.4.55
  Uname: Linux 5.4.0-47-generic x86_64
  ApportVersion: 2.20.11-0ubuntu27.8
  Architecture: amd64
  CasperMD5CheckResult: pass
  Date: Mon Sep 14 12:23:35 2020
  InstallationDate: Installed on 2020-05-06 (130 days ago)
  InstallationMedia: Ubuntu-Server 20.04 LTS "Focal Fossa" - Release amd64 
(20200423)
  ProcEnviron:
   TERM=xterm-256color
   PATH=(custom, no user)
   LANG=en_US.UTF-8
   SHELL=/bin/bash
  SourcePackage: ocfs2-tools
  UpgradeStatus: No upgrade log present (probably fresh install)

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1895526/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1891214] Re: targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR option disabled

2020-09-08 Thread Rafael David Tinoco
** Changed in: python-rtslib-fb (Ubuntu)
   Status: Confirmed => Fix Committed

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1891214

Title:
  targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR
  option disabled

Status in linux package in Ubuntu:
  Fix Released
Status in python-rtslib-fb package in Ubuntu:
  Fix Committed
Status in qemu package in Ubuntu:
  Fix Released

Bug description:
  targetcli-fb was recently included in MAIN and rely on some features
  that aren't available currently in Ubuntu:

  ## TCM VHOST

  /vhost> create
  b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...

  not enabled in Ubuntu kernels.

  QEMU virtio-scsi feature:

  https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview

  KERNEL option to be enabled:

  https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html

  KERNEL TCM documentation:

  https://www.kernel.org/doc/html/latest/target/tcmu-design.html

  LIO (LinuxIO) VHOST feature explained:

  http://linux-iscsi.org/wiki/VHost

  ## XEN PVSCSI

  Same happens for XEN:

  https://wiki.xenproject.org/wiki/Paravirtualized_SCSI

  PS: this would I would go for a targetcli fabric module disablement
  instead of enabling the feature.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1891214/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1891214] Re: targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR option disabled

2020-09-08 Thread Rafael David Tinoco
With suggested fix:

[rafaeldtinoco@guestdevel ubuntu]$ sudo targetcli 
targetcli shell version 2.1.53
Copyright 2011-2013 by Datera, Inc and others.
For help on commands, type 'help'.

/> ls /
o- / 
..
 [...]
  o- backstores 
... 
[...]
  | o- block 
... [Storage 
Objects: 0]
  | o- fileio 
.. [Storage 
Objects: 0]
  | o- pscsi 
... [Storage 
Objects: 0]
  | o- ramdisk 
. [Storage 
Objects: 0]
  o- iscsi 
. 
[Targets: 0]
  o- loopback 
.. 
[Targets: 0]
  o- vhost 
. 
[Targets: 0]
/> cd /xen-pvscsi
No such path /xen-pvscsi


** Changed in: qemu (Ubuntu)
   Status: Incomplete => Fix Released

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1891214

Title:
  targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR
  option disabled

Status in linux package in Ubuntu:
  Fix Released
Status in python-rtslib-fb package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  Fix Released

Bug description:
  targetcli-fb was recently included in MAIN and rely on some features
  that aren't available currently in Ubuntu:

  ## TCM VHOST

  /vhost> create
  b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...

  not enabled in Ubuntu kernels.

  QEMU virtio-scsi feature:

  https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview

  KERNEL option to be enabled:

  https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html

  KERNEL TCM documentation:

  https://www.kernel.org/doc/html/latest/target/tcmu-design.html

  LIO (LinuxIO) VHOST feature explained:

  http://linux-iscsi.org/wiki/VHost

  ## XEN PVSCSI

  Same happens for XEN:

  https://wiki.xenproject.org/wiki/Paravirtualized_SCSI

  PS: this would I would go for a targetcli fabric module disablement
  instead of enabling the feature.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1891214/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1891214] Re: targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR option disabled

2020-09-08 Thread Rafael David Tinoco
$ sudo modinfo tcm_vhost
filename:   /lib/modules/5.8.0-18-generic/kernel/drivers/vhost/vhost_scsi.ko
license:GPL
alias:  tcm_vhost
description:VHOST_SCSI series fabric driver
srcversion: 2AD428CAF926D0F5A58751D
depends:target_core_mod,vhost
retpoline:  Y
intree: Y
name:   vhost_scsi
vermagic:   5.8.0-18-generic SMP mod_unload 
sig_id: PKCS#7
signer: Build time autogenerated kernel key
sig_key:36:2A:15:BD:BF:65:C1:25:91:5F:A9:27:E5:4C:76:B8:C2:26:6B:1C
sig_hashalgo:   sha512
signature:  65:8B:63:37:F0:CE:40:48:AF:56:65:DC:F3:6F:29:DB:E8:D9:A7:86:

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1891214

Title:
  targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR
  option disabled

Status in linux package in Ubuntu:
  Fix Released
Status in python-rtslib-fb package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  Incomplete

Bug description:
  targetcli-fb was recently included in MAIN and rely on some features
  that aren't available currently in Ubuntu:

  ## TCM VHOST

  /vhost> create
  b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...

  not enabled in Ubuntu kernels.

  QEMU virtio-scsi feature:

  https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview

  KERNEL option to be enabled:

  https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html

  KERNEL TCM documentation:

  https://www.kernel.org/doc/html/latest/target/tcmu-design.html

  LIO (LinuxIO) VHOST feature explained:

  http://linux-iscsi.org/wiki/VHost

  ## XEN PVSCSI

  Same happens for XEN:

  https://wiki.xenproject.org/wiki/Paravirtualized_SCSI

  PS: this would I would go for a targetcli fabric module disablement
  instead of enabling the feature.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1891214/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1891214] Re: targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR option disabled

2020-09-08 Thread Rafael David Tinoco
/vhost> cd /xen-pvscsi 
l/xen-pvscsi> ls
o- xen-pvscsi 
.. 
[Targets: 0]
/xen-pvscsi> create 
b"modprobe: ERROR: could not insert 'xen_scsiback': No such device\n"
/xen-pvscsi> quit

Will disable the XEN-PVSCSI then.

## XEN PVSCSI

Same happens for XEN:

https://wiki.xenproject.org/wiki/Paravirtualized_SCSI

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1891214

Title:
  targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR
  option disabled

Status in linux package in Ubuntu:
  Fix Released
Status in python-rtslib-fb package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  Incomplete

Bug description:
  targetcli-fb was recently included in MAIN and rely on some features
  that aren't available currently in Ubuntu:

  ## TCM VHOST

  /vhost> create
  b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...

  not enabled in Ubuntu kernels.

  QEMU virtio-scsi feature:

  https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview

  KERNEL option to be enabled:

  https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html

  KERNEL TCM documentation:

  https://www.kernel.org/doc/html/latest/target/tcmu-design.html

  LIO (LinuxIO) VHOST feature explained:

  http://linux-iscsi.org/wiki/VHost

  ## XEN PVSCSI

  Same happens for XEN:

  https://wiki.xenproject.org/wiki/Paravirtualized_SCSI

  PS: this would I would go for a targetcli fabric module disablement
  instead of enabling the feature.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1891214/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1891214] Re: targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR option disabled

2020-09-08 Thread Rafael David Tinoco
Ooops TCM_VHOST is good for Groovy:

/> cd /vhost
/vhost> create
Created target naa.500140533cd76f07.
Created TPG 1.
  
/vhost> delete naa.500140533cd76f07 
Deleted Target naa.500140533cd76f07.

/vhost> quit

Tagging linux as Fix Released.

** Changed in: linux (Ubuntu)
   Status: Confirmed => Fix Released

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1891214

Title:
  targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR
  option disabled

Status in linux package in Ubuntu:
  Fix Released
Status in python-rtslib-fb package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  Incomplete

Bug description:
  targetcli-fb was recently included in MAIN and rely on some features
  that aren't available currently in Ubuntu:

  ## TCM VHOST

  /vhost> create
  b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...

  not enabled in Ubuntu kernels.

  QEMU virtio-scsi feature:

  https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview

  KERNEL option to be enabled:

  https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html

  KERNEL TCM documentation:

  https://www.kernel.org/doc/html/latest/target/tcmu-design.html

  LIO (LinuxIO) VHOST feature explained:

  http://linux-iscsi.org/wiki/VHost

  ## XEN PVSCSI

  Same happens for XEN:

  https://wiki.xenproject.org/wiki/Paravirtualized_SCSI

  PS: this would I would go for a targetcli fabric module disablement
  instead of enabling the feature.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1891214/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1891214] Re: targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR option disabled

2020-09-08 Thread Rafael David Tinoco
Okay, since TCM_VHOST is experimental in kernel, as we are in feature
freeze for Groovy, I'm going to cap the missing features from targetcli
so end user does not experience failures from the UI. This bug can serve
as a future guidance in enabling those options (specially TCM_VHOST).

** Changed in: qemu (Ubuntu)
Milestone: ubuntu-20.10-beta => None

** Changed in: python-rtslib-fb (Ubuntu)
Milestone: ubuntu-20.10-beta => None

** Changed in: linux (Ubuntu)
Milestone: ubuntu-20.10-beta => None

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1891214

Title:
  targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR
  option disabled

Status in linux package in Ubuntu:
  Confirmed
Status in python-rtslib-fb package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  Incomplete

Bug description:
  targetcli-fb was recently included in MAIN and rely on some features
  that aren't available currently in Ubuntu:

  ## TCM VHOST

  /vhost> create
  b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...

  not enabled in Ubuntu kernels.

  QEMU virtio-scsi feature:

  https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview

  KERNEL option to be enabled:

  https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html

  KERNEL TCM documentation:

  https://www.kernel.org/doc/html/latest/target/tcmu-design.html

  LIO (LinuxIO) VHOST feature explained:

  http://linux-iscsi.org/wiki/VHost

  ## XEN PVSCSI

  Same happens for XEN:

  https://wiki.xenproject.org/wiki/Paravirtualized_SCSI

  PS: this would I would go for a targetcli fabric module disablement
  instead of enabling the feature.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1891214/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1496942] Re: Infiniband (mellanox) SR-IOV and libvirt + libnl problems

2020-09-03 Thread Rafael David Tinoco
Let's keep this bug as Invalid please. There is no issue specific issue
to be solved here.

Thank you

-rafaeldtinoco

** Changed in: linux (Ubuntu)
   Status: In Progress => Invalid

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1496942

Title:
  Infiniband (mellanox) SR-IOV and libvirt + libnl problems

Status in linux package in Ubuntu:
  Invalid
Status in linux package in Debian:
  New

Bug description:
  When trying to start an IB SR-IOV guest by using the following XML:

  


  


  

  following the Mellanox SR-IOV guide, we are able to start guests using
  kernel 3.16 (Utopic).

  We are NOT able to start guests using 3.13 OR 3.19. The following
  error occurs:

  2015-09-17 02:25:07.208+: 52157: info : libvirt version: 1.2.12, package: 
1.2.12-0ubuntu14.1~cloud0
  2015-09-17 02:25:07.208+: 52157: error : virSecurityDriverLookup:80 : 
unsupported configuration: Security driver apparmor not enabled
  2015-09-17 02:25:42.308+: 52281: info : libvirt version: 1.2.12, package: 
1.2.12-0ubuntu14.1~cloud0
  2015-09-17 02:25:42.308+: 52281: error : virSecurityDriverLookup:80 : 
unsupported configuration: Security driver apparmor not enabled
  2015-09-17 02:25:48.996+: 52274: error : virNetDevParseVfConfig:1905 : 
internal error: missing IFLA_VF_INFO in netlink response
  2015-09-17 02:25:49.006+: 52274: error : virFileReadAll:1347 : Failed to 
open file '/var/run/libvirt/hostdevmgr/ib0_vf0': No such file or directory
  2015-09-17 02:25:49.006+: 52274: error : virFileReadAll:1347 : Failed to 
open file '/var/run/libvirt/qemu/ib0_vf0': No such file or directory

  So probably there is some regression in between 3.16 and 3.19 for the
  IFLA_VF_INFO feature from netlink AND this has to be backported to
  kernel 3.13 for Trusty to have IB SR-IOV working.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1496942/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1861941] Re: bcache by-uuid links disappear after mounting bcache0

2020-08-21 Thread Rafael David Tinoco
Bionic verification:

$ apt changelog bcache-tools | head -10

bcache-tools (1.0.8-2ubuntu0.18.04.1) bionic; urgency=medium

  [ Ryan Harper ]
  * Add helper script to read bcache devs superblock (LP: #1861941)

 -- Rafael David Tinoco   Wed, 05 Aug 2020
17:44:05 -0300

bcache-tools (1.0.8-2build1) artful; urgency=medium



$ dpkg-query -f '${Package}###${Version}\n' -W 'bcache-tools'
bcache-tools###1.0.8-2ubuntu0.18.04.1


$ sudo ./test-bcache.sh 
/mnt is a mountpoint
/dev/bcache0: 2 bytes were erased at offset 0x0438 (ext4): 53 ef
writing 1 to /sys/class/block/bcache0/bcache/stop
writing 1 to /sys/fs/bcache/60412675-9103-47b0-9794-91fcfb12d50d/stop
/dev/vdc: 16 bytes were erased at offset 0x1018 (bcache): c6 85 73 f6 4e 1a 
45 ca 82 65 f5 7f 48 ba 6d 81
10+0 records in
10+0 records out
10485760 bytes (10 MB, 10 MiB) copied, 0.0173157 s, 606 MB/s
/dev/vdb: 16 bytes were erased at offset 0x1018 (bcache): c6 85 73 f6 4e 1a 
45 ca 82 65 f5 7f 48 ba 6d 81
10+0 records in
10+0 records out
10485760 bytes (10 MB, 10 MiB) copied, 0.00634546 s, 1.7 GB/s
UUID:   c3758ea3-0e2c-42e3-bb77-da27292d2476
Set UUID:   b2b21f55-3599-461a-b162-8377d85fbc34
version:0
nbuckets:   2048
block_size: 1
bucket_size:1024
nr_in_set:  1
nr_this_dev:0
first_bucket:   1
UUID:   f4001b7e-386e-4ca3-a5e0-d53f100d156f
Set UUID:   b2b21f55-3599-461a-b162-8377d85fbc34
version:1
block_size: 1
data_offset:16
/dev/vdc
tee: /sys/fs/bcache/register: Invalid argument
/dev/vdb
tee: /sys/fs/bcache/register: Invalid argument
total 0
drwxr-xr-x 2 root root 60 Aug 21 14:03 .
drwxr-xr-x 3 root root 60 Aug 21 14:03 ..
lrwxrwxrwx 1 root root 13 Aug 21 14:03 f4001b7e-386e-4ca3-a5e0-d53f100d156f -> 
../../bcache0
Creating filesystems on bcache0
mke2fs 1.44.1 (24-Mar-2018)
Discarding device blocks: done
Creating filesystem with 262142 4k blocks and 65536 inodes
Filesystem UUID: 4ade91a9-6176-4a93-a34f-158fa08d0091
Superblock backups stored on blocks: 
32768, 98304, 163840, 229376

Allocating group tables: done
Writing inode tables: done
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: done

mounting bcache0 to /mnt
total 0
drwxr-xr-x 2 root root 60 Aug 21 14:03 .
drwxr-xr-x 3 root root 60 Aug 21 14:03 ..
lrwxrwxrwx 1 root root 13 Aug 21 14:03 f4001b7e-386e-4ca3-a5e0-d53f100d156f -> 
../../bcache0
Everything OK


** Tags removed: verification-needed verification-needed-bionic
** Tags added: verification-done verification-done-bionic

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1861941

Title:
  bcache by-uuid links disappear after mounting bcache0

Status in bcache-tools package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  Fix Committed
Status in systemd package in Ubuntu:
  Fix Released
Status in bcache-tools source package in Bionic:
  Fix Committed
Status in systemd source package in Bionic:
  Won't Fix
Status in bcache-tools source package in Focal:
  Fix Released
Status in systemd source package in Focal:
  In Progress

Bug description:
  SRU TEAM: The last 2 commits show a summary for the merges/changes
  I added some specific (to Bionic) notes in the template.
  Thanks!

  [Impact]

   * bcache-tools udev created symlinks might disappear when other udev
  events are processed for the same devices.

   * after mkfs.XXX in /dev/bcacheY you might face a condition where
  /dev/bcache/by-{uuid,label}/zzz symlinks are gone.

   * /dev/bcache/by-{uuid,label}/ symlinks are important so bcache
  devices can be addressed by their UUIDs and not the ordering they were
  assembled (MAAS depends on this feature, for example).

   * it was also discussed in this bug that systemd-udev should *not*
  populate /dev/disk/by-uuid/ with symlinks of disks that were bcache
  backing devices. this was turned into a discussion whether blkid
  should report those or not, and this discussion "died" after sometime.
  This last item is what the systemd update is all about: to disallow
  /dev/disk/by-XXX/ creation for bcache backing devices (a simple
  change that will reduce end users confusion).

  [Test Case]

   * The reproducer script is here:

     https://paste.ubuntu.com/p/37KGy2Smnp/

   * Bionic can't reproduce the issue with the 18.04 kernel, nor with
  the HWE kernel. Nevertheless, it is preferable that Bionic also do the
  same thing: to read bcache superblock and feed environment for
  /dev/bcache/by-{uuid,label} symlinks creation.

  [Regression Potential]

   * We are not depending on bcache device udev events any more when
  creating the /dev/bcache/by-{uuid,label}/ symli

[Kernel-packages] [Bug 1891214] Re: targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR option disabled

2020-08-11 Thread Rafael David Tinoco
** Changed in: linux (Ubuntu)
   Status: Incomplete => Confirmed

** Changed in: python-rtslib-fb (Ubuntu)
   Status: In Progress => Confirmed

** Changed in: python-rtslib-fb (Ubuntu)
 Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1891214

Title:
  targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR
  option disabled

Status in linux package in Ubuntu:
  Confirmed
Status in python-rtslib-fb package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  New

Bug description:
  targetcli-fb was recently included in MAIN and rely on some features
  that aren't available currently in Ubuntu:

  ## TCM VHOST

  /vhost> create
  b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...

  not enabled in Ubuntu kernels.

  QEMU virtio-scsi feature:

  https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview

  KERNEL option to be enabled:

  https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html

  KERNEL TCM documentation:

  https://www.kernel.org/doc/html/latest/target/tcmu-design.html

  LIO (LinuxIO) VHOST feature explained:

  http://linux-iscsi.org/wiki/VHost

  ## XEN PVSCSI

  Same happens for XEN:

  https://wiki.xenproject.org/wiki/Paravirtualized_SCSI

  PS: this would I would go for a targetcli fabric module disablement
  instead of enabling the feature.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1891214/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1891214] Re: targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR option disabled

2020-08-11 Thread Rafael David Tinoco
Please other teams/people,

let me know your thoughts. I'm able to disable those existing fabric LIO
modules, but... at least TCM VHOST might be worth to be kept (if we can
explore/enable in QEMU).

Cheers

** Summary changed:

- targetcli/LIO needs tcm_vhost feature enabled
+ targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR option 
disabled

** Description changed:

+ targetcli-fb was recently included in MAIN and rely on some features
+ that aren't available currently in Ubuntu:
  
- targetcli-fb was recently included in MAIN and one of its features is the 
VHOST TCM:
+ ## TCM VHOST
  
- /vhost> create 
+ /vhost> create
  b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...
  
  not enabled in Ubuntu kernels.
  
  QEMU virtio-scsi feature:
  
  https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview
  
  KERNEL option to be enabled:
  
  https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html
  
  KERNEL TCM documentation:
  
  https://www.kernel.org/doc/html/latest/target/tcmu-design.html
  
  LIO (LinuxIO) VHOST feature explained:
  
  http://linux-iscsi.org/wiki/VHost
+ 
+ ## XEN PVSCSI
+ 
+ Same happens for XEN:
+ 
+ https://wiki.xenproject.org/wiki/Paravirtualized_SCSI
+ 
+ PS: this would I would go for a targetcli fabric module disablement
+ instead of enabling the feature.

** Changed in: qemu (Ubuntu)
Milestone: None => ubuntu-20.10-beta

** Changed in: python-rtslib-fb (Ubuntu)
Milestone: None => ubuntu-20.10-beta

** Changed in: linux (Ubuntu)
Milestone: None => ubuntu-20.10-beta

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1891214

Title:
  targetcli/LIO needs tcm_vhost and xen-scsiback feature enabled OR
  option disabled

Status in linux package in Ubuntu:
  Incomplete
Status in python-rtslib-fb package in Ubuntu:
  In Progress
Status in qemu package in Ubuntu:
  New

Bug description:
  targetcli-fb was recently included in MAIN and rely on some features
  that aren't available currently in Ubuntu:

  ## TCM VHOST

  /vhost> create
  b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...

  not enabled in Ubuntu kernels.

  QEMU virtio-scsi feature:

  https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview

  KERNEL option to be enabled:

  https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html

  KERNEL TCM documentation:

  https://www.kernel.org/doc/html/latest/target/tcmu-design.html

  LIO (LinuxIO) VHOST feature explained:

  http://linux-iscsi.org/wiki/VHost

  ## XEN PVSCSI

  Same happens for XEN:

  https://wiki.xenproject.org/wiki/Paravirtualized_SCSI

  PS: this would I would go for a targetcli fabric module disablement
  instead of enabling the feature.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1891214/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1891214] Re: targetcli/LIO needs tcm_vhost feature enabled

2020-08-11 Thread Rafael David Tinoco
I have flagged this as affecting:

- targetcli-fb (vhost feature broken)

- QEMU (vhost scsi support enabled ?)

- kernel (would need TCM_VHOST feature enabled)

** Also affects: python-rtslib-fb (Ubuntu)
   Importance: Undecided
   Status: New

** No longer affects: targetcli-fb (Ubuntu)

** Changed in: python-rtslib-fb (Ubuntu)
   Status: New => In Progress

** Changed in: python-rtslib-fb (Ubuntu)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1891214

Title:
  targetcli/LIO needs tcm_vhost feature enabled

Status in linux package in Ubuntu:
  New
Status in python-rtslib-fb package in Ubuntu:
  In Progress
Status in qemu package in Ubuntu:
  New

Bug description:
  
  targetcli-fb was recently included in MAIN and one of its features is the 
VHOST TCM:

  /vhost> create 
  b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...

  not enabled in Ubuntu kernels.

  QEMU virtio-scsi feature:

  https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview

  KERNEL option to be enabled:

  https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html

  KERNEL TCM documentation:

  https://www.kernel.org/doc/html/latest/target/tcmu-design.html

  LIO (LinuxIO) VHOST feature explained:

  http://linux-iscsi.org/wiki/VHost

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1891214/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1891214] [NEW] targetcli/LIO needs tcm_vhost feature enabled

2020-08-11 Thread Rafael David Tinoco
Public bug reported:


targetcli-fb was recently included in MAIN and one of its features is the VHOST 
TCM:

/vhost> create 
b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...

not enabled in Ubuntu kernels.

QEMU virtio-scsi feature:

https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview

KERNEL option to be enabled:

https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html

KERNEL TCM documentation:

https://www.kernel.org/doc/html/latest/target/tcmu-design.html

LIO (LinuxIO) VHOST feature explained:

http://linux-iscsi.org/wiki/VHost

** Affects: linux (Ubuntu)
 Importance: Undecided
 Status: New

** Affects: python-rtslib-fb (Ubuntu)
 Importance: Undecided
 Assignee: Rafael David Tinoco (rafaeldtinoco)
 Status: In Progress

** Affects: qemu (Ubuntu)
 Importance: Undecided
 Status: New

** Also affects: qemu (Ubuntu)
   Importance: Undecided
   Status: New

** Also affects: linux (Ubuntu)
   Importance: Undecided
   Status: New

** Changed in: targetcli-fb (Ubuntu)
   Status: New => In Progress

** Changed in: targetcli-fb (Ubuntu)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1891214

Title:
  targetcli/LIO needs tcm_vhost feature enabled

Status in linux package in Ubuntu:
  New
Status in python-rtslib-fb package in Ubuntu:
  In Progress
Status in qemu package in Ubuntu:
  New

Bug description:
  
  targetcli-fb was recently included in MAIN and one of its features is the 
VHOST TCM:

  /vhost> create 
  b'modprobe: FATAL: Module tcm_vhost not found in directory /lib/modules/...

  not enabled in Ubuntu kernels.

  QEMU virtio-scsi feature:

  https://wiki.qemu.org/Features/VirtioSCSI/TCM_Overview

  KERNEL option to be enabled:

  https://cateee.net/lkddb/web-lkddb/TCM_VHOST.html

  KERNEL TCM documentation:

  https://www.kernel.org/doc/html/latest/target/tcmu-design.html

  LIO (LinuxIO) VHOST feature explained:

  http://linux-iscsi.org/wiki/VHost

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1891214/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1729145] Re: /dev/bcache/by-uuid links not created after reboot

2020-07-22 Thread Rafael David Tinoco
Anyone interested in this bug, please take a look at:

https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1861941

Good summary of the issue:

https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1861941/comments/27
https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1861941/comments/47
https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1861941/comments/56
https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1861941/comments/62

And the fix made at bcache-tools for that bug (kernel patch made to fix
this bug will asked to be removed soon, as that fix solves this issue).

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1729145

Title:
  /dev/bcache/by-uuid links not created after reboot

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Xenial:
  Fix Released
Status in linux source package in Zesty:
  Won't Fix
Status in linux source package in Artful:
  Fix Released
Status in linux source package in Bionic:
  Fix Released

Bug description:
  1. $ lsb_release -rd
  Description:  Ubuntu 17.10
  Release:  17.10

  2. $ apt-cache policy linux-image-`uname -r`
  linux-image-4.13.0-16-generic:
    Installed: 4.13.0-16.19
    Candidate: 4.13.0-16.19
    Version table:
   *** 4.13.0-16.19 500
  500 http://nova.clouds.archive.ubuntu.com/ubuntu artful/main amd64 
Packages
  100 /var/lib/dpkg/status

  3. After creating some bcache devices and rebooting 
/dev/bcache/by-uuid/ -> ../../bcacheN
  symlinks point to the current bcache device which is caching the dev.uuid 
found after creating a backing device.

  4. /dev/bcache/by-uuid does not exist and there are not symlinks
  underneath

  It appears that since the initramfs loads the bcache module which
  probes and finds all of the cache devices and backing devices then
  once the rootfs is mounted and udev gets to run, the bcache kernel
  module does not emit the CACHED_UUID value into the environment if the
  underlying devices are already registered.

  In dmesg, one can see that prior to mounting the rootfs, we see bcache
  register events:

  [5.333973] bcache: register_bdev() registered backing device vdb2
  [5.354138] bcache: register_bdev() registered backing device vdb4
  [5.365665] bcache: register_bdev() registered backing device vdb3
  [5.397720] bcache: bch_journal_replay() journal replay done, 0 keys in 1 
entries, seq 1
  [5.428683] bcache: register_cache() registered cache device vdb1

  then rootfs ismounted and systemd starts systemd-udev

  [9.350889] systemd[1]: Listening on udev Kernel Socket.

  And then the coldplug replay of kernel events triggers 
/lib/udev/rules.d/69-bcache.rules
  which invokes /lib/udev/bcache-register which writes the device name 
(/dev/vdb1 or /dev/bcache0) into /sys/fs/bcache/register and results is the 
bcache kernel driver attempting to register the block device.  However, there 
is already a bcache device associated already and registration fails

  [   11.173141] bcache: register_bcache() error opening /dev/vdb2: device 
already registered
  [   11.184617] bcache: register_bcache() error opening /dev/vdb3: device 
already registered
  [   11.199130] bcache: register_bcache() error opening /dev/vdb1: device 
already registered
  [   11.271694] bcache: register_bcache() error opening /dev/vdb4: device 
already registered

  The problem then is that only a kernel call to bch_cached_dev_run()
  which happens like this:

  bcache_register()
    register_bdev()
  bch_cached_dev_run()
    kobject_uevent_env(_to_dev(d->disk)->kobj, KOBJ_CHANGE, env);

  where env includes:
  "DRIVER=bcache",
  kasprintf(GFP_KERNEL, "CACHED_UUID=%pU", dc->sb.uuid),
  NULL,
  NULL,
  };

  Since that event is not emitted for any previously registered device,
  then the symlink will not be created.

  ProblemType: Bug
  DistroRelease: Ubuntu 17.10
  Package: linux-image-4.13.0-16-generic 4.13.0-16.19
  ProcVersionSignature: User Name 4.13.0-16.19-generic 4.13.4
  Uname: Linux 4.13.0-16-generic x86_64
  AlsaDevices:
   total 0
   crw-rw 1 root audio 116,  1 Oct 31 22:09 seq
   crw-rw 1 root audio 116, 33 Oct 31 22:09 timer
  AplayDevices: Error: [Errno 2] No such file or directory: 'aplay': 'aplay'
  ApportVersion: 2.20.7-0ubuntu3.1
  Architecture: amd64
  ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord': 
'arecord'
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', 
'/dev/snd/timer'] failed with exit code 1:
  CRDA: N/A
  Date: Wed Nov  1 01:39:01 2017
  Ec2AMI: ami-030b
  Ec2AMIManifest: FIXME
  Ec2AvailabilityZone: nova
  Ec2InstanceType: m1.small
  Ec2Kernel: unavailable
  Ec2Ramdisk: unavailable
  IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig': 'iwconfig'
  Lsusb:
   Bus 001 Device 002: ID 0627:0001 Adomax Technology Co., Ltd
   Bus 

[Kernel-packages] [Bug 1886364] Re: initiator causes kernel crash when login lun/disk on Focal

2020-07-07 Thread Rafael David Tinoco
Its in kernel team's hands from my POV.

Thanks for reporting this!

** Tags removed: server-next

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1886364

Title:
  initiator causes kernel crash when login lun/disk on Focal

Status in ceph-iscsi package in Ubuntu:
  Invalid
Status in linux package in Ubuntu:
  Confirmed
Status in linux source package in Eoan:
  Triaged
Status in linux source package in Focal:
  Confirmed

Bug description:
  Software version
  linaro@j13-r120-t32-09:~$ lsb_release -a
  No LSB modules are available.
  Distributor ID: Ubuntu
  Description:Ubuntu 20.04 LTS
  Release:20.04
  Codename:   focal
  linaro@j13-r120-t32-09:~$ uname -a
  Linux j13-r120-t32-09 5.4.0-37-generic #41-Ubuntu SMP Wed Jun 3 17:57:16 UTC 
2020 aarch64 aarch64 aarch64 GNU/Linux
  linaro@j13-r120-t32-09:~$
  stack@j13-r120-t32-09:~/devstack-plugin-ceph$ apt search ceph-iscsi
  Sorting... Done
  Full Text Search... Done
  ceph-iscsi/focal,now 3.4-0ubuntu2 all [installed]
    common logic and CLI tools for creating and managing LIO gateways for Ceph

  stack@j13-r120-t32-09:~/devstack-plugin-ceph$ apt search tcmu-runner
  Sorting... Done
  Full Text Search... Done
  libtcmu2/focal,now 1.5.2-5build1 arm64 [installed,automatic]
    Library that handles the userspace side of the LIO TCM-User backstore

  tcmu-runner/focal,now 1.5.2-5build1 arm64 [installed]
    Daemon that handles the userspace side of the LIO TCM-User backstore

  Hardware
  cavium thx1

  root@j13-r120-t32-09:/home/linaro# lshw -c cpu
    *-cpu
     description: CPU
     product: ARM (CN88xx)
     vendor: CN8890-2000BG2601-CP-Y-G
     physical id: 2e
     bus info: cpu@0
     version: 2.1
     serial: CPU Serial#
     slot: Socket
     size: 2GHz
     capacity: 2GHz
     clock: 156MHz
     capabilities: lm
     configuration: cores=48 enabledcores=48
  root@j13-r120-t32-09:/home/linaro# lshw -c system
  j13-r120-t32-09
  description: System
  product: R120-T32-00 (01234567890123456789AB)
  vendor: GIGABYTE
  version: 0100
  serial: GHG2N2912A0009
  width: 64 bits
  capabilities: smbios-3.0.0 dmi-3.0.0 smp cp15_barrier setend swp 
tagged_addr_disabled
  configuration: chassis=server family=Server sku=01234567890123456789AB 
uuid=--4000-8000-1C1B0D94A9DE

  Reproduce
  Setup ceph iscsi gate way and initiator in the same ubuntu focal all-in-one.
  iSCSI targets setup
  1, $ apt install ceph-iscsi targetcli-fb
  2, ceph iscsi config
  stack@j13-r120-t32-09:~/devstack-plugin-ceph$ sudo cat 
/etc/ceph/iscsi-gateway.cfg

  [config]
  api_port = 5002
  api_password = openstack
  api_user = openstack
  api_secure = false
  prometheus_host = 10.101.96.110
  gateway_keyring = ceph.client.admin.keyring
  cluster_name = ceph
  trusted_ip_list = 10.101.96.110,localhost
  minimum_gateways = 1
  pool = volumes

  3, target iqn, client iqn, disk/lun creation
  https://docs.ceph.com/docs/master//rbd/iscsi-target-cli/

  iSCSI initiator setup
  1, $ apt install open-iscsi
  https://www.server-world.info/en/note?os=Ubuntu_18.04=iscsi=3
  2,
  $ iscsiadm -m discovery -t sendtargets -p 10.101.96.110
  $ sudo iscsiadm -m node -T iqn.1993-08.org.opendev:01:a9aa4032d2c1 -l
  Login lun cause crash ceph iscsi gw node

  [  122.112611] xfs filesystem being mounted at /var/lib/ceph supports 
timestamps until 2038 (0x7fff)
  linaro@j13-r120-t32-09:~$ [ 1512.796815] Unable to handle kernel read from 
unreadable memory at virtual address 01dc0040
  [ 1512.805865] Mem abort info:
  [ 1512.808647]   ESR = 0x9604
  [ 1512.811702]   EC = 0x25: DABT (current EL), IL = 32 bits
  [ 1512.817023]   SET = 0, FnV = 0
  [ 1512.820089]   EA = 0, S1PTW = 0
  [ 1512.823238] Data abort info:
  [ 1512.826128]   ISV = 0, ISS = 0x0004
  [ 1512.829972]   CM = 0, WnR = 0
  [ 1512.832933] user pgtable: 4k pages, 48-bit VAs, pgdp=000cd14a
  [ 1512.839410] [01dc0040] pgd=
  [ 1512.844300] Internal error: Oops: 9604 [#1] SMP
  [ 1512.849169] Modules linked in: target_core_pscsi target_core_file 
target_core_iblock iscsi_target_mod xfs xt_REDIRECT xt_comment xt_nat xt_mark 
xt_connmark ip6table_raw iptable_raw xt_CHECKSUM xt_MASQUERADE xt_conntrack 
ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle 
iptable_nat nf_tables ip6table_filter ip6_tables iptable_filter bpfilter bridge 
stp llc target_core_user uio target_core_mod nf_conntrack_netlink binfmt_misc 
nls_iso8859_1 nfnetlink_cttimeout nfnetlink ipmi_ssif ipmi_devintf 
cavium_rng_vf joydev input_leds ipmi_msghandler cavium_rng thunderx_edac 
openvswitch nsh nf_conncount nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 
libcrc32c sch_fq_codel ip_tables x_tables autofs4 crct10dif_ce ghash_ce nicvf 
ast cavium_ptp i2c_algo_bit drm_vram_helper sha2_ce 

[Kernel-packages] [Bug 1886364] Re: initiator causes kernel crash when login lun/disk on Focal

2020-07-06 Thread Rafael David Tinoco
** Changed in: ceph-iscsi (Ubuntu)
   Status: New => Invalid

** Changed in: linux (Ubuntu)
   Status: Incomplete => Confirmed

** Also affects: linux (Ubuntu Eoan)
   Importance: Undecided
   Status: New

** Also affects: ceph-iscsi (Ubuntu Eoan)
   Importance: Undecided
   Status: New

** Also affects: linux (Ubuntu Focal)
   Importance: Undecided
   Status: New

** Also affects: ceph-iscsi (Ubuntu Focal)
   Importance: Undecided
   Status: New

** No longer affects: ceph-iscsi (Ubuntu Eoan)

** No longer affects: ceph-iscsi (Ubuntu Focal)

** Changed in: linux (Ubuntu Focal)
   Status: New => Confirmed

** Changed in: linux (Ubuntu Eoan)
   Status: New => Triaged

** Tags added: server-next

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1886364

Title:
  initiator causes kernel crash when login lun/disk on Focal

Status in ceph-iscsi package in Ubuntu:
  Invalid
Status in linux package in Ubuntu:
  Confirmed
Status in linux source package in Eoan:
  Triaged
Status in linux source package in Focal:
  Confirmed

Bug description:
  Software version
  linaro@j13-r120-t32-09:~$ lsb_release -a
  No LSB modules are available.
  Distributor ID: Ubuntu
  Description:Ubuntu 20.04 LTS
  Release:20.04
  Codename:   focal
  linaro@j13-r120-t32-09:~$ uname -a
  Linux j13-r120-t32-09 5.4.0-37-generic #41-Ubuntu SMP Wed Jun 3 17:57:16 UTC 
2020 aarch64 aarch64 aarch64 GNU/Linux
  linaro@j13-r120-t32-09:~$
  stack@j13-r120-t32-09:~/devstack-plugin-ceph$ apt search ceph-iscsi
  Sorting... Done
  Full Text Search... Done
  ceph-iscsi/focal,now 3.4-0ubuntu2 all [installed]
    common logic and CLI tools for creating and managing LIO gateways for Ceph

  stack@j13-r120-t32-09:~/devstack-plugin-ceph$ apt search tcmu-runner
  Sorting... Done
  Full Text Search... Done
  libtcmu2/focal,now 1.5.2-5build1 arm64 [installed,automatic]
    Library that handles the userspace side of the LIO TCM-User backstore

  tcmu-runner/focal,now 1.5.2-5build1 arm64 [installed]
    Daemon that handles the userspace side of the LIO TCM-User backstore

  Hardware
  cavium thx1

  root@j13-r120-t32-09:/home/linaro# lshw -c cpu
    *-cpu
     description: CPU
     product: ARM (CN88xx)
     vendor: CN8890-2000BG2601-CP-Y-G
     physical id: 2e
     bus info: cpu@0
     version: 2.1
     serial: CPU Serial#
     slot: Socket
     size: 2GHz
     capacity: 2GHz
     clock: 156MHz
     capabilities: lm
     configuration: cores=48 enabledcores=48
  root@j13-r120-t32-09:/home/linaro# lshw -c system
  j13-r120-t32-09
  description: System
  product: R120-T32-00 (01234567890123456789AB)
  vendor: GIGABYTE
  version: 0100
  serial: GHG2N2912A0009
  width: 64 bits
  capabilities: smbios-3.0.0 dmi-3.0.0 smp cp15_barrier setend swp 
tagged_addr_disabled
  configuration: chassis=server family=Server sku=01234567890123456789AB 
uuid=--4000-8000-1C1B0D94A9DE

  Reproduce
  Setup ceph iscsi gate way and initiator in the same ubuntu focal all-in-one.
  iSCSI targets setup
  1, $ apt install ceph-iscsi targetcli-fb
  2, ceph iscsi config
  stack@j13-r120-t32-09:~/devstack-plugin-ceph$ sudo cat 
/etc/ceph/iscsi-gateway.cfg

  [config]
  api_port = 5002
  api_password = openstack
  api_user = openstack
  api_secure = false
  prometheus_host = 10.101.96.110
  gateway_keyring = ceph.client.admin.keyring
  cluster_name = ceph
  trusted_ip_list = 10.101.96.110,localhost
  minimum_gateways = 1
  pool = volumes

  3, target iqn, client iqn, disk/lun creation
  https://docs.ceph.com/docs/master//rbd/iscsi-target-cli/

  iSCSI initiator setup
  1, $ apt install open-iscsi
  https://www.server-world.info/en/note?os=Ubuntu_18.04=iscsi=3
  2,
  $ iscsiadm -m discovery -t sendtargets -p 10.101.96.110
  $ sudo iscsiadm -m node -T iqn.1993-08.org.opendev:01:a9aa4032d2c1 -l
  Login lun cause crash ceph iscsi gw node

  [  122.112611] xfs filesystem being mounted at /var/lib/ceph supports 
timestamps until 2038 (0x7fff)
  linaro@j13-r120-t32-09:~$ [ 1512.796815] Unable to handle kernel read from 
unreadable memory at virtual address 01dc0040
  [ 1512.805865] Mem abort info:
  [ 1512.808647]   ESR = 0x9604
  [ 1512.811702]   EC = 0x25: DABT (current EL), IL = 32 bits
  [ 1512.817023]   SET = 0, FnV = 0
  [ 1512.820089]   EA = 0, S1PTW = 0
  [ 1512.823238] Data abort info:
  [ 1512.826128]   ISV = 0, ISS = 0x0004
  [ 1512.829972]   CM = 0, WnR = 0
  [ 1512.832933] user pgtable: 4k pages, 48-bit VAs, pgdp=000cd14a
  [ 1512.839410] [01dc0040] pgd=
  [ 1512.844300] Internal error: Oops: 9604 [#1] SMP
  [ 1512.849169] Modules linked in: target_core_pscsi target_core_file 
target_core_iblock iscsi_target_mod xfs xt_REDIRECT xt_comment xt_nat xt_mark 
xt_connmark ip6table_raw 

[Kernel-packages] [Bug 1872021] Re: commissioning fails due to hung tasks setting up ipmitool

2020-04-22 Thread Rafael David Tinoco
Summary...

For Ubuntu Bionic, dpkg triggers for systemd (237-3ubuntu10.39) might
have caused systemd to hang:

[  363.776878]  wait_for_completion+0xba/0x140
[  363.776890]  __flush_work+0x15b/0x210
[  363.776901]  flush_delayed_work+0x41/0x50
[  363.776908]  fsnotify_wait_marks_destroyed+0x15/0x20
[  363.776912]  fsnotify_destroy_group+0x48/0xd0
[  363.776917]  inotify_release+0x1e/0x50
[  363.776923]  __fput+0xea/0x220
[  363.776929]  fput+0xe/0x10
[  363.776935]  task_work_run+0x9d/0xc0
[  363.776942]  exit_to_usermode_loop+0xc0/0xd0
[  363.776947]  do_syscall_64+0x121/0x130
[  363.776954]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2

and

[  364.050206]  wait_for_completion+0xba/0x140
[  364.050238]  __synchronize_srcu.part.13+0x85/0xb0
[  364.050248]  synchronize_srcu+0x66/0xe0
[  364.050256]  fsnotify_mark_destroy_workfn+0x7b/0xe0
[  364.050262]  process_one_work+0x1de/0x420
[  364.050267]  worker_thread+0x228/0x410
[  364.050272]  kthread+0x121/0x140

and

[  364.326985]  wait_for_completion+0xba/0x140
[  364.326988]  __synchronize_srcu.part.13+0x85/0xb0
[  364.326993]  synchronize_srcu+0x66/0xe0
[  364.326995]  ? synchronize_srcu+0x66/0xe0
[  364.326996]  fsnotify_connector_destroy_workfn+0x4a/0x80
[  364.326998]  process_one_work+0x1de/0x420
[  364.326999]  worker_thread+0x253/0x410
[  364.327001]  kthread+0x121/0x140

All stack traces seem to come from "fsnotify" subsystem and waiting on
delayed work (completion) for fsnotify marks destruction after a
inotify_release() was called. Completion did not happen for the past 2
minutes. Without a kernel dump it is hard to tell if completion was
still ok - due to kthread being overloaded doing scheduled work and/or
the marks group destruction - or there was a dead lock for the
completion due to a kernel bug.

If this is reproducible, I think that having a kernel dump would help
identifying the issue. I'm letting the kernel team to handle this and
marking all other issues as dealt per previous comments.


** No longer affects: ipmitool (Ubuntu)

** Changed in: maas
   Status: New => Invalid

** Summary changed:

- commissioning fails due to hung tasks setting up ipmitool
+ [Ubuntu][Bionic] systemd caused kernel to hang on fsnotify wait-on-completion

** Also affects: linux (Ubuntu)
   Importance: Undecided
   Status: New

** No longer affects: linux (Ubuntu)

** Project changed: linux => linux (Ubuntu)

** Also affects: linux (Ubuntu Bionic)
   Importance: Undecided
   Status: New

** Also affects: linux (Ubuntu Focal)
   Importance: Undecided
   Status: New

** Also affects: linux (Ubuntu Eoan)
   Importance: Undecided
   Status: New

** Changed in: linux (Ubuntu Bionic)
   Status: New => Triaged

** Changed in: linux (Ubuntu Bionic)
   Importance: Undecided => Medium

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1872021

Title:
  [Ubuntu][Bionic] systemd caused kernel to hang on fsnotify wait-on-
  completion

Status in MAAS:
  Invalid
Status in linux package in Ubuntu:
  Incomplete
Status in linux source package in Bionic:
  Triaged
Status in linux source package in Eoan:
  Incomplete
Status in linux source package in Focal:
  Incomplete

Bug description:
  This is with MAAS 2.7.0, commissioning an HP DL385 G7 with Bionic.
  During the first boot, the machine performs an apt-get upgrade, which 
includes an update of ipmitool (1.8.18-5ubuntu0.1) and freeipmi-tools 
(1.4.11-1.1ubuntu4.1).
  This triggers hung tasks:
  [   66.457048] cloud-init[1534]: Setting up ipmitool (1.8.18-5ubuntu0.1) ... 
   Starting IPMI event daemon...
  
  [  OK  ] Started IPMI event daemon.   
  
  [   67.240857] cloud-init[1534]: Setting up freeipmi-tools 
(1.4.11-1.1ubuntu4.1) ...
  [   67.254241] cloud-init[1534]: Processing triggers for systemd 
(237-3ubuntu10.39) ...
  [  242.642684] INFO: task systemd:1 blocked for more than 120 seconds.
  [  242.725654]   Not tainted 4.15.0-96-generic #97-Ubuntu 
  
  [  242.799835] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables 
this message.
  [  242.906319] INFO: task kworker/u49:0:6 blocked for more than 120 seconds.  
  
  [  242.997214]   Not tainted 4.15.0-96-generic #97-Ubuntu 
  
  [  243.072024] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables 
this message.
  [  247.381896] cloud-init[1534]: Failed to reload daemon: Connection timed 
out  
  [  247.385109] cloud-init[1534]: Processing triggers for man-db 
(2.8.3-2ubuntu0.1) ...
  [  249.828279] cloud-init[1534]: Processing triggers for ureadahead 

[Kernel-packages] [Bug 1866012] Re: depmod ERROR during Setting up linux-modules-5.4.0-17-generic

2020-03-11 Thread Rafael David Tinoco
*** This bug is a duplicate of bug 1864992 ***
https://bugs.launchpad.net/bugs/1864992

Im marking this bug as a duplicate of:

https://bugs.launchpad.net/ubuntu/+source/kmod/+bug/1864992

** This bug has been marked a duplicate of bug 1864992
   depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1866012

Title:
  depmod ERROR during Setting up linux-modules-5.4.0-17-generic

Status in kmod package in Ubuntu:
  New
Status in linux package in Ubuntu:
  Invalid

Bug description:
  Steps to reproduce:
  1. Deploy Focal on a KVM ndoe, enable proposed
  2. Run sudo apt dist-upgrade

  The console will be flushed with:
  Setting up libisc1105:amd64 (1:9.11.16+dfsg-3~build1) ...
  Setting up linux-modules-5.4.0-17-generic (5.4.0-17.21) ...
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  
  Setting up apt-utils (1.9.12) ...
  Setting up libselinux1-dev:amd64 (3.0-1build2) ...
  Setting up libglib2.0-0:amd64 (2.64.0-1) ...

  ProblemType: Bug
  DistroRelease: Ubuntu 20.04
  Package: linux-image-5.4.0-14-generic 5.4.0-14.17
  ProcVersionSignature: User Name 5.4.0-14.17-generic 5.4.18
  Uname: Linux 5.4.0-14-generic x86_64
  AlsaDevices:
   total 0
   crw-rw 1 root audio 116,  1 Mar  4 08:29 seq
   crw-rw 1 root audio 116, 33 Mar  4 08:29 timer
  AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
  ApportVersion: 2.20.11-0ubuntu18
  Architecture: amd64
  ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', 
'/dev/snd/timer'] failed with exit code 1:
  Date: Wed Mar  4 09:06:42 2020
  IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
  Lsusb: Bus 001 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
  Lsusb-t: /:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
  MachineType: QEMU Standard PC (i440FX + PIIX, 1996)
  PciMultimedia:
   
  ProcFB: 0 cirrusdrmfb
  ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-5.4.0-14-generic 
root=UUID=36e162f3-41b5-4487-a6dc-09ba4e37d3bf ro console=tty1 console=ttyS0
  RelatedPackageVersions:
   linux-restricted-modules-5.4.0-14-generic N/A
   linux-backports-modules-5.4.0-14-generic  N/A
   linux-firmware1.186
  RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
  SourcePackage: linux-5.4
  StagingDrivers: exfat
  UpgradeStatus: No upgrade log present (probably fresh install)
  dmi.bios.date: 04/01/2014
  dmi.bios.vendor: SeaBIOS
  dmi.bios.version: 1.10.2-1ubuntu1
  dmi.chassis.type: 1
  dmi.chassis.vendor: QEMU
  dmi.chassis.version: pc-i440fx-bionic
  dmi.modalias: 
dmi:bvnSeaBIOS:bvr1.10.2-1ubuntu1:bd04/01/2014:svnQEMU:pnStandardPC(i440FX+PIIX,1996):pvrpc-i440fx-bionic:cvnQEMU:ct1:cvrpc-i440fx-bionic:
  dmi.product.name: Standard PC (i440FX + PIIX, 1996)
  dmi.product.version: pc-i440fx-bionic
  dmi.sys.vendor: QEMU

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/kmod/+bug/1866012/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1866012] Re: depmod ERROR during Setting up linux-modules-5.4.0-17-generic

2020-03-11 Thread Rafael David Tinoco
*** This bug is a duplicate of bug 1864992 ***
https://bugs.launchpad.net/bugs/1864992

https://bugs.launchpad.net/curtin/+bug/1864992/comments/34
https://bugs.launchpad.net/curtin/+bug/1864992/comments/35
https://bugs.launchpad.net/curtin/+bug/1864992/comments/36

Issue is in verbosity level of kmod.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1866012

Title:
  depmod ERROR during Setting up linux-modules-5.4.0-17-generic

Status in kmod package in Ubuntu:
  New
Status in linux package in Ubuntu:
  Invalid

Bug description:
  Steps to reproduce:
  1. Deploy Focal on a KVM ndoe, enable proposed
  2. Run sudo apt dist-upgrade

  The console will be flushed with:
  Setting up libisc1105:amd64 (1:9.11.16+dfsg-3~build1) ...
  Setting up linux-modules-5.4.0-17-generic (5.4.0-17.21) ...
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  
  Setting up apt-utils (1.9.12) ...
  Setting up libselinux1-dev:amd64 (3.0-1build2) ...
  Setting up libglib2.0-0:amd64 (2.64.0-1) ...

  ProblemType: Bug
  DistroRelease: Ubuntu 20.04
  Package: linux-image-5.4.0-14-generic 5.4.0-14.17
  ProcVersionSignature: User Name 5.4.0-14.17-generic 5.4.18
  Uname: Linux 5.4.0-14-generic x86_64
  AlsaDevices:
   total 0
   crw-rw 1 root audio 116,  1 Mar  4 08:29 seq
   crw-rw 1 root audio 116, 33 Mar  4 08:29 timer
  AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
  ApportVersion: 2.20.11-0ubuntu18
  Architecture: amd64
  ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', 
'/dev/snd/timer'] failed with exit code 1:
  Date: Wed Mar  4 09:06:42 2020
  IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
  Lsusb: Bus 001 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
  Lsusb-t: /:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
  MachineType: QEMU Standard PC (i440FX + PIIX, 1996)
  PciMultimedia:
   
  ProcFB: 0 cirrusdrmfb
  ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-5.4.0-14-generic 
root=UUID=36e162f3-41b5-4487-a6dc-09ba4e37d3bf ro console=tty1 console=ttyS0
  RelatedPackageVersions:
   linux-restricted-modules-5.4.0-14-generic N/A
   linux-backports-modules-5.4.0-14-generic  N/A
   linux-firmware1.186
  RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
  SourcePackage: linux-5.4
  StagingDrivers: exfat
  UpgradeStatus: No upgrade log present (probably fresh install)
  dmi.bios.date: 04/01/2014
  dmi.bios.vendor: SeaBIOS
  dmi.bios.version: 1.10.2-1ubuntu1
  dmi.chassis.type: 1
  dmi.chassis.vendor: QEMU
  dmi.chassis.version: pc-i440fx-bionic
  dmi.modalias: 
dmi:bvnSeaBIOS:bvr1.10.2-1ubuntu1:bd04/01/2014:svnQEMU:pnStandardPC(i440FX+PIIX,1996):pvrpc-i440fx-bionic:cvnQEMU:ct1:cvrpc-i440fx-bionic:
  dmi.product.name: Standard PC (i440FX + PIIX, 1996)
  dmi.product.version: pc-i440fx-bionic
  dmi.sys.vendor: QEMU

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/kmod/+bug/1866012/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1866012] Re: depmod ERROR during Setting up linux-modules-5.4.0-17-generic

2020-03-11 Thread Rafael David Tinoco
Related bugs:

https://bugs.launchpad.net/ubuntu/+source/initramfs-tools/+bug/1863261
https://bugs.launchpad.net/ubuntu/+source/kmod/+bug/1866012
https://bugs.launchpad.net/ubuntu/+source/kmod/+bug/1864992

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1866012

Title:
  depmod ERROR during Setting up linux-modules-5.4.0-17-generic

Status in kmod package in Ubuntu:
  New
Status in linux package in Ubuntu:
  Invalid

Bug description:
  Steps to reproduce:
  1. Deploy Focal on a KVM ndoe, enable proposed
  2. Run sudo apt dist-upgrade

  The console will be flushed with:
  Setting up libisc1105:amd64 (1:9.11.16+dfsg-3~build1) ...
  Setting up linux-modules-5.4.0-17-generic (5.4.0-17.21) ...
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open 
builtin file '/lib/modules/5.4.0-17-generic/modules.builtin.bin'
  
  Setting up apt-utils (1.9.12) ...
  Setting up libselinux1-dev:amd64 (3.0-1build2) ...
  Setting up libglib2.0-0:amd64 (2.64.0-1) ...

  ProblemType: Bug
  DistroRelease: Ubuntu 20.04
  Package: linux-image-5.4.0-14-generic 5.4.0-14.17
  ProcVersionSignature: User Name 5.4.0-14.17-generic 5.4.18
  Uname: Linux 5.4.0-14-generic x86_64
  AlsaDevices:
   total 0
   crw-rw 1 root audio 116,  1 Mar  4 08:29 seq
   crw-rw 1 root audio 116, 33 Mar  4 08:29 timer
  AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
  ApportVersion: 2.20.11-0ubuntu18
  Architecture: amd64
  ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', 
'/dev/snd/timer'] failed with exit code 1:
  Date: Wed Mar  4 09:06:42 2020
  IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
  Lsusb: Bus 001 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
  Lsusb-t: /:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
  MachineType: QEMU Standard PC (i440FX + PIIX, 1996)
  PciMultimedia:
   
  ProcFB: 0 cirrusdrmfb
  ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-5.4.0-14-generic 
root=UUID=36e162f3-41b5-4487-a6dc-09ba4e37d3bf ro console=tty1 console=ttyS0
  RelatedPackageVersions:
   linux-restricted-modules-5.4.0-14-generic N/A
   linux-backports-modules-5.4.0-14-generic  N/A
   linux-firmware1.186
  RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
  SourcePackage: linux-5.4
  StagingDrivers: exfat
  UpgradeStatus: No upgrade log present (probably fresh install)
  dmi.bios.date: 04/01/2014
  dmi.bios.vendor: SeaBIOS
  dmi.bios.version: 1.10.2-1ubuntu1
  dmi.chassis.type: 1
  dmi.chassis.vendor: QEMU
  dmi.chassis.version: pc-i440fx-bionic
  dmi.modalias: 
dmi:bvnSeaBIOS:bvr1.10.2-1ubuntu1:bd04/01/2014:svnQEMU:pnStandardPC(i440FX+PIIX,1996):pvrpc-i440fx-bionic:cvnQEMU:ct1:cvrpc-i440fx-bionic:
  dmi.product.name: Standard PC (i440FX + PIIX, 1996)
  dmi.product.version: pc-i440fx-bionic
  dmi.sys.vendor: QEMU

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/kmod/+bug/1866012/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1864992] Re: depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open builtin file '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

2020-03-10 Thread Rafael David Tinoco
Alright, sorry for the delay, I'm revisiting this now...

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1864992

Title:
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could
  not open builtin file
  '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

Status in curtin:
  Invalid
Status in subiquity:
  New
Status in kmod package in Ubuntu:
  Confirmed
Status in linux package in Ubuntu:
  Confirmed

Bug description:
  During a Focal install from the ISO image several errors like:

  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could
  not open builtin file
  '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

  are logged in curtin's install logs. The installed system boots and
  works fine, but the error is clearly something we want to get rid of.

  At first glance this seems related to:

  https://bugs.launchpad.net/ubuntu/+source/initramfs-tools/+bug/1863261

  but the version of initramfs-tools in both the installer and installed
  system (checked with `chroot /target dpkg -l initramfs-tools` during
  the installation) is 0.136ubuntu1, which should contain Rafael's fix
  for that bug. I wonder if the update-initramfs diversion has a role
  here.

  I verified this happens at least on amd64 and arm64. I'm attaching the full 
install logs for a amd64 installation.
  --- 
  ProblemType: Bug
  AlsaVersion: Advanced Linux Sound Architecture Driver Version 
k5.4.0-14-generic.
  AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
  ApportVersion: 2.20.11-0ubuntu18
  Architecture: amd64
  ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/by-path', 
'/dev/snd/controlC0', '/dev/snd/hwC0D0', '/dev/snd/pcmC0D0c', 
'/dev/snd/pcmC0D0p', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
  CRDA: N/A
  Card0.Amixer.info: Error: [Errno 2] No such file or directory: 'amixer'
  Card0.Amixer.values: Error: [Errno 2] No such file or directory: 'amixer'
  CasperVersion: 1.439
  DistroRelease: Ubuntu 20.04
  IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
  LiveMediaBuild: Ubuntu-Server 20.04 LTS "Focal Fossa" - Alpha amd64 (20200225)
  Lsusb:
   Bus 001 Device 002: ID 0627:0001 Adomax Technology Co., Ltd QEMU USB Tablet
   Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
   Bus 004 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
   Bus 003 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
   Bus 002 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
  Lsusb-t:
   /:  Bus 04.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 03.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 02.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=ehci-pci/6p, 480M
   |__ Port 1: Dev 2, If 0, Class=Human Interface Device, Driver=usbhid, 
480M
  MachineType: QEMU Standard PC (Q35 + ICH9, 2009)
  NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
  Package: linux (not installed)
  ProcEnviron:
   TERM=linux
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=
   LANG=C.UTF-8
  ProcFB: 0 qxldrmfb
  ProcKernelCmdLine: initrd=/casper/initrd quiet  --- maybe-ubiquity
  ProcVersionSignature: Ubuntu 5.4.0-14.17-generic 5.4.18
  RelatedPackageVersions:
   linux-restricted-modules-5.4.0-14-generic N/A
   linux-backports-modules-5.4.0-14-generic  N/A
   linux-firmware1.186
  RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
  Tags:  focal uec-images
  Uname: Linux 5.4.0-14-generic x86_64
  UpgradeStatus: No upgrade log present (probably fresh install)
  UserGroups:
   
  _MarkForUpload: True
  dmi.bios.date: 04/01/2014
  dmi.bios.vendor: SeaBIOS
  dmi.bios.version: 1.13.0-1
  dmi.chassis.type: 1
  dmi.chassis.vendor: QEMU
  dmi.chassis.version: pc-q35-4.2
  dmi.modalias: 
dmi:bvnSeaBIOS:bvr1.13.0-1:bd04/01/2014:svnQEMU:pnStandardPC(Q35+ICH9,2009):pvrpc-q35-4.2:cvnQEMU:ct1:cvrpc-q35-4.2:
  dmi.product.name: Standard PC (Q35 + ICH9, 2009)
  dmi.product.version: pc-q35-4.2
  dmi.sys.vendor: QEMU

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1864992/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1864992] Re: depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open builtin file '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

2020-03-03 Thread Rafael David Tinoco
At that time .. kmod was 26+20191223-1ubuntu1, now kmod is
27-1ubuntu1... Will check if something happened in that upgrade that
made the mkinitramfs change buggy OR its something that was never
covered.

** Changed in: kmod (Ubuntu)
   Importance: Undecided => Medium

** Changed in: linux (Ubuntu)
   Importance: Undecided => Low

** Changed in: kmod (Ubuntu)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

** Changed in: linux (Ubuntu)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1864992

Title:
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could
  not open builtin file
  '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

Status in curtin:
  Invalid
Status in subiquity:
  New
Status in kmod package in Ubuntu:
  Confirmed
Status in linux package in Ubuntu:
  Confirmed

Bug description:
  During a Focal install from the ISO image several errors like:

  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could
  not open builtin file
  '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

  are logged in curtin's install logs. The installed system boots and
  works fine, but the error is clearly something we want to get rid of.

  At first glance this seems related to:

  https://bugs.launchpad.net/ubuntu/+source/initramfs-tools/+bug/1863261

  but the version of initramfs-tools in both the installer and installed
  system (checked with `chroot /target dpkg -l initramfs-tools` during
  the installation) is 0.136ubuntu1, which should contain Rafael's fix
  for that bug. I wonder if the update-initramfs diversion has a role
  here.

  I verified this happens at least on amd64 and arm64. I'm attaching the full 
install logs for a amd64 installation.
  --- 
  ProblemType: Bug
  AlsaVersion: Advanced Linux Sound Architecture Driver Version 
k5.4.0-14-generic.
  AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
  ApportVersion: 2.20.11-0ubuntu18
  Architecture: amd64
  ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/by-path', 
'/dev/snd/controlC0', '/dev/snd/hwC0D0', '/dev/snd/pcmC0D0c', 
'/dev/snd/pcmC0D0p', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
  CRDA: N/A
  Card0.Amixer.info: Error: [Errno 2] No such file or directory: 'amixer'
  Card0.Amixer.values: Error: [Errno 2] No such file or directory: 'amixer'
  CasperVersion: 1.439
  DistroRelease: Ubuntu 20.04
  IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
  LiveMediaBuild: Ubuntu-Server 20.04 LTS "Focal Fossa" - Alpha amd64 (20200225)
  Lsusb:
   Bus 001 Device 002: ID 0627:0001 Adomax Technology Co., Ltd QEMU USB Tablet
   Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
   Bus 004 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
   Bus 003 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
   Bus 002 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
  Lsusb-t:
   /:  Bus 04.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 03.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 02.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=ehci-pci/6p, 480M
   |__ Port 1: Dev 2, If 0, Class=Human Interface Device, Driver=usbhid, 
480M
  MachineType: QEMU Standard PC (Q35 + ICH9, 2009)
  NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
  Package: linux (not installed)
  ProcEnviron:
   TERM=linux
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=
   LANG=C.UTF-8
  ProcFB: 0 qxldrmfb
  ProcKernelCmdLine: initrd=/casper/initrd quiet  --- maybe-ubiquity
  ProcVersionSignature: Ubuntu 5.4.0-14.17-generic 5.4.18
  RelatedPackageVersions:
   linux-restricted-modules-5.4.0-14-generic N/A
   linux-backports-modules-5.4.0-14-generic  N/A
   linux-firmware1.186
  RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
  Tags:  focal uec-images
  Uname: Linux 5.4.0-14-generic x86_64
  UpgradeStatus: No upgrade log present (probably fresh install)
  UserGroups:
   
  _MarkForUpload: True
  dmi.bios.date: 04/01/2014
  dmi.bios.vendor: SeaBIOS
  dmi.bios.version: 1.13.0-1
  dmi.chassis.type: 1
  dmi.chassis.vendor: QEMU
  dmi.chassis.version: pc-q35-4.2
  dmi.modalias: 
dmi:bvnSeaBIOS:bvr1.13.0-1:bd04/01/2014:svnQEMU:pnStandardPC(Q35+ICH9,2009):pvrpc-q35-4.2:cvnQEMU:ct1:cvrpc-q35-4.2:
  dmi.product.name: Standard PC (Q35 + ICH9, 2009)
  dmi.product.version: pc-q35-4.2
  dmi.sys.vendor: QEMU

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1864992/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~ker

[Kernel-packages] [Bug 1864992] Re: depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open builtin file '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

2020-03-03 Thread Rafael David Tinoco
@dsmythies, @kaihengfeng

you seem to be correct.

First time I saw that issue was in a kmod regression test iirc.

The fix was supposed to be in:

initramfs-tools (0.133ubuntu15) focal; urgency=medium

from:

https://bugs.launchpad.net/ubuntu/+source/initramfs-tools/+bug/1863261

but I see now that might not cover all cases.

I'll revisit this today.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1864992

Title:
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could
  not open builtin file
  '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

Status in curtin:
  Invalid
Status in subiquity:
  New
Status in kmod package in Ubuntu:
  Confirmed
Status in linux package in Ubuntu:
  Confirmed

Bug description:
  During a Focal install from the ISO image several errors like:

  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could
  not open builtin file
  '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

  are logged in curtin's install logs. The installed system boots and
  works fine, but the error is clearly something we want to get rid of.

  At first glance this seems related to:

  https://bugs.launchpad.net/ubuntu/+source/initramfs-tools/+bug/1863261

  but the version of initramfs-tools in both the installer and installed
  system (checked with `chroot /target dpkg -l initramfs-tools` during
  the installation) is 0.136ubuntu1, which should contain Rafael's fix
  for that bug. I wonder if the update-initramfs diversion has a role
  here.

  I verified this happens at least on amd64 and arm64. I'm attaching the full 
install logs for a amd64 installation.
  --- 
  ProblemType: Bug
  AlsaVersion: Advanced Linux Sound Architecture Driver Version 
k5.4.0-14-generic.
  AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
  ApportVersion: 2.20.11-0ubuntu18
  Architecture: amd64
  ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/by-path', 
'/dev/snd/controlC0', '/dev/snd/hwC0D0', '/dev/snd/pcmC0D0c', 
'/dev/snd/pcmC0D0p', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
  CRDA: N/A
  Card0.Amixer.info: Error: [Errno 2] No such file or directory: 'amixer'
  Card0.Amixer.values: Error: [Errno 2] No such file or directory: 'amixer'
  CasperVersion: 1.439
  DistroRelease: Ubuntu 20.04
  IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
  LiveMediaBuild: Ubuntu-Server 20.04 LTS "Focal Fossa" - Alpha amd64 (20200225)
  Lsusb:
   Bus 001 Device 002: ID 0627:0001 Adomax Technology Co., Ltd QEMU USB Tablet
   Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
   Bus 004 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
   Bus 003 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
   Bus 002 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
  Lsusb-t:
   /:  Bus 04.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 03.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 02.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=ehci-pci/6p, 480M
   |__ Port 1: Dev 2, If 0, Class=Human Interface Device, Driver=usbhid, 
480M
  MachineType: QEMU Standard PC (Q35 + ICH9, 2009)
  NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
  Package: linux (not installed)
  ProcEnviron:
   TERM=linux
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=
   LANG=C.UTF-8
  ProcFB: 0 qxldrmfb
  ProcKernelCmdLine: initrd=/casper/initrd quiet  --- maybe-ubiquity
  ProcVersionSignature: Ubuntu 5.4.0-14.17-generic 5.4.18
  RelatedPackageVersions:
   linux-restricted-modules-5.4.0-14-generic N/A
   linux-backports-modules-5.4.0-14-generic  N/A
   linux-firmware1.186
  RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
  Tags:  focal uec-images
  Uname: Linux 5.4.0-14-generic x86_64
  UpgradeStatus: No upgrade log present (probably fresh install)
  UserGroups:
   
  _MarkForUpload: True
  dmi.bios.date: 04/01/2014
  dmi.bios.vendor: SeaBIOS
  dmi.bios.version: 1.13.0-1
  dmi.chassis.type: 1
  dmi.chassis.vendor: QEMU
  dmi.chassis.version: pc-q35-4.2
  dmi.modalias: 
dmi:bvnSeaBIOS:bvr1.13.0-1:bd04/01/2014:svnQEMU:pnStandardPC(Q35+ICH9,2009):pvrpc-q35-4.2:cvnQEMU:ct1:cvrpc-q35-4.2:
  dmi.product.name: Standard PC (Q35 + ICH9, 2009)
  dmi.product.version: pc-q35-4.2
  dmi.sys.vendor: QEMU

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1864992/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1864992] Re: depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could not open builtin file '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

2020-03-03 Thread Rafael David Tinoco
https://bugs.launchpad.net/ubuntu/+source/initramfs-tools/+bug/1863261

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1864992

Title:
  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could
  not open builtin file
  '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

Status in curtin:
  Invalid
Status in subiquity:
  New
Status in kmod package in Ubuntu:
  Confirmed
Status in linux package in Ubuntu:
  Confirmed

Bug description:
  During a Focal install from the ISO image several errors like:

  depmod: ERROR: ../libkmod/libkmod.c:515 lookup_builtin_file() could
  not open builtin file
  '/lib/modules/5.4.0-14-generic/modules.builtin.bin'

  are logged in curtin's install logs. The installed system boots and
  works fine, but the error is clearly something we want to get rid of.

  At first glance this seems related to:

  https://bugs.launchpad.net/ubuntu/+source/initramfs-tools/+bug/1863261

  but the version of initramfs-tools in both the installer and installed
  system (checked with `chroot /target dpkg -l initramfs-tools` during
  the installation) is 0.136ubuntu1, which should contain Rafael's fix
  for that bug. I wonder if the update-initramfs diversion has a role
  here.

  I verified this happens at least on amd64 and arm64. I'm attaching the full 
install logs for a amd64 installation.
  --- 
  ProblemType: Bug
  AlsaVersion: Advanced Linux Sound Architecture Driver Version 
k5.4.0-14-generic.
  AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
  ApportVersion: 2.20.11-0ubuntu18
  Architecture: amd64
  ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/by-path', 
'/dev/snd/controlC0', '/dev/snd/hwC0D0', '/dev/snd/pcmC0D0c', 
'/dev/snd/pcmC0D0p', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
  CRDA: N/A
  Card0.Amixer.info: Error: [Errno 2] No such file or directory: 'amixer'
  Card0.Amixer.values: Error: [Errno 2] No such file or directory: 'amixer'
  CasperVersion: 1.439
  DistroRelease: Ubuntu 20.04
  IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
  LiveMediaBuild: Ubuntu-Server 20.04 LTS "Focal Fossa" - Alpha amd64 (20200225)
  Lsusb:
   Bus 001 Device 002: ID 0627:0001 Adomax Technology Co., Ltd QEMU USB Tablet
   Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
   Bus 004 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
   Bus 003 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
   Bus 002 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
  Lsusb-t:
   /:  Bus 04.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 03.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 02.Port 1: Dev 1, Class=root_hub, Driver=uhci_hcd/2p, 12M
   /:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=ehci-pci/6p, 480M
   |__ Port 1: Dev 2, If 0, Class=Human Interface Device, Driver=usbhid, 
480M
  MachineType: QEMU Standard PC (Q35 + ICH9, 2009)
  NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
  Package: linux (not installed)
  ProcEnviron:
   TERM=linux
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=
   LANG=C.UTF-8
  ProcFB: 0 qxldrmfb
  ProcKernelCmdLine: initrd=/casper/initrd quiet  --- maybe-ubiquity
  ProcVersionSignature: Ubuntu 5.4.0-14.17-generic 5.4.18
  RelatedPackageVersions:
   linux-restricted-modules-5.4.0-14-generic N/A
   linux-backports-modules-5.4.0-14-generic  N/A
   linux-firmware1.186
  RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
  Tags:  focal uec-images
  Uname: Linux 5.4.0-14-generic x86_64
  UpgradeStatus: No upgrade log present (probably fresh install)
  UserGroups:
   
  _MarkForUpload: True
  dmi.bios.date: 04/01/2014
  dmi.bios.vendor: SeaBIOS
  dmi.bios.version: 1.13.0-1
  dmi.chassis.type: 1
  dmi.chassis.vendor: QEMU
  dmi.chassis.version: pc-q35-4.2
  dmi.modalias: 
dmi:bvnSeaBIOS:bvr1.13.0-1:bd04/01/2014:svnQEMU:pnStandardPC(Q35+ICH9,2009):pvrpc-q35-4.2:cvnQEMU:ct1:cvrpc-q35-4.2:
  dmi.product.name: Standard PC (Q35 + ICH9, 2009)
  dmi.product.version: pc-q35-4.2
  dmi.sys.vendor: QEMU

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1864992/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1852122] Re: ocfs2-tools is causing kernel panics in Ubuntu Focal (Ubuntu-5.4.0-9.12)

2020-02-12 Thread Rafael David Tinoco
VERIFICATION:

(k)rafaeldtinoco@ocfs2:~$ apt-cache policy linux-image-5.4.0-14-generic
linux-image-5.4.0-14-generic:
  Installed: 5.4.0-14.17
  Candidate: 5.4.0-14.17
  Version table:
 *** 5.4.0-14.17 500
500 http://br.archive.ubuntu.com/ubuntu focal-proposed/main amd64 
Packages
100 /var/lib/dpkg/status

(k)rafaeldtinoco@ocfs2:~/scripts$ sudo ./ocfs2_reproducer.sh
=== dlmfs ===
ocfs2_dlmfs /dlm ocfs2_dlmfs rw,relatime 0 0
=== lsmod ===
ocfs2_stack_o2cb   16384  0
ocfs2_dlm 192512  1 ocfs2_stack_o2cb
ocfs2_nodemanager 196608  7 ocfs2_stack_o2cb,ocfs2_dlm,ocfs2_dlmfs
ocfs2_stackglue20480  2 ocfs2_stack_o2cb,ocfs2_dlmfs
=== o2hbmonitor ===
1026 o2hbmonitor
=== o2cluster ===
o2cb,ocfs2,local
=== o2cb_ctl ===
cluster:
name = ocfs2
node_count = 1
status = configured

=== losetup ===
200+0 records in
200+0 records out
209715200 bytes (210 MB, 200 MiB) copied, 0.192249 s, 1.1 GB/s
=== mkfs ===
mkfs.ocfs2 1.8.6
Cluster stack: o2cb
Cluster name: ocfs2
Stack Flags: 0x0
NOTE: Feature extended slot map may be enabled
Label:
Features: sparse extended-slotmap backup-super unwritten inline-data 
strict-journal-super xattr indexed-dirs refcount discontig-bg append-dio
Block size: 1024 (10 bits)
Cluster size: 4096 (12 bits)
Volume size: 209715200 (51200 clusters) (204800 blocks)
Cluster groups: 7 (tail covers 5120 clusters, rest cover 7680 clusters)
Extent allocator size: 2097152 (1 groups)
Journal size: 4194304
Node slots: 2
Creating bitmaps: done
Initializing superblock: done
Writing system files: done
Writing superblock: done
Writing backup superblock: 0 block(s)
Formatting Journals: done
Growing extent allocator: done
Formatting slot map: done
Formatting quota files: done
Writing lost+found: done
mkfs.ocfs2 successful

=== mount ===
Filesystem 1K-blocks  Used Available Use% Mounted on
/dev/loop0204800 14904189896   8% /mnt
cleanup

** Tags removed: verification-needed-eoan
** Tags added: verification-done verification-done-eoan

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1852122

Title:
  ocfs2-tools is causing kernel panics in Ubuntu Focal
  (Ubuntu-5.4.0-9.12)

Status in OCFS2 Tools:
  Fix Released
Status in linux package in Ubuntu:
  Fix Released
Status in ocfs2-tools package in Ubuntu:
  Invalid
Status in linux source package in Eoan:
  Fix Committed
Status in ocfs2-tools source package in Eoan:
  Invalid
Status in linux source package in Focal:
  Fix Released
Status in ocfs2-tools source package in Focal:
  Invalid

Bug description:
  
  [Impact] 

   * Umounts to OCFS2 filesystems will cause a kernel crash in any
  kernel containing commit e581595ea29c (v5.3-rc1) and not containing
  its fix b73eba2a867e (v5.5-rc5).

  [Test Case]

   * ocfs2_reproducer.sh (attached to this bug)

  [Regression Potential]

   * it could cause ocfs2 issues, so I guess its a low impact considering 
amount of users.
   * Its a straightforward fix identified by upstream developer and a clean 
cherry-pick for us.

  [Other Info]

   * Original description:

  I noticed the tests for ocfs2-tools/1.8.6-1ubuntu1 were constantly
  retrying themselves. It's a feature we have so that transient /
  occasional failures are auto-retried, but it's misfiring here because
  we're not detecting that it's a consistent failure. That particular
  bug is fixed, but it means that ocfs2-tools is failing on ppc64el.
  Here's the important part of the log, full output attached.

  [   85.605738] BUG: Unable to handle kernel data access at 0x01744098
    
   [   85.605850] Faulting instruction address: 
0xc0e81168
    
   [   85.605901] Oops: Kernel access of bad 
area, sig: 11 [#1]
    
   [   85.605970] LE PAGE_SIZE=64K MMU=Hash SMP 
NR_CPUS=2048 NUMA pSeries
    
   [   85.606029] Modules linked in: ocfs2 
quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager 
ocfs2_stackglue iptable_mangle xt_TCPMSS xt_tcpudp bpfilter dm_multipath 
scsi_dh_rdac scsi_dh_emc scsi_dh_alua vmx_crypto crct10dif_vpmsum sch_fq_codel 
ip_tables x_tables autofs4 btrfs xor zstd_compress raid6_pq libcrc32c 
crc32c_vpmsum virtio_net virtio_blk net_failover failover
    
   [   85.606291] CPU: 0 PID: 1 Comm: systemd 
Not tainted 5.3.0-18-generic #19-Ubuntu
    
  

[Kernel-packages] [Bug 1852122] Re: ocfs2-tools is causing kernel panics in Ubuntu Focal (Ubuntu-5.4.0-9.12)

2020-01-23 Thread Rafael David Tinoco
Eoan patch was acked. Focal patch is already in latest kernel version.

** Changed in: linux (Ubuntu Focal)
   Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1852122

Title:
  ocfs2-tools is causing kernel panics in Ubuntu Focal
  (Ubuntu-5.4.0-9.12)

Status in OCFS2 Tools:
  Fix Released
Status in linux package in Ubuntu:
  Fix Released
Status in ocfs2-tools package in Ubuntu:
  Invalid
Status in linux source package in Eoan:
  In Progress
Status in ocfs2-tools source package in Eoan:
  Invalid
Status in linux source package in Focal:
  Fix Released
Status in ocfs2-tools source package in Focal:
  Invalid

Bug description:
  
  [Impact] 

   * Umounts to OCFS2 filesystems will cause a kernel crash in any
  kernel containing commit e581595ea29c (v5.3-rc1) and not containing
  its fix b73eba2a867e (v5.5-rc5).

  [Test Case]

   * ocfs2_reproducer.sh (attached to this bug)

  [Regression Potential]

   * it could cause ocfs2 issues, so I guess its a low impact considering 
amount of users.
   * Its a straightforward fix identified by upstream developer and a clean 
cherry-pick for us.

  [Other Info]

   * Original description:

  I noticed the tests for ocfs2-tools/1.8.6-1ubuntu1 were constantly
  retrying themselves. It's a feature we have so that transient /
  occasional failures are auto-retried, but it's misfiring here because
  we're not detecting that it's a consistent failure. That particular
  bug is fixed, but it means that ocfs2-tools is failing on ppc64el.
  Here's the important part of the log, full output attached.

  [   85.605738] BUG: Unable to handle kernel data access at 0x01744098
    
   [   85.605850] Faulting instruction address: 
0xc0e81168
    
   [   85.605901] Oops: Kernel access of bad 
area, sig: 11 [#1]
    
   [   85.605970] LE PAGE_SIZE=64K MMU=Hash SMP 
NR_CPUS=2048 NUMA pSeries
    
   [   85.606029] Modules linked in: ocfs2 
quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager 
ocfs2_stackglue iptable_mangle xt_TCPMSS xt_tcpudp bpfilter dm_multipath 
scsi_dh_rdac scsi_dh_emc scsi_dh_alua vmx_crypto crct10dif_vpmsum sch_fq_codel 
ip_tables x_tables autofs4 btrfs xor zstd_compress raid6_pq libcrc32c 
crc32c_vpmsum virtio_net virtio_blk net_failover failover
    
   [   85.606291] CPU: 0 PID: 1 Comm: systemd 
Not tainted 5.3.0-18-generic #19-Ubuntu
    
   [   85.606350] NIP:  c0e81168 LR: 
c054f240 CTR: 
    
   [   85.606410] REGS: c0005a3e3700 TRAP: 
0300   Not tainted  (5.3.0-18-generic)
    
   [   85.606469] MSR:  80009033 
  CR: 28024448  XER: 
    
   [   85.606531] CFAR: 701f9806f638 DAR: 
01744098 DSISR: 4000 IRQMASK: 0
    
   [   85.606531] GPR00: 7374 
c0005a3e3990 c19c9100 c0004fe462a8
    
   [   85.606531] GPR04: c0005856d840 
000e 74656772 c0004fe4a568
    
   [   85.606531] GPR08:  
c00058568004 01744090 
    
   [   85.606531] GPR12: e8086002 
c1d6 7fffddd522d0 
    
   [   85.606531] GPR16:  
  c755e07c
    
   [   85.606531] GPR20: 

[Kernel-packages] [Bug 1852122] Re: ocfs2-tools is causing kernel panics in Ubuntu Focal (Ubuntu-5.4.0-9.12)

2020-01-13 Thread Rafael David Tinoco
Patches for Focal and SRU were sent to kernel-t...@lists.ubuntu.com:

https://lists.ubuntu.com/archives/kernel-team/2020-January/106845.html
https://lists.ubuntu.com/archives/kernel-team/2020-January/106846.html

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1852122

Title:
  ocfs2-tools is causing kernel panics in Ubuntu Focal
  (Ubuntu-5.4.0-9.12)

Status in OCFS2 Tools:
  Fix Released
Status in linux package in Ubuntu:
  In Progress
Status in ocfs2-tools package in Ubuntu:
  Invalid
Status in linux source package in Eoan:
  In Progress
Status in ocfs2-tools source package in Eoan:
  Invalid
Status in linux source package in Focal:
  In Progress
Status in ocfs2-tools source package in Focal:
  Invalid

Bug description:
  
  [Impact] 

   * Umounts to OCFS2 filesystems will cause a kernel crash in any
  kernel containing commit e581595ea29c (v5.3-rc1) and not containing
  its fix b73eba2a867e (v5.5-rc5).

  [Test Case]

   * ocfs2_reproducer.sh (attached to this bug)

  [Regression Potential]

   * it could cause ocfs2 issues, so I guess its a low impact considering 
amount of users.
   * Its a straightforward fix identified by upstream developer and a clean 
cherry-pick for us.

  [Other Info]

   * Original description:

  I noticed the tests for ocfs2-tools/1.8.6-1ubuntu1 were constantly
  retrying themselves. It's a feature we have so that transient /
  occasional failures are auto-retried, but it's misfiring here because
  we're not detecting that it's a consistent failure. That particular
  bug is fixed, but it means that ocfs2-tools is failing on ppc64el.
  Here's the important part of the log, full output attached.

  [   85.605738] BUG: Unable to handle kernel data access at 0x01744098
    
   [   85.605850] Faulting instruction address: 
0xc0e81168
    
   [   85.605901] Oops: Kernel access of bad 
area, sig: 11 [#1]
    
   [   85.605970] LE PAGE_SIZE=64K MMU=Hash SMP 
NR_CPUS=2048 NUMA pSeries
    
   [   85.606029] Modules linked in: ocfs2 
quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager 
ocfs2_stackglue iptable_mangle xt_TCPMSS xt_tcpudp bpfilter dm_multipath 
scsi_dh_rdac scsi_dh_emc scsi_dh_alua vmx_crypto crct10dif_vpmsum sch_fq_codel 
ip_tables x_tables autofs4 btrfs xor zstd_compress raid6_pq libcrc32c 
crc32c_vpmsum virtio_net virtio_blk net_failover failover
    
   [   85.606291] CPU: 0 PID: 1 Comm: systemd 
Not tainted 5.3.0-18-generic #19-Ubuntu
    
   [   85.606350] NIP:  c0e81168 LR: 
c054f240 CTR: 
    
   [   85.606410] REGS: c0005a3e3700 TRAP: 
0300   Not tainted  (5.3.0-18-generic)
    
   [   85.606469] MSR:  80009033 
  CR: 28024448  XER: 
    
   [   85.606531] CFAR: 701f9806f638 DAR: 
01744098 DSISR: 4000 IRQMASK: 0
    
   [   85.606531] GPR00: 7374 
c0005a3e3990 c19c9100 c0004fe462a8
    
   [   85.606531] GPR04: c0005856d840 
000e 74656772 c0004fe4a568
    
   [   85.606531] GPR08:  
c00058568004 01744090 
    
   [   85.606531] GPR12: e8086002 
c1d6 7fffddd522d0 
    
   [   85.606531] GPR16:  
  c755e07c
    
 

[Kernel-packages] [Bug 1852122] Re: ocfs2-tools is causing kernel panics in Ubuntu Focal (Ubuntu-5.4.0-9.12)

2020-01-13 Thread Rafael David Tinoco
** Description changed:

+ 
+ [Impact] 
+ 
+  * Umounts to OCFS2 filesystems will cause a kernel crash in any kernel
+ containing commit e581595ea29c (v5.3-rc1) and not containing its fix
+ b73eba2a867e (v5.5-rc5).
+ 
+ [Test Case]
+ 
+  * ocfs2_reproducer.sh (attached to this bug)
+ 
+ [Regression Potential]
+ 
+  * it could cause ocfs2 issues, so I guess its a low impact considering 
amount of users.
+  * Its a straightforward fix identified by upstream developer and a clean 
cherry-pick for us.
+ 
+ [Other Info]
+ 
+  * Original description:
+ 
  I noticed the tests for ocfs2-tools/1.8.6-1ubuntu1 were constantly
  retrying themselves. It's a feature we have so that transient /
  occasional failures are auto-retried, but it's misfiring here because
  we're not detecting that it's a consistent failure. That particular bug
  is fixed, but it means that ocfs2-tools is failing on ppc64el. Here's
  the important part of the log, full output attached.
  
  [   85.605738] BUG: Unable to handle kernel data access at 0x01744098
-   
   [   85.605850] Faulting instruction address: 
0xc0e81168
-   
   [   85.605901] Oops: Kernel access of bad 
area, sig: 11 [#1]
-   
   [   85.605970] LE PAGE_SIZE=64K MMU=Hash SMP 
NR_CPUS=2048 NUMA pSeries
-   
   [   85.606029] Modules linked in: ocfs2 
quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager 
ocfs2_stackglue iptable_mangle xt_TCPMSS xt_tcpudp bpfilter dm_multipath 
scsi_dh_rdac scsi_dh_emc scsi_dh_alua vmx_crypto crct10dif_vpmsum sch_fq_codel 
ip_tables x_tables autofs4 btrfs xor zstd_compress raid6_pq libcrc32c 
crc32c_vpmsum virtio_net virtio_blk net_failover failover
-   
   [   85.606291] CPU: 0 PID: 1 Comm: systemd 
Not tainted 5.3.0-18-generic #19-Ubuntu
-   
   [   85.606350] NIP:  c0e81168 LR: 
c054f240 CTR: 
-   
   [   85.606410] REGS: c0005a3e3700 TRAP: 
0300   Not tainted  (5.3.0-18-generic)
-   
   [   85.606469] MSR:  80009033 
  CR: 28024448  XER: 
-   
   [   85.606531] CFAR: 701f9806f638 DAR: 
01744098 DSISR: 4000 IRQMASK: 0 
-   
   [   85.606531] GPR00: 7374 
c0005a3e3990 c19c9100 c0004fe462a8 
-   
   [   85.606531] GPR04: c0005856d840 
000e 74656772 c0004fe4a568 
-   
   [   85.606531] GPR08:  
c00058568004 01744090  
-   
   [   85.606531] GPR12: e8086002 
c1d6 7fffddd522d0  
-   
   [   85.606531] GPR16:  
  c755e07c 
-   
   [   85.606531] GPR20: c000598caca8 
c0005a3e3a58  c00058292f00 
-   
   [   85.606531] GPR24: c0eea710 
 c0005856d840 c755e074 
-   
   [   85.606531] GPR28: 6518907d 
c0005a3e3a68 c0004fe4b160 027c47b6 
-   
   [   85.607079] NIP [c0e81168] 
rb_insert_color+0x18/0x1c0
-   

[Kernel-packages] [Bug 1852122] Re: ocfs2-tools is causing kernel panics in Ubuntu Focal (Ubuntu-5.4.0-9.12)

2020-01-13 Thread Rafael David Tinoco
Yep, fixes the issue:

[   25.249831] ocfs2: Registered cluster interface o2cb
[   25.257661] OCFS2 User DLM kernel interface loaded
[   25.265196] o2hb: Heartbeat mode set to local
[   34.231435] o2dlm: Joining domain F67405C564CB4A7CAEBA6F6ACCA2C82F
[   34.231436] (
[   34.231437] 0
[   34.231438] ) 1 nodes
[   34.231825] JBD2: Ignoring recovery information on journal
[   34.233058] ocfs2: Mounting device (7,0) on (node 0, slot 0) with ordered 
data mode.
[   38.246001] o2dlm: Leaving domain F67405C564CB4A7CAEBA6F6ACCA2C82F
[   38.247583] ocfs2: Unmounting device (7,0) on (node 0)
[   50.998435] ocfs2: Unregistered cluster interface o2cb
[   51.117395] ocfs2: Registered cluster interface o2cb
[   51.124916] OCFS2 User DLM kernel interface loaded
[   51.131192] o2hb: Heartbeat mode set to local
[   59.999672] o2dlm: Joining domain 1D1FFAA94E654FE6B94AA0E44029CE9E
[   59.999674] (
[   59.999675] 0
[   59.999676] ) 1 nodes
[   60.000252] JBD2: Ignoring recovery information on journal
[   60.001543] ocfs2: Mounting device (7,0) on (node 0, slot 0) with ordered 
data mode.
[   64.043638] o2dlm: Leaving domain 1D1FFAA94E654FE6B94AA0E44029CE9E
[   64.045484] ocfs2: Unmounting device (7,0) on (node 0)
[   70.866574] random: crng init done
[   70.866586] random: 7 urandom warning(s) missed due to ratelimiting

I'll propose patch to kernel team.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1852122

Title:
  ocfs2-tools is causing kernel panics in Ubuntu Focal
  (Ubuntu-5.4.0-9.12)

Status in OCFS2 Tools:
  Fix Released
Status in linux package in Ubuntu:
  In Progress
Status in ocfs2-tools package in Ubuntu:
  Invalid
Status in linux source package in Eoan:
  In Progress
Status in ocfs2-tools source package in Eoan:
  Invalid
Status in linux source package in Focal:
  In Progress
Status in ocfs2-tools source package in Focal:
  Invalid

Bug description:
  I noticed the tests for ocfs2-tools/1.8.6-1ubuntu1 were constantly
  retrying themselves. It's a feature we have so that transient /
  occasional failures are auto-retried, but it's misfiring here because
  we're not detecting that it's a consistent failure. That particular
  bug is fixed, but it means that ocfs2-tools is failing on ppc64el.
  Here's the important part of the log, full output attached.

  [   85.605738] BUG: Unable to handle kernel data access at 0x01744098

   [   85.605850] Faulting instruction address: 
0xc0e81168

   [   85.605901] Oops: Kernel access of bad 
area, sig: 11 [#1]

   [   85.605970] LE PAGE_SIZE=64K MMU=Hash SMP 
NR_CPUS=2048 NUMA pSeries

   [   85.606029] Modules linked in: ocfs2 
quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager 
ocfs2_stackglue iptable_mangle xt_TCPMSS xt_tcpudp bpfilter dm_multipath 
scsi_dh_rdac scsi_dh_emc scsi_dh_alua vmx_crypto crct10dif_vpmsum sch_fq_codel 
ip_tables x_tables autofs4 btrfs xor zstd_compress raid6_pq libcrc32c 
crc32c_vpmsum virtio_net virtio_blk net_failover failover

   [   85.606291] CPU: 0 PID: 1 Comm: systemd 
Not tainted 5.3.0-18-generic #19-Ubuntu

   [   85.606350] NIP:  c0e81168 LR: 
c054f240 CTR: 

   [   85.606410] REGS: c0005a3e3700 TRAP: 
0300   Not tainted  (5.3.0-18-generic)

   [   85.606469] MSR:  80009033 
  CR: 28024448  XER: 

   [   85.606531] CFAR: 701f9806f638 DAR: 
01744098 DSISR: 4000 IRQMASK: 0 

   [   85.606531] GPR00: 7374 
c0005a3e3990 c19c9100 c0004fe462a8 

   [   85.606531] GPR04: c0005856d840 
000e 74656772 c0004fe4a568 
 

[Kernel-packages] [Bug 1852122] Re: ocfs2-tools is causing kernel panics in Ubuntu Focal (Ubuntu-5.4.0-9.12)

2020-01-13 Thread Rafael David Tinoco
The upstream fix is likely this:

>From b73eba2a867e10b9b4477738677341f3307c07bb Mon Sep 17 00:00:00 2001
From: Gang He 
Date: Sat, 4 Jan 2020 13:00:22 -0800
Subject: [PATCH] ocfs2: fix the crash due to call ocfs2_get_dlm_debug once
 less

Because ocfs2_get_dlm_debug() function is called once less here, ocfs2
file system will trigger the system crash, usually after ocfs2 file
system is unmounted.

This system crash is caused by a generic memory corruption, these crash
backtraces are not always the same, for exapmle,

ocfs2: Unmounting device (253,16) on (node 172167785)
general protection fault:  [#1] SMP PTI
CPU: 3 PID: 14107 Comm: fence_legacy Kdump:
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996)
RIP: 0010:__kmalloc+0xa5/0x2a0
Code: 00 00 4d 8b 07 65 4d 8b
RSP: 0018:aa1fc094bbe8 EFLAGS: 00010286
RAX:  RBX: d310a8800d7a3faf RCX: 
RDX:  RSI: 0dc0 RDI: 96e68fc036c0
RBP: d310a8800d7a3faf R08: 96e6ffdb10a0 R09: 752e7079
R10: 0001c513 R11: 04091041 R12: 0dc0
R13: 0039 R14: 96e68fc036c0 R15: 96e68fc036c0
FS:  7f699dfba540() GS:96e6ffd8() knlGS:0
CS:  0010 DS:  ES:  CR0: 80050033
CR2: 55f3a9d9b768 CR3: 2cd1c000 CR4: 06e0
Call Trace:
 ext4_htree_store_dirent+0x35/0x100 [ext4]
 htree_dirblock_to_tree+0xea/0x290 [ext4]
 ext4_htree_fill_tree+0x1c1/0x2d0 [ext4]
 ext4_readdir+0x67c/0x9d0 [ext4]
 iterate_dir+0x8d/0x1a0
 __x64_sys_getdents+0xab/0x130
 do_syscall_64+0x60/0x1f0
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7f699d33a9fb

This regression problem was introduced by commit e581595ea29c ("ocfs: no
need to check return value of debugfs_create functions").

Link: http://lkml.kernel.org/r/20191225061501.13587-1-...@suse.com
Fixes: e581595ea29c ("ocfs: no need to check return value of debugfs_create 
functions")
Signed-off-by: Gang He 
Acked-by: Joseph Qi 
Cc: Mark Fasheh 
Cc: Joel Becker 
Cc: Junxiao Bi 
Cc: Changwei Ge 
Cc: Gang He 
Cc: Jun Piao 
Cc: [5.3+]
Signed-off-by: Andrew Morton 
Signed-off-by: Linus Torvalds 

as reported in upstream bug. Giving it a try to finally suggest as a SRU
to the kernel team.

** Changed in: ocfs2-tools (Ubuntu Eoan)
   Status: In Progress => Invalid

** Changed in: ocfs2-tools (Ubuntu Focal)
   Status: In Progress => Invalid

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1852122

Title:
  ocfs2-tools is causing kernel panics in Ubuntu Focal
  (Ubuntu-5.4.0-9.12)

Status in OCFS2 Tools:
  Fix Released
Status in linux package in Ubuntu:
  In Progress
Status in ocfs2-tools package in Ubuntu:
  Invalid
Status in linux source package in Eoan:
  In Progress
Status in ocfs2-tools source package in Eoan:
  Invalid
Status in linux source package in Focal:
  In Progress
Status in ocfs2-tools source package in Focal:
  Invalid

Bug description:
  I noticed the tests for ocfs2-tools/1.8.6-1ubuntu1 were constantly
  retrying themselves. It's a feature we have so that transient /
  occasional failures are auto-retried, but it's misfiring here because
  we're not detecting that it's a consistent failure. That particular
  bug is fixed, but it means that ocfs2-tools is failing on ppc64el.
  Here's the important part of the log, full output attached.

  [   85.605738] BUG: Unable to handle kernel data access at 0x01744098

   [   85.605850] Faulting instruction address: 
0xc0e81168

   [   85.605901] Oops: Kernel access of bad 
area, sig: 11 [#1]

   [   85.605970] LE PAGE_SIZE=64K MMU=Hash SMP 
NR_CPUS=2048 NUMA pSeries

   [   85.606029] Modules linked in: ocfs2 
quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager 
ocfs2_stackglue iptable_mangle xt_TCPMSS xt_tcpudp bpfilter dm_multipath 
scsi_dh_rdac scsi_dh_emc scsi_dh_alua vmx_crypto crct10dif_vpmsum sch_fq_codel 
ip_tables x_tables autofs4 btrfs xor zstd_compress raid6_pq libcrc32c 
crc32c_vpmsum virtio_net virtio_blk net_failover failover

   [   85.606291] CPU: 0 PID: 1 Comm: systemd 
Not tainted 5.3.0-18-generic #19-Ubuntu

   [  

[Kernel-packages] [Bug 1852122] Re: ocfs2-tools is causing kernel panics in Ubuntu Focal (Ubuntu-5.4.0-9.12)

2020-01-13 Thread Rafael David Tinoco
Thanks for checking this Andreas! Looks like upstream got a fix for the
issue and Debian has confirmed it worked. With that, I'll check if it
fixes the issue indeed and suggest the SRU to the kernel-team so we can
unblock ocfs2-tools.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1852122

Title:
  ocfs2-tools is causing kernel panics in Ubuntu Focal
  (Ubuntu-5.4.0-9.12)

Status in OCFS2 Tools:
  Fix Released
Status in linux package in Ubuntu:
  In Progress
Status in ocfs2-tools package in Ubuntu:
  In Progress
Status in linux source package in Eoan:
  In Progress
Status in ocfs2-tools source package in Eoan:
  In Progress
Status in linux source package in Focal:
  In Progress
Status in ocfs2-tools source package in Focal:
  In Progress

Bug description:
  I noticed the tests for ocfs2-tools/1.8.6-1ubuntu1 were constantly
  retrying themselves. It's a feature we have so that transient /
  occasional failures are auto-retried, but it's misfiring here because
  we're not detecting that it's a consistent failure. That particular
  bug is fixed, but it means that ocfs2-tools is failing on ppc64el.
  Here's the important part of the log, full output attached.

  [   85.605738] BUG: Unable to handle kernel data access at 0x01744098

   [   85.605850] Faulting instruction address: 
0xc0e81168

   [   85.605901] Oops: Kernel access of bad 
area, sig: 11 [#1]

   [   85.605970] LE PAGE_SIZE=64K MMU=Hash SMP 
NR_CPUS=2048 NUMA pSeries

   [   85.606029] Modules linked in: ocfs2 
quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager 
ocfs2_stackglue iptable_mangle xt_TCPMSS xt_tcpudp bpfilter dm_multipath 
scsi_dh_rdac scsi_dh_emc scsi_dh_alua vmx_crypto crct10dif_vpmsum sch_fq_codel 
ip_tables x_tables autofs4 btrfs xor zstd_compress raid6_pq libcrc32c 
crc32c_vpmsum virtio_net virtio_blk net_failover failover

   [   85.606291] CPU: 0 PID: 1 Comm: systemd 
Not tainted 5.3.0-18-generic #19-Ubuntu

   [   85.606350] NIP:  c0e81168 LR: 
c054f240 CTR: 

   [   85.606410] REGS: c0005a3e3700 TRAP: 
0300   Not tainted  (5.3.0-18-generic)

   [   85.606469] MSR:  80009033 
  CR: 28024448  XER: 

   [   85.606531] CFAR: 701f9806f638 DAR: 
01744098 DSISR: 4000 IRQMASK: 0 

   [   85.606531] GPR00: 7374 
c0005a3e3990 c19c9100 c0004fe462a8 

   [   85.606531] GPR04: c0005856d840 
000e 74656772 c0004fe4a568 

   [   85.606531] GPR08:  
c00058568004 01744090  

   [   85.606531] GPR12: e8086002 
c1d6 7fffddd522d0  

   [   85.606531] GPR16:  
  c755e07c 

   [   85.606531] GPR20: c000598caca8 
c0005a3e3a58  c00058292f00 

   [   85.606531] GPR24: c0eea710 
 c0005856d840 c755e074 

   [   85.606531] GPR28: 

[Kernel-packages] [Bug 1852122] Re: ocfs2-tools is causing kernel panics in Ubuntu Focal (Ubuntu-5.4.0-9.12)

2020-01-09 Thread Rafael David Tinoco
Last good test:

https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac
/autopkgtest-eoan/eoan/amd64/o/ocfs2-tools/20190910_143817_4312f@/log.gz

Kernel: 5.2.0-15-generic

First failure:

https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac
/autopkgtest-eoan/eoan/amd64/o/ocfs2-tools/20190918_060126_bd321@/log.gz

Kernel: 5.3.0-10-generic

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1852122

Title:
  ocfs2-tools is causing kernel panics in Ubuntu Focal
  (Ubuntu-5.4.0-9.12)

Status in OCFS2 Tools:
  New
Status in linux package in Ubuntu:
  In Progress
Status in ocfs2-tools package in Ubuntu:
  In Progress
Status in linux source package in Eoan:
  In Progress
Status in ocfs2-tools source package in Eoan:
  In Progress
Status in linux source package in Focal:
  In Progress
Status in ocfs2-tools source package in Focal:
  In Progress

Bug description:
  I noticed the tests for ocfs2-tools/1.8.6-1ubuntu1 were constantly
  retrying themselves. It's a feature we have so that transient /
  occasional failures are auto-retried, but it's misfiring here because
  we're not detecting that it's a consistent failure. That particular
  bug is fixed, but it means that ocfs2-tools is failing on ppc64el.
  Here's the important part of the log, full output attached.

  [   85.605738] BUG: Unable to handle kernel data access at 0x01744098

   [   85.605850] Faulting instruction address: 
0xc0e81168

   [   85.605901] Oops: Kernel access of bad 
area, sig: 11 [#1]

   [   85.605970] LE PAGE_SIZE=64K MMU=Hash SMP 
NR_CPUS=2048 NUMA pSeries

   [   85.606029] Modules linked in: ocfs2 
quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager 
ocfs2_stackglue iptable_mangle xt_TCPMSS xt_tcpudp bpfilter dm_multipath 
scsi_dh_rdac scsi_dh_emc scsi_dh_alua vmx_crypto crct10dif_vpmsum sch_fq_codel 
ip_tables x_tables autofs4 btrfs xor zstd_compress raid6_pq libcrc32c 
crc32c_vpmsum virtio_net virtio_blk net_failover failover

   [   85.606291] CPU: 0 PID: 1 Comm: systemd 
Not tainted 5.3.0-18-generic #19-Ubuntu

   [   85.606350] NIP:  c0e81168 LR: 
c054f240 CTR: 

   [   85.606410] REGS: c0005a3e3700 TRAP: 
0300   Not tainted  (5.3.0-18-generic)

   [   85.606469] MSR:  80009033 
  CR: 28024448  XER: 

   [   85.606531] CFAR: 701f9806f638 DAR: 
01744098 DSISR: 4000 IRQMASK: 0 

   [   85.606531] GPR00: 7374 
c0005a3e3990 c19c9100 c0004fe462a8 

   [   85.606531] GPR04: c0005856d840 
000e 74656772 c0004fe4a568 

   [   85.606531] GPR08:  
c00058568004 01744090  

   [   85.606531] GPR12: e8086002 
c1d6 7fffddd522d0  

   [   85.606531] GPR16:  
  c755e07c 

   [   85.606531] GPR20: c000598caca8 
c0005a3e3a58  c00058292f00 

   [   85.606531] GPR24: c0eea710 
 

[Kernel-packages] [Bug 1852122] Re: ocfs2-tools autopkgtest is causing kernel panics on service shutdown

2020-01-09 Thread Rafael David Tinoco
I have tested latest focal kernel and looks like the kernel issue is
still there. There is an on going thread upstream about that (most
likely) and I have explained how to reproduce the issue here:

https://github.com/markfasheh/ocfs2-tools/issues/45#issuecomment-572875062

Issue is happening in all arches currently in autopkgtest
infrastructure.



** Summary changed:

- ocfs2-tools autopkgtest is causing kernel panics on service shutdown
+ ocfs2-tools is causing kernel panics in Ubuntu Focal (Ubuntu-5.4.0-9.12)

** Also affects: linux (Ubuntu)
   Importance: Undecided
   Status: New

** Changed in: linux (Ubuntu)
   Status: New => In Progress

** Changed in: linux (Ubuntu)
   Importance: Undecided => Medium

** Also affects: ocfs2-tools (Ubuntu Focal)
   Importance: Medium
 Assignee: Rafael David Tinoco (rafaeldtinoco)
   Status: In Progress

** Also affects: linux (Ubuntu Focal)
   Importance: Medium
   Status: In Progress

** Also affects: ocfs2-tools (Ubuntu Eoan)
   Importance: Undecided
   Status: New

** Also affects: linux (Ubuntu Eoan)
   Importance: Undecided
   Status: New

** Changed in: linux (Ubuntu Eoan)
   Status: New => In Progress

** Changed in: ocfs2-tools (Ubuntu Eoan)
   Status: New => In Progress

** Changed in: ocfs2-tools (Ubuntu Eoan)
   Importance: Undecided => Medium

** Changed in: linux (Ubuntu Eoan)
   Importance: Undecided => Medium

** Changed in: ocfs2-tools (Ubuntu Eoan)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1852122

Title:
  ocfs2-tools is causing kernel panics in Ubuntu Focal
  (Ubuntu-5.4.0-9.12)

Status in OCFS2 Tools:
  New
Status in linux package in Ubuntu:
  In Progress
Status in ocfs2-tools package in Ubuntu:
  In Progress
Status in linux source package in Eoan:
  In Progress
Status in ocfs2-tools source package in Eoan:
  In Progress
Status in linux source package in Focal:
  In Progress
Status in ocfs2-tools source package in Focal:
  In Progress

Bug description:
  I noticed the tests for ocfs2-tools/1.8.6-1ubuntu1 were constantly
  retrying themselves. It's a feature we have so that transient /
  occasional failures are auto-retried, but it's misfiring here because
  we're not detecting that it's a consistent failure. That particular
  bug is fixed, but it means that ocfs2-tools is failing on ppc64el.
  Here's the important part of the log, full output attached.

  [   85.605738] BUG: Unable to handle kernel data access at 0x01744098

   [   85.605850] Faulting instruction address: 
0xc0e81168

   [   85.605901] Oops: Kernel access of bad 
area, sig: 11 [#1]

   [   85.605970] LE PAGE_SIZE=64K MMU=Hash SMP 
NR_CPUS=2048 NUMA pSeries

   [   85.606029] Modules linked in: ocfs2 
quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager 
ocfs2_stackglue iptable_mangle xt_TCPMSS xt_tcpudp bpfilter dm_multipath 
scsi_dh_rdac scsi_dh_emc scsi_dh_alua vmx_crypto crct10dif_vpmsum sch_fq_codel 
ip_tables x_tables autofs4 btrfs xor zstd_compress raid6_pq libcrc32c 
crc32c_vpmsum virtio_net virtio_blk net_failover failover

   [   85.606291] CPU: 0 PID: 1 Comm: systemd 
Not tainted 5.3.0-18-generic #19-Ubuntu

   [   85.606350] NIP:  c0e81168 LR: 
c054f240 CTR: 

   [   85.606410] REGS: c0005a3e3700 TRAP: 
0300   Not tainted  (5.3.0-18-generic)

   [   85.606469] MSR:  80009033 
  CR: 28024448  XER: 

   [   85.606531] CFAR: 701f9806f638 DAR: 
01744098 DSISR: 4000 IRQMASK: 0 

   [   85.606531] GPR00: 7374 
c0005a3e3990 c19c

[Kernel-packages] [Bug 1852122] Re: ocfs2-tools is causing kernel panics in Ubuntu Focal (Ubuntu-5.4.0-9.12)

2020-01-09 Thread Rafael David Tinoco
Waiting on upstream bug.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1852122

Title:
  ocfs2-tools is causing kernel panics in Ubuntu Focal
  (Ubuntu-5.4.0-9.12)

Status in OCFS2 Tools:
  New
Status in linux package in Ubuntu:
  In Progress
Status in ocfs2-tools package in Ubuntu:
  In Progress
Status in linux source package in Eoan:
  In Progress
Status in ocfs2-tools source package in Eoan:
  In Progress
Status in linux source package in Focal:
  In Progress
Status in ocfs2-tools source package in Focal:
  In Progress

Bug description:
  I noticed the tests for ocfs2-tools/1.8.6-1ubuntu1 were constantly
  retrying themselves. It's a feature we have so that transient /
  occasional failures are auto-retried, but it's misfiring here because
  we're not detecting that it's a consistent failure. That particular
  bug is fixed, but it means that ocfs2-tools is failing on ppc64el.
  Here's the important part of the log, full output attached.

  [   85.605738] BUG: Unable to handle kernel data access at 0x01744098

   [   85.605850] Faulting instruction address: 
0xc0e81168

   [   85.605901] Oops: Kernel access of bad 
area, sig: 11 [#1]

   [   85.605970] LE PAGE_SIZE=64K MMU=Hash SMP 
NR_CPUS=2048 NUMA pSeries

   [   85.606029] Modules linked in: ocfs2 
quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager 
ocfs2_stackglue iptable_mangle xt_TCPMSS xt_tcpudp bpfilter dm_multipath 
scsi_dh_rdac scsi_dh_emc scsi_dh_alua vmx_crypto crct10dif_vpmsum sch_fq_codel 
ip_tables x_tables autofs4 btrfs xor zstd_compress raid6_pq libcrc32c 
crc32c_vpmsum virtio_net virtio_blk net_failover failover

   [   85.606291] CPU: 0 PID: 1 Comm: systemd 
Not tainted 5.3.0-18-generic #19-Ubuntu

   [   85.606350] NIP:  c0e81168 LR: 
c054f240 CTR: 

   [   85.606410] REGS: c0005a3e3700 TRAP: 
0300   Not tainted  (5.3.0-18-generic)

   [   85.606469] MSR:  80009033 
  CR: 28024448  XER: 

   [   85.606531] CFAR: 701f9806f638 DAR: 
01744098 DSISR: 4000 IRQMASK: 0 

   [   85.606531] GPR00: 7374 
c0005a3e3990 c19c9100 c0004fe462a8 

   [   85.606531] GPR04: c0005856d840 
000e 74656772 c0004fe4a568 

   [   85.606531] GPR08:  
c00058568004 01744090  

   [   85.606531] GPR12: e8086002 
c1d6 7fffddd522d0  

   [   85.606531] GPR16:  
  c755e07c 

   [   85.606531] GPR20: c000598caca8 
c0005a3e3a58  c00058292f00 

   [   85.606531] GPR24: c0eea710 
 c0005856d840 c755e074 

   [   85.606531] GPR28: 6518907d 
c0005a3e3a68 c0004fe4b160 027c47b6 

   [   85.607079] NIP 

[Kernel-packages] [Bug 1718227] Re: replacement of ifupdown with netplan needs integration for /etc/network/if{up, down}.d scripts

2019-12-11 Thread Rafael David Tinoco
For openvpn + systemd-resolve:

With "up / down" openvpn config file commands you can wrap "systemd-
resolve --set-dns=XXX" and update the given DNS servers.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to ubuntu-fan in Ubuntu.
https://bugs.launchpad.net/bugs/1718227

Title:
  replacement of ifupdown with netplan needs integration for
  /etc/network/if{up,down}.d scripts

Status in aiccu package in Ubuntu:
  Invalid
Status in aoetools package in Ubuntu:
  New
Status in avahi package in Ubuntu:
  New
Status in bind9 package in Ubuntu:
  Invalid
Status in chrony package in Ubuntu:
  Fix Released
Status in clamav package in Ubuntu:
  Triaged
Status in controlaula package in Ubuntu:
  Invalid
Status in ethtool package in Ubuntu:
  Triaged
Status in guidedog package in Ubuntu:
  New
Status in htpdate package in Ubuntu:
  New
Status in ifenslave package in Ubuntu:
  Won't Fix
Status in ifmetric package in Ubuntu:
  Won't Fix
Status in ifupdown-multi package in Ubuntu:
  New
Status in ifupdown-scripts-zg2 package in Ubuntu:
  Invalid
Status in isatapd package in Ubuntu:
  New
Status in lprng package in Ubuntu:
  New
Status in miredo package in Ubuntu:
  New
Status in mythtv package in Ubuntu:
  New
Status in nplan package in Ubuntu:
  New
Status in nss-pam-ldapd package in Ubuntu:
  New
Status in ntp package in Ubuntu:
  Won't Fix
Status in openntpd package in Ubuntu:
  New
Status in openresolv package in Ubuntu:
  Won't Fix
Status in openssh package in Ubuntu:
  Fix Released
Status in openvpn package in Ubuntu:
  Confirmed
Status in openvswitch package in Ubuntu:
  Triaged
Status in postfix package in Ubuntu:
  New
Status in quicktun package in Ubuntu:
  New
Status in resolvconf package in Ubuntu:
  New
Status in sendmail package in Ubuntu:
  New
Status in shorewall-init package in Ubuntu:
  New
Status in sidedoor package in Ubuntu:
  New
Status in slrn package in Ubuntu:
  New
Status in tinc package in Ubuntu:
  New
Status in ubuntu-fan package in Ubuntu:
  Fix Released
Status in ucarp package in Ubuntu:
  New
Status in uml-utilities package in Ubuntu:
  New
Status in uruk package in Ubuntu:
  New
Status in vlan package in Ubuntu:
  Won't Fix
Status in vzctl package in Ubuntu:
  Triaged
Status in wide-dhcpv6 package in Ubuntu:
  New
Status in wpa package in Ubuntu:
  New

Bug description:
  when network is configured with ifupdown, scripts in
  /etc/network/ifup.d/ were called on network being brought up and
  /etc/network/ifdown.d were called on network being brought down.

  Any packages that shipped these hooks need to be verified to have the
  same functionality under a netplan configured system.

  # binpkgs=$(apt-file search /etc/network/if-up | sed 's,: .*,,' | sort -u)
  # for i in $binpkgs; do
src=$(apt-cache show $i | awk '$1 == "Source:" { print $2; exit(0); }');
[ -z "$src" ] && src="$i"; echo $src; done | sort -u

  aiccu
  aoetools
  avahi
  bind9
  chrony
  clamav
  controlaula
  epoptes
  ethtool
  guidedog
  htpdate
  ifenslave
  ifmetric
  ifupdown-extra
  ifupdown-multi
  ifupdown-scripts-zg2
  isatapd
  lprng
  miredo
  mythtv-backend
  nss-pam-ldapd
  ntp
  openntpd
  openresolv
  openssh
  openvpn
  postfix
  quicktun
  resolvconf
  sendmail
  shorewall-init
  sidedoor
  slrn
  tinc
  ubuntu-fan
  ucarp
  uml-utilities
  uruk
  vlan
  vzctl
  wide-dhcpv6
  wpa

  
  Related bugs:
   * bug 1718227: replacement of ifupdown with netplan needs integration for 
/etc/network/if{up,down}.d scripts 
   * bug 1713803: replacement of resolvconf with systemd needs integration 
   * bug 1717983: replacement of isc-dhcp-client with with systemd-networkd for 
dhclient needs integration

  
  ProblemType: Bug
  DistroRelease: Ubuntu 17.10
  Package: netplan (not installed)
  ProcVersionSignature: Ubuntu 4.12.0-11.12-generic 4.12.5
  Uname: Linux 4.12.0-11-generic x86_64
  NonfreeKernelModules: zfs zunicode zavl zcommon znvpair
  ApportVersion: 2.20.7-0ubuntu1
  Architecture: amd64
  CurrentDesktop: GNOME
  Date: Tue Sep 19 10:53:08 2017
  EcryptfsInUse: Yes
  InstallationDate: Installed on 2015-07-23 (789 days ago)
  InstallationMedia: Ubuntu 15.10 "Wily Werewolf" - Alpha amd64 (20150722.1)
  ProcEnviron:
   TERM=xterm-256color
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=
   LANG=en_US.UTF-8
   SHELL=/bin/bash
  SourcePackage: plan
  UpgradeStatus: No upgrade log present (probably fresh install)

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/aiccu/+bug/1718227/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1718227] Re: replacement of ifupdown with netplan needs integration for /etc/network/if{up, down}.d scripts

2019-12-11 Thread Rafael David Tinoco
An example of dns update after putting:

up /etc/openvpn/update-resolv-conf
down /etc/openvpn/update-resolv-conf

in the openvpn .config file:

Wed Dec 11 15:04:25 2019 /etc/openvpn/update-resolv-conf tun0 1500 1558
10.172.67.194 255.255.192.0 init

update-resolv-conf uses:

[ -x /sbin/resolvconf ] || exit 0

so I guess it needs a systemd-resolved.service integration instead.

** Changed in: openvpn (Ubuntu)
   Importance: Undecided => Medium

** Changed in: openvpn (Ubuntu)
   Status: New => Confirmed

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to ubuntu-fan in Ubuntu.
https://bugs.launchpad.net/bugs/1718227

Title:
  replacement of ifupdown with netplan needs integration for
  /etc/network/if{up,down}.d scripts

Status in aiccu package in Ubuntu:
  Invalid
Status in aoetools package in Ubuntu:
  New
Status in avahi package in Ubuntu:
  New
Status in bind9 package in Ubuntu:
  Invalid
Status in chrony package in Ubuntu:
  Fix Released
Status in clamav package in Ubuntu:
  Triaged
Status in controlaula package in Ubuntu:
  Invalid
Status in ethtool package in Ubuntu:
  Triaged
Status in guidedog package in Ubuntu:
  New
Status in htpdate package in Ubuntu:
  New
Status in ifenslave package in Ubuntu:
  Won't Fix
Status in ifmetric package in Ubuntu:
  Won't Fix
Status in ifupdown-multi package in Ubuntu:
  New
Status in ifupdown-scripts-zg2 package in Ubuntu:
  Invalid
Status in isatapd package in Ubuntu:
  New
Status in lprng package in Ubuntu:
  New
Status in miredo package in Ubuntu:
  New
Status in mythtv package in Ubuntu:
  New
Status in nplan package in Ubuntu:
  New
Status in nss-pam-ldapd package in Ubuntu:
  New
Status in ntp package in Ubuntu:
  Won't Fix
Status in openntpd package in Ubuntu:
  New
Status in openresolv package in Ubuntu:
  Won't Fix
Status in openssh package in Ubuntu:
  Fix Released
Status in openvpn package in Ubuntu:
  Confirmed
Status in openvswitch package in Ubuntu:
  Triaged
Status in postfix package in Ubuntu:
  New
Status in quicktun package in Ubuntu:
  New
Status in resolvconf package in Ubuntu:
  New
Status in sendmail package in Ubuntu:
  New
Status in shorewall-init package in Ubuntu:
  New
Status in sidedoor package in Ubuntu:
  New
Status in slrn package in Ubuntu:
  New
Status in tinc package in Ubuntu:
  New
Status in ubuntu-fan package in Ubuntu:
  Fix Released
Status in ucarp package in Ubuntu:
  New
Status in uml-utilities package in Ubuntu:
  New
Status in uruk package in Ubuntu:
  New
Status in vlan package in Ubuntu:
  Won't Fix
Status in vzctl package in Ubuntu:
  Triaged
Status in wide-dhcpv6 package in Ubuntu:
  New
Status in wpa package in Ubuntu:
  New

Bug description:
  when network is configured with ifupdown, scripts in
  /etc/network/ifup.d/ were called on network being brought up and
  /etc/network/ifdown.d were called on network being brought down.

  Any packages that shipped these hooks need to be verified to have the
  same functionality under a netplan configured system.

  # binpkgs=$(apt-file search /etc/network/if-up | sed 's,: .*,,' | sort -u)
  # for i in $binpkgs; do
src=$(apt-cache show $i | awk '$1 == "Source:" { print $2; exit(0); }');
[ -z "$src" ] && src="$i"; echo $src; done | sort -u

  aiccu
  aoetools
  avahi
  bind9
  chrony
  clamav
  controlaula
  epoptes
  ethtool
  guidedog
  htpdate
  ifenslave
  ifmetric
  ifupdown-extra
  ifupdown-multi
  ifupdown-scripts-zg2
  isatapd
  lprng
  miredo
  mythtv-backend
  nss-pam-ldapd
  ntp
  openntpd
  openresolv
  openssh
  openvpn
  postfix
  quicktun
  resolvconf
  sendmail
  shorewall-init
  sidedoor
  slrn
  tinc
  ubuntu-fan
  ucarp
  uml-utilities
  uruk
  vlan
  vzctl
  wide-dhcpv6
  wpa

  
  Related bugs:
   * bug 1718227: replacement of ifupdown with netplan needs integration for 
/etc/network/if{up,down}.d scripts 
   * bug 1713803: replacement of resolvconf with systemd needs integration 
   * bug 1717983: replacement of isc-dhcp-client with with systemd-networkd for 
dhclient needs integration

  
  ProblemType: Bug
  DistroRelease: Ubuntu 17.10
  Package: netplan (not installed)
  ProcVersionSignature: Ubuntu 4.12.0-11.12-generic 4.12.5
  Uname: Linux 4.12.0-11-generic x86_64
  NonfreeKernelModules: zfs zunicode zavl zcommon znvpair
  ApportVersion: 2.20.7-0ubuntu1
  Architecture: amd64
  CurrentDesktop: GNOME
  Date: Tue Sep 19 10:53:08 2017
  EcryptfsInUse: Yes
  InstallationDate: Installed on 2015-07-23 (789 days ago)
  InstallationMedia: Ubuntu 15.10 "Wily Werewolf" - Alpha amd64 (20150722.1)
  ProcEnviron:
   TERM=xterm-256color
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=
   LANG=en_US.UTF-8
   SHELL=/bin/bash
  SourcePackage: plan
  UpgradeStatus: No upgrade log present (probably fresh install)

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/aiccu/+bug/1718227/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : 

[Kernel-packages] [Bug 1855177] Re: QEMU emulated nvdimm regions alignment need (128MB) or ndctl create-namespace namespace1.0 might fail

2019-12-07 Thread Rafael David Tinoco
You have to make sure to set the label size as the same size as the
minimum alignment required. For QEMU emulation I found it to be 2M, and,
in this case, you can correctly work with 2 or more nvdimms. With proper
alignment, you can also re-create namespaces - of other mode like devdax
or fsdax - if you already have a namespace working.

Example:



  
$_nvpath1
  
  
1048576
0

  2048

  
  



  
$_nvpath2
  
  
1048576
1

  2048

  
  


So I'm closing this as NOT A BUG as the alignment can be configured
accordingly.

For other examples you can check autopkgtests being proposed as a merge
request at:

https://bugs.launchpad.net/ubuntu/+source/ndctl/+bug/1853506

** Changed in: ndctl (Ubuntu Focal)
   Status: Confirmed => Invalid

** Changed in: qemu (Ubuntu Focal)
   Status: Confirmed => Invalid

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1855177

Title:
  QEMU emulated nvdimm regions alignment need (128MB) or ndctl create-
  namespace namespace1.0 might fail

Status in linux package in Ubuntu:
  Fix Released
Status in ndctl package in Ubuntu:
  Invalid
Status in qemu package in Ubuntu:
  Invalid
Status in linux source package in Focal:
  Fix Released
Status in ndctl source package in Focal:
  Invalid
Status in qemu source package in Focal:
  Invalid

Bug description:
  I got a probe error for pfn1.0 (from both pfn0.0 and pfn1.0) when
  dealing with ndctl:

  
  [11257.765457] memory add fail, invalid altmap
  [11257.765489] WARNING: CPU: 6 PID: 5680 at arch/x86/mm/init_64.c:852 
add_pages+0x5d/0x70
  [11257.765489] Modules linked in: nls_iso8859_1 edac_mce_amd crct10dif_pclmul 
crc32_pclmul dax_pmem_compat device_dax dax_pmem_core nd_pmem nd_btt 
ghash_clmulni_intel aesni_intel aes_x86_64 crypto_simd cryptd glue_helper 
input_leds joydev mac_hid nfit serio_raw qemu_fw_cfg sch_fq_codel ip_tables 
x_tables autofs4 virtio_net net_failover psmouse failover pata_acpi virtio_blk 
i2c_piix4 floppy
  [11257.765505] CPU: 6 PID: 5680 Comm: ndctl Not tainted 5.3.0-24-generic 
#26-Ubuntu
  [11257.765505] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 
1.12.0-1 04/01/2014
  [11257.765507] RIP: 0010:add_pages+0x5d/0x70
  [11257.765509] Code: 33 c2 01 76 20 48 89 15 99 33 c2 01 48 89 15 a2 33 c2 01 
48 c1 e2 0c 48 03 15 97 96 39 01 48 89 15 48 0e c2 01 5b 41 5c 5d c3 <0f> 0b eb 
ba 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44
  [11257.765509] RSP: 0018:a360c09dfbf0 EFLAGS: 00010282
  [11257.765510] RAX: ffea RBX: 0017ffe0 RCX: 

  [11257.765511] RDX:  RSI: 8acb7db17448 RDI: 
8acb7db17448
  [11257.765512] RBP: a360c09dfc00 R08: 8acb7db17448 R09: 
0004
  [11257.765512] R10:  R11: 0001 R12: 
0003fe20
  [11257.765513] R13: 0001 R14: a360c09dfc48 R15: 
8acb7a7226f8
  [11257.765515] FS:  7febc9fd6bc0() GS:8acb7db0() 
knlGS:
  [11257.765516] CS:  0010 DS:  ES:  CR0: 80050033
  [11257.765517] CR2: 55eec8aab398 CR3: 00013a8fa000 CR4: 
000406e0
  [11257.765519] Call Trace:
  [11257.765523]  arch_add_memory+0x41/0x50
  [11257.765525]  devm_memremap_pages+0x47c/0x640
  [11257.765529]  pmem_attach_disk+0x173/0x610 [nd_pmem]
  [11257.765531]  ? devm_memremap+0x67/0xa0
  [11257.765532]  nd_pmem_probe+0x7f/0xa0 [nd_pmem]
  [11257.765542]  nvdimm_bus_probe+0x6b/0x170
  [11257.765547]  really_probe+0xfb/0x3a0
  [11257.765549]  driver_probe_device+0x5f/0xe0
  [11257.765550]  device_driver_attach+0x5d/0x70
  [11257.765551]  bind_store+0xd3/0x110
  [11257.765553]  drv_attr_store+0x24/0x30
  [11257.765554]  sysfs_kf_write+0x3e/0x50
  [11257.76]  kernfs_fop_write+0x11e/0x1a0
  [11257.765557]  __vfs_write+0x1b/0x40
  [11257.765558]  vfs_write+0xb9/0x1a0
  [11257.765559]  ksys_write+0x67/0xe0
  [11257.765561]  __x64_sys_write+0x1a/0x20
  [11257.765567]  do_syscall_64+0x5a/0x130
  [11257.765693]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
  [11257.765696] RIP: 0033:0x7febc9e81327
  [11257.765698] Code: 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 
f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 01 00 00 00 0f 05 <48> 3d 00 
f0 ff ff 77 51 c3 48 83 ec 28 48 89 54 24 18 48 89 74 24
  [11257.765698] RSP: 002b:7ffd599433f8 EFLAGS: 0246 ORIG_RAX: 
0001
  [11257.765699] RAX: ffda RBX: 7febc9fd6ae8 RCX: 
7febc9e81327
  [11257.765700] RDX: 0007 RSI: 55eec8a9bfa0 RDI: 
0004
  [11257.765701] RBP: 0004 R08: 0006 R09: 
7375622f7379732f
  [11257.765701] R10:  R11: 0246 R12: 
55eec8a9bfa0
  [11257.765702] R13: 

[Kernel-packages] [Bug 1855177] Re: QEMU emulated nvdimm regions alignment need (128MB) or ndctl create-namespace namespace1.0 might fail

2019-12-05 Thread Rafael David Tinoco
>From comment #5, i was able to make changes persistent with
access='shared':


  
/tmp/.nbdpath1.2898617
  
  
1048576
0

  256

  
  


so now backing files are updated (and can even be shared among 2 vms).

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1855177

Title:
  QEMU emulated nvdimm regions alignment need (128MB) or ndctl create-
  namespace namespace1.0 might fail

Status in linux package in Ubuntu:
  Fix Released
Status in ndctl package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  Confirmed
Status in linux source package in Focal:
  Fix Released
Status in ndctl source package in Focal:
  Confirmed
Status in qemu source package in Focal:
  Confirmed

Bug description:
  I got a probe error for pfn1.0 (from both pfn0.0 and pfn1.0) when
  dealing with ndctl:

  
  [11257.765457] memory add fail, invalid altmap
  [11257.765489] WARNING: CPU: 6 PID: 5680 at arch/x86/mm/init_64.c:852 
add_pages+0x5d/0x70
  [11257.765489] Modules linked in: nls_iso8859_1 edac_mce_amd crct10dif_pclmul 
crc32_pclmul dax_pmem_compat device_dax dax_pmem_core nd_pmem nd_btt 
ghash_clmulni_intel aesni_intel aes_x86_64 crypto_simd cryptd glue_helper 
input_leds joydev mac_hid nfit serio_raw qemu_fw_cfg sch_fq_codel ip_tables 
x_tables autofs4 virtio_net net_failover psmouse failover pata_acpi virtio_blk 
i2c_piix4 floppy
  [11257.765505] CPU: 6 PID: 5680 Comm: ndctl Not tainted 5.3.0-24-generic 
#26-Ubuntu
  [11257.765505] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 
1.12.0-1 04/01/2014
  [11257.765507] RIP: 0010:add_pages+0x5d/0x70
  [11257.765509] Code: 33 c2 01 76 20 48 89 15 99 33 c2 01 48 89 15 a2 33 c2 01 
48 c1 e2 0c 48 03 15 97 96 39 01 48 89 15 48 0e c2 01 5b 41 5c 5d c3 <0f> 0b eb 
ba 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44
  [11257.765509] RSP: 0018:a360c09dfbf0 EFLAGS: 00010282
  [11257.765510] RAX: ffea RBX: 0017ffe0 RCX: 

  [11257.765511] RDX:  RSI: 8acb7db17448 RDI: 
8acb7db17448
  [11257.765512] RBP: a360c09dfc00 R08: 8acb7db17448 R09: 
0004
  [11257.765512] R10:  R11: 0001 R12: 
0003fe20
  [11257.765513] R13: 0001 R14: a360c09dfc48 R15: 
8acb7a7226f8
  [11257.765515] FS:  7febc9fd6bc0() GS:8acb7db0() 
knlGS:
  [11257.765516] CS:  0010 DS:  ES:  CR0: 80050033
  [11257.765517] CR2: 55eec8aab398 CR3: 00013a8fa000 CR4: 
000406e0
  [11257.765519] Call Trace:
  [11257.765523]  arch_add_memory+0x41/0x50
  [11257.765525]  devm_memremap_pages+0x47c/0x640
  [11257.765529]  pmem_attach_disk+0x173/0x610 [nd_pmem]
  [11257.765531]  ? devm_memremap+0x67/0xa0
  [11257.765532]  nd_pmem_probe+0x7f/0xa0 [nd_pmem]
  [11257.765542]  nvdimm_bus_probe+0x6b/0x170
  [11257.765547]  really_probe+0xfb/0x3a0
  [11257.765549]  driver_probe_device+0x5f/0xe0
  [11257.765550]  device_driver_attach+0x5d/0x70
  [11257.765551]  bind_store+0xd3/0x110
  [11257.765553]  drv_attr_store+0x24/0x30
  [11257.765554]  sysfs_kf_write+0x3e/0x50
  [11257.76]  kernfs_fop_write+0x11e/0x1a0
  [11257.765557]  __vfs_write+0x1b/0x40
  [11257.765558]  vfs_write+0xb9/0x1a0
  [11257.765559]  ksys_write+0x67/0xe0
  [11257.765561]  __x64_sys_write+0x1a/0x20
  [11257.765567]  do_syscall_64+0x5a/0x130
  [11257.765693]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
  [11257.765696] RIP: 0033:0x7febc9e81327
  [11257.765698] Code: 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 
f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 01 00 00 00 0f 05 <48> 3d 00 
f0 ff ff 77 51 c3 48 83 ec 28 48 89 54 24 18 48 89 74 24
  [11257.765698] RSP: 002b:7ffd599433f8 EFLAGS: 0246 ORIG_RAX: 
0001
  [11257.765699] RAX: ffda RBX: 7febc9fd6ae8 RCX: 
7febc9e81327
  [11257.765700] RDX: 0007 RSI: 55eec8a9bfa0 RDI: 
0004
  [11257.765701] RBP: 0004 R08: 0006 R09: 
7375622f7379732f
  [11257.765701] R10:  R11: 0246 R12: 
55eec8a9bfa0
  [11257.765702] R13: 0001 R14: 0007 R15: 
7ffd59943448
  [11257.765703] ---[ end trace 442db04e33790cb5 ]---
  [11257.782659] nd_pmem: probe of pfn1.0 failed with error -22
  

  It seems that after this point I can't play with my second virtual
  nvdimm device (pfn1.0).

  A namespace destroy works but a namespace creation does not:

  rafaeldtinoco@ndctltest:~$ sudo ndctl list -B
  [
{
  "provider":"ACPI.NFIT",
  "dev":"ndbus0"
}
  ]

  rafaeldtinoco@ndctltest:~$ sudo ndctl list -D
  [
{
  "dev":"nmem1",
  "id":"8680-57341200",
  "handle":2,
  "phys_id":0
},
{
  "dev":"nmem0",
  "id":"8680-56341200",
  

[Kernel-packages] [Bug 1855177] Re: qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

2019-12-05 Thread Rafael David Tinoco
This way more complex than I thought and its not so easy to address.
Lets see if I can summarize the issue here. Whenever developing the
regressions tests for ndctl, it occurred to me the same backtrace, over
and over, when realizing the tests:


[  271.705646] memory add fail, invalid altmap
[  271.705677] WARNING: CPU: 5 PID: 886 at arch/x86/mm/init_64.c:852 
add_pages+0x5d/0x70
[  271.705679] Modules linked in: nls_iso8859_1 edac_mce_amd dax_pmem_compat 
nd_pmem device_dax nd_btt dax_pmem_core crct10dif_pclmul crc32_pclmul 
ghash_clmulni_intel joydev aesni_intel aes_x86_64 crypto_simd input_leds cryptd 
glue_helper serio_raw mac_hid qemu_fw_cfg nfit sch_fq_codel ip_tables x_tables 
autofs4 virtio_net psmouse net_failover virtio_blk i2c_piix4 failover pata_acpi 
floppy
[  271.705707] CPU: 5 PID: 886 Comm: ndctl Not tainted 5.3.0-24-generic 
#26-Ubuntu
[  271.705709] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 
1.12.0-1 04/01/2014
[  271.705720] RIP: 0010:add_pages+0x5d/0x70
[  271.705721] Code: 33 c2 01 76 20 48 89 15 99 33 c2 01 48 89 15 a2 33 c2 01 
48 c1 e2 0c 48 03 15 97 96 39 01 48 89 15 48 0e c2 01 5b 41 5c 5d c3 <0f> 0b eb 
ba 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44
[  271.705722] RSP: 0018:ba02c0d2bbf0 EFLAGS: 00010282
[  271.705723] RAX: ffea RBX: 0017ffc0 RCX: 
[  271.705723] RDX:  RSI: 9aaa3da97448 RDI: 9aaa3da97448
[  271.705724] RBP: ba02c0d2bc00 R08: 9aaa3da97448 R09: 0004
[  271.705724] R10:  R11: 0001 R12: 0003fe40
[  271.705725] R13: 0001 R14: ba02c0d2bc48 R15: 9aa975efaaf8
[  271.705727] FS:  7f70a62d4bc0() GS:9aaa3da8() 
knlGS:
[  271.705728] CS:  0010 DS:  ES:  CR0: 80050033
[  271.705729] CR2: 5594a0aaa158 CR3: 00013811 CR4: 000406e0
[  271.705731] Call Trace:
[  271.705734]  arch_add_memory+0x41/0x50
[  271.705737]  devm_memremap_pages+0x47c/0x640
[  271.705740]  pmem_attach_disk+0x173/0x610 [nd_pmem]
[  271.705741]  ? devm_memremap+0x67/0xa0
[  271.705743]  nd_pmem_probe+0x7f/0xa0 [nd_pmem]
[  271.705745]  nvdimm_bus_probe+0x6b/0x170
[  271.705747]  really_probe+0xfb/0x3a0
[  271.705749]  driver_probe_device+0x5f/0xe0
[  271.705750]  device_driver_attach+0x5d/0x70
[  271.705751]  bind_store+0xd3/0x110
[  271.705753]  drv_attr_store+0x24/0x30
[  271.705754]  sysfs_kf_write+0x3e/0x50
[  271.705755]  kernfs_fop_write+0x11e/0x1a0
[  271.705757]  __vfs_write+0x1b/0x40
[  271.705758]  vfs_write+0xb9/0x1a0
[  271.705759]  ksys_write+0x67/0xe0
[  271.705760]  __x64_sys_write+0x1a/0x20
[  271.705762]  do_syscall_64+0x5a/0x130
[  271.705764]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  271.705765] RIP: 0033:0x7f70a6189327
[  271.705767] Code: 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 
f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 01 00 00 00 0f 05 <48> 3d 00 
f0 ff ff 77 51 c3 48 83 ec 28 48 89 54 24 18 48 89 74 24
[  271.705767] RSP: 002b:7ffc616998b8 EFLAGS: 0246 ORIG_RAX: 
0001
[  271.705768] RAX: ffda RBX: 7f70a62d4ae8 RCX: 7f70a6189327
[  271.705769] RDX: 0007 RSI: 5594a0aa01a0 RDI: 0006
[  271.705769] RBP: 0006 R08: 0006 R09: 7375622f7379732f
[  271.705770] R10:  R11: 0246 R12: 5594a0aa01a0
[  271.705770] R13: 0001 R14: 0007 R15: 7ffc61699908
[  271.705772] ---[ end trace 7ee621e68332018c ]---


And I realized that I could NOT re-generate the SECOND namespace (the
first one always worked). First I had to read about how qemu emulated
nvdimms and check why namespaces were not persistent on qemu nvdimms
emulation, then I had to discover why it looked like virtual nvdimms had
no labels (as RAW namespaces are always created by default) and then I
had to understand why the mapping was failing, to realize the real
issue.

First things first.

### QEMU emulated nvdimms:

https://github.com/qemu/qemu/blob/master/docs/nvdimm.txt

Whenever backing filesystems are not DAX capable (on a REAL NVDIMM HW,
for example) then after the instance is shutdown all nvdimm data
(written to the backing files) are gone.

### QEMU virtual nvdimms lack of labels:

Label
-

QEMU v2.7.0 and later implement the label support for vNVDIMM devices.
To enable label on vNVDIMM devices, users can simply add
"label-size=$SZ" option to "-device nvdimm", e.g.

 -device nvdimm,id=nvdimm1,memdev=mem1,label-size=128K

Note:

1. The minimal label size is 128KB.

2. QEMU v2.7.0 and later store labels at the end of backend storage.
   If a memory backend file, which was previously used as the backend
   of a vNVDIMM device without labels, is now used for a vNVDIMM
   device with label, the data in the label area at the end of file
   will be inaccessible to the guest. If any useful data (e.g. the
   meta-data of 

[Kernel-packages] [Bug 1855177] Re: QEMU emulated nvdimm regions alignment need (128MB) or ndctl create-namespace namespace1.0 might fail

2019-12-05 Thread Rafael David Tinoco
The Linux Kernel fix is here:

commit 274b924088e9
Author: Jeff Moyer 
Date:   Wed Aug 28 12:49:46 2019

libnvdimm/pfn: Fix namespace creation on misaligned addresses

Yi reported[1] that after commit a3619190d62e ("libnvdimm/pfn: stop
padding pmem namespaces to section alignment"), it was no longer
possible to create a device dax namespace with a 1G alignment.  The
reason was that the pmem region was not itself 1G-aligned.  The code
happily skips past the first 512M, but fails to account for a now
misaligned end offset (since space was allocated starting at that
misaligned address, and extending for size GBs).  Reintroduce
end_trunc, so that the code correctly handles the misaligned end
address.  This results in the same behavior as before the introduction
of the offending commit.

[1] https://lists.01.org/pipermail/linux-nvdimm/2019-July/022813.html

Fixes: a3619190d62e ("libnvdimm/pfn: stop padding pmem namespaces ...")
Reported-and-tested-by: Yi Zhang 
Signed-off-by: Jeff Moyer 
Link: 
https://lore.kernel.org/r/x49ftll8f39@segfault.boston.devel.redhat.com
Signed-off-by: Dan Williams 

So marking kernel as Fix Released (as this is included in Focal).


** Also affects: qemu (Ubuntu Focal)
   Importance: Medium
   Status: Confirmed

** Also affects: linux (Ubuntu Focal)
   Importance: Medium
   Status: Fix Released

** Also affects: ndctl (Ubuntu Focal)
   Importance: Medium
   Status: Confirmed

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1855177

Title:
  QEMU emulated nvdimm regions alignment need (128MB) or ndctl create-
  namespace namespace1.0 might fail

Status in linux package in Ubuntu:
  Fix Released
Status in ndctl package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  Confirmed
Status in linux source package in Focal:
  Fix Released
Status in ndctl source package in Focal:
  Confirmed
Status in qemu source package in Focal:
  Confirmed

Bug description:
  I got a probe error for pfn1.0 (from both pfn0.0 and pfn1.0) when
  dealing with ndctl:

  
  [11257.765457] memory add fail, invalid altmap
  [11257.765489] WARNING: CPU: 6 PID: 5680 at arch/x86/mm/init_64.c:852 
add_pages+0x5d/0x70
  [11257.765489] Modules linked in: nls_iso8859_1 edac_mce_amd crct10dif_pclmul 
crc32_pclmul dax_pmem_compat device_dax dax_pmem_core nd_pmem nd_btt 
ghash_clmulni_intel aesni_intel aes_x86_64 crypto_simd cryptd glue_helper 
input_leds joydev mac_hid nfit serio_raw qemu_fw_cfg sch_fq_codel ip_tables 
x_tables autofs4 virtio_net net_failover psmouse failover pata_acpi virtio_blk 
i2c_piix4 floppy
  [11257.765505] CPU: 6 PID: 5680 Comm: ndctl Not tainted 5.3.0-24-generic 
#26-Ubuntu
  [11257.765505] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 
1.12.0-1 04/01/2014
  [11257.765507] RIP: 0010:add_pages+0x5d/0x70
  [11257.765509] Code: 33 c2 01 76 20 48 89 15 99 33 c2 01 48 89 15 a2 33 c2 01 
48 c1 e2 0c 48 03 15 97 96 39 01 48 89 15 48 0e c2 01 5b 41 5c 5d c3 <0f> 0b eb 
ba 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44
  [11257.765509] RSP: 0018:a360c09dfbf0 EFLAGS: 00010282
  [11257.765510] RAX: ffea RBX: 0017ffe0 RCX: 

  [11257.765511] RDX:  RSI: 8acb7db17448 RDI: 
8acb7db17448
  [11257.765512] RBP: a360c09dfc00 R08: 8acb7db17448 R09: 
0004
  [11257.765512] R10:  R11: 0001 R12: 
0003fe20
  [11257.765513] R13: 0001 R14: a360c09dfc48 R15: 
8acb7a7226f8
  [11257.765515] FS:  7febc9fd6bc0() GS:8acb7db0() 
knlGS:
  [11257.765516] CS:  0010 DS:  ES:  CR0: 80050033
  [11257.765517] CR2: 55eec8aab398 CR3: 00013a8fa000 CR4: 
000406e0
  [11257.765519] Call Trace:
  [11257.765523]  arch_add_memory+0x41/0x50
  [11257.765525]  devm_memremap_pages+0x47c/0x640
  [11257.765529]  pmem_attach_disk+0x173/0x610 [nd_pmem]
  [11257.765531]  ? devm_memremap+0x67/0xa0
  [11257.765532]  nd_pmem_probe+0x7f/0xa0 [nd_pmem]
  [11257.765542]  nvdimm_bus_probe+0x6b/0x170
  [11257.765547]  really_probe+0xfb/0x3a0
  [11257.765549]  driver_probe_device+0x5f/0xe0
  [11257.765550]  device_driver_attach+0x5d/0x70
  [11257.765551]  bind_store+0xd3/0x110
  [11257.765553]  drv_attr_store+0x24/0x30
  [11257.765554]  sysfs_kf_write+0x3e/0x50
  [11257.76]  kernfs_fop_write+0x11e/0x1a0
  [11257.765557]  __vfs_write+0x1b/0x40
  [11257.765558]  vfs_write+0xb9/0x1a0
  [11257.765559]  ksys_write+0x67/0xe0
  [11257.765561]  __x64_sys_write+0x1a/0x20
  [11257.765567]  do_syscall_64+0x5a/0x130
  [11257.765693]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
  [11257.765696] RIP: 0033:0x7febc9e81327
  [11257.765698] Code: 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 
f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 

[Kernel-packages] [Bug 1855177] Re: qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

2019-12-05 Thread Rafael David Tinoco
** No longer affects: linux (Ubuntu Focal)

** Also affects: ndctl (Ubuntu)
   Importance: Undecided
   Status: New

** Changed in: ndctl (Ubuntu)
   Status: New => Confirmed

** Changed in: qemu (Ubuntu Focal)
   Status: Invalid => Confirmed

** Changed in: linux (Ubuntu)
   Status: Invalid => Confirmed

** No longer affects: qemu (Ubuntu Focal)

** Changed in: ndctl (Ubuntu)
   Importance: Undecided => Medium

** Changed in: linux (Ubuntu)
   Importance: Low => Medium

** Changed in: qemu (Ubuntu)
   Importance: Low => Medium

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1855177

Title:
  qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

Status in linux package in Ubuntu:
  Confirmed
Status in ndctl package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  Confirmed

Bug description:
  I got a probe error for pfn1.0 (from both pfn0.0 and pfn1.0) when
  dealing with ndctl:

  
  [11257.765457] memory add fail, invalid altmap
  [11257.765489] WARNING: CPU: 6 PID: 5680 at arch/x86/mm/init_64.c:852 
add_pages+0x5d/0x70
  [11257.765489] Modules linked in: nls_iso8859_1 edac_mce_amd crct10dif_pclmul 
crc32_pclmul dax_pmem_compat device_dax dax_pmem_core nd_pmem nd_btt 
ghash_clmulni_intel aesni_intel aes_x86_64 crypto_simd cryptd glue_helper 
input_leds joydev mac_hid nfit serio_raw qemu_fw_cfg sch_fq_codel ip_tables 
x_tables autofs4 virtio_net net_failover psmouse failover pata_acpi virtio_blk 
i2c_piix4 floppy
  [11257.765505] CPU: 6 PID: 5680 Comm: ndctl Not tainted 5.3.0-24-generic 
#26-Ubuntu
  [11257.765505] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 
1.12.0-1 04/01/2014
  [11257.765507] RIP: 0010:add_pages+0x5d/0x70
  [11257.765509] Code: 33 c2 01 76 20 48 89 15 99 33 c2 01 48 89 15 a2 33 c2 01 
48 c1 e2 0c 48 03 15 97 96 39 01 48 89 15 48 0e c2 01 5b 41 5c 5d c3 <0f> 0b eb 
ba 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44
  [11257.765509] RSP: 0018:a360c09dfbf0 EFLAGS: 00010282
  [11257.765510] RAX: ffea RBX: 0017ffe0 RCX: 

  [11257.765511] RDX:  RSI: 8acb7db17448 RDI: 
8acb7db17448
  [11257.765512] RBP: a360c09dfc00 R08: 8acb7db17448 R09: 
0004
  [11257.765512] R10:  R11: 0001 R12: 
0003fe20
  [11257.765513] R13: 0001 R14: a360c09dfc48 R15: 
8acb7a7226f8
  [11257.765515] FS:  7febc9fd6bc0() GS:8acb7db0() 
knlGS:
  [11257.765516] CS:  0010 DS:  ES:  CR0: 80050033
  [11257.765517] CR2: 55eec8aab398 CR3: 00013a8fa000 CR4: 
000406e0
  [11257.765519] Call Trace:
  [11257.765523]  arch_add_memory+0x41/0x50
  [11257.765525]  devm_memremap_pages+0x47c/0x640
  [11257.765529]  pmem_attach_disk+0x173/0x610 [nd_pmem]
  [11257.765531]  ? devm_memremap+0x67/0xa0
  [11257.765532]  nd_pmem_probe+0x7f/0xa0 [nd_pmem]
  [11257.765542]  nvdimm_bus_probe+0x6b/0x170
  [11257.765547]  really_probe+0xfb/0x3a0
  [11257.765549]  driver_probe_device+0x5f/0xe0
  [11257.765550]  device_driver_attach+0x5d/0x70
  [11257.765551]  bind_store+0xd3/0x110
  [11257.765553]  drv_attr_store+0x24/0x30
  [11257.765554]  sysfs_kf_write+0x3e/0x50
  [11257.76]  kernfs_fop_write+0x11e/0x1a0
  [11257.765557]  __vfs_write+0x1b/0x40
  [11257.765558]  vfs_write+0xb9/0x1a0
  [11257.765559]  ksys_write+0x67/0xe0
  [11257.765561]  __x64_sys_write+0x1a/0x20
  [11257.765567]  do_syscall_64+0x5a/0x130
  [11257.765693]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
  [11257.765696] RIP: 0033:0x7febc9e81327
  [11257.765698] Code: 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 
f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 01 00 00 00 0f 05 <48> 3d 00 
f0 ff ff 77 51 c3 48 83 ec 28 48 89 54 24 18 48 89 74 24
  [11257.765698] RSP: 002b:7ffd599433f8 EFLAGS: 0246 ORIG_RAX: 
0001
  [11257.765699] RAX: ffda RBX: 7febc9fd6ae8 RCX: 
7febc9e81327
  [11257.765700] RDX: 0007 RSI: 55eec8a9bfa0 RDI: 
0004
  [11257.765701] RBP: 0004 R08: 0006 R09: 
7375622f7379732f
  [11257.765701] R10:  R11: 0246 R12: 
55eec8a9bfa0
  [11257.765702] R13: 0001 R14: 0007 R15: 
7ffd59943448
  [11257.765703] ---[ end trace 442db04e33790cb5 ]---
  [11257.782659] nd_pmem: probe of pfn1.0 failed with error -22
  

  It seems that after this point I can't play with my second virtual
  nvdimm device (pfn1.0).

  A namespace destroy works but a namespace creation does not:

  rafaeldtinoco@ndctltest:~$ sudo ndctl list -B
  [
{
  "provider":"ACPI.NFIT",
  "dev":"ndbus0"
}
  ]

  rafaeldtinoco@ndctltest:~$ sudo ndctl list -D
  [
{
  "dev":"nmem1",
  "id":"8680-57341200",
  "handle":2,
  "phys_id":0
},
  

[Kernel-packages] [Bug 1855177] Re: qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

2019-12-04 Thread Rafael David Tinoco
Alright, if someone ever faces this, the label size can be the one to
blame.

Judging by the manual:

https://github.com/qemu/qemu/blob/master/docs/nvdimm.txt

Note:

1. The minimal label size is 128KB.

2. QEMU v2.7.0 and later store labels at the end of backend storage.
   If a memory backend file, which was previously used as the backend
   of a vNVDIMM device without labels, is now used for a vNVDIMM
   device with label, the data in the label area at the end of file
   will be inaccessible to the guest. If any useful data (e.g. the
   meta-data of the file system) was stored there, the latter usage
   may result guest data corruption (e.g. breakage of guest file
   system).

=> 128KB was not enough. Changing label area to 2MB "fixed" the issue.
Funny is that I'm not even trying to use labels, I'm using full regions
for namespaces BUT its likely that there is a single label in those
cases (being written at the end of backing files).

=> I was also truncating the backing files, now I'm creating full zeroed
files (I guess that for the MMIO nature of DAX & PMEM, having full files
is either better OR mandatory).

rafaeldtinoco@ndctltest:~$ sudo ndctl disable-namespace all
disabled 2 namespaces

rafaeldtinoco@ndctltest:~$ sudo ndctl create-namespace -v -r region1 -m fsdax 
{
  "dev":"namespace1.0",
  "mode":"fsdax",
  "map":"dev",
  "size":"1006.00 MiB (1054.87 MB)",
  "uuid":"51dec4e0-1414-418a-9263-6459d5c12194",
  "sector_size":512,
  "align":2097152,
  "blockdev":"pmem1"
}

rafaeldtinoco@ndctltest:~$ sudo ndctl create-namespace -v -r region0 -m fsdax 
{
  "dev":"namespace0.0",
  "mode":"fsdax",
  "map":"dev",
  "size":"1006.00 MiB (1054.87 MB)",
  "uuid":"33be9543-603c-4a7f-9f2d-98a3f3ff5ec0",
  "sector_size":512,
  "align":2097152,
  "blockdev":"pmem0"
}


** Changed in: linux (Ubuntu Focal)
   Status: Confirmed => Invalid

** Changed in: qemu (Ubuntu Focal)
   Status: Confirmed => Invalid

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1855177

Title:
  qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

Status in linux package in Ubuntu:
  Invalid
Status in qemu package in Ubuntu:
  Invalid
Status in linux source package in Focal:
  Invalid
Status in qemu source package in Focal:
  Invalid

Bug description:
  I got a probe error for pfn1.0 (from both pfn0.0 and pfn1.0) when
  dealing with ndctl:

  
  [11257.765457] memory add fail, invalid altmap
  [11257.765489] WARNING: CPU: 6 PID: 5680 at arch/x86/mm/init_64.c:852 
add_pages+0x5d/0x70
  [11257.765489] Modules linked in: nls_iso8859_1 edac_mce_amd crct10dif_pclmul 
crc32_pclmul dax_pmem_compat device_dax dax_pmem_core nd_pmem nd_btt 
ghash_clmulni_intel aesni_intel aes_x86_64 crypto_simd cryptd glue_helper 
input_leds joydev mac_hid nfit serio_raw qemu_fw_cfg sch_fq_codel ip_tables 
x_tables autofs4 virtio_net net_failover psmouse failover pata_acpi virtio_blk 
i2c_piix4 floppy
  [11257.765505] CPU: 6 PID: 5680 Comm: ndctl Not tainted 5.3.0-24-generic 
#26-Ubuntu
  [11257.765505] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 
1.12.0-1 04/01/2014
  [11257.765507] RIP: 0010:add_pages+0x5d/0x70
  [11257.765509] Code: 33 c2 01 76 20 48 89 15 99 33 c2 01 48 89 15 a2 33 c2 01 
48 c1 e2 0c 48 03 15 97 96 39 01 48 89 15 48 0e c2 01 5b 41 5c 5d c3 <0f> 0b eb 
ba 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44
  [11257.765509] RSP: 0018:a360c09dfbf0 EFLAGS: 00010282
  [11257.765510] RAX: ffea RBX: 0017ffe0 RCX: 

  [11257.765511] RDX:  RSI: 8acb7db17448 RDI: 
8acb7db17448
  [11257.765512] RBP: a360c09dfc00 R08: 8acb7db17448 R09: 
0004
  [11257.765512] R10:  R11: 0001 R12: 
0003fe20
  [11257.765513] R13: 0001 R14: a360c09dfc48 R15: 
8acb7a7226f8
  [11257.765515] FS:  7febc9fd6bc0() GS:8acb7db0() 
knlGS:
  [11257.765516] CS:  0010 DS:  ES:  CR0: 80050033
  [11257.765517] CR2: 55eec8aab398 CR3: 00013a8fa000 CR4: 
000406e0
  [11257.765519] Call Trace:
  [11257.765523]  arch_add_memory+0x41/0x50
  [11257.765525]  devm_memremap_pages+0x47c/0x640
  [11257.765529]  pmem_attach_disk+0x173/0x610 [nd_pmem]
  [11257.765531]  ? devm_memremap+0x67/0xa0
  [11257.765532]  nd_pmem_probe+0x7f/0xa0 [nd_pmem]
  [11257.765542]  nvdimm_bus_probe+0x6b/0x170
  [11257.765547]  really_probe+0xfb/0x3a0
  [11257.765549]  driver_probe_device+0x5f/0xe0
  [11257.765550]  device_driver_attach+0x5d/0x70
  [11257.765551]  bind_store+0xd3/0x110
  [11257.765553]  drv_attr_store+0x24/0x30
  [11257.765554]  sysfs_kf_write+0x3e/0x50
  [11257.76]  kernfs_fop_write+0x11e/0x1a0
  [11257.765557]  __vfs_write+0x1b/0x40
  [11257.765558]  vfs_write+0xb9/0x1a0
  [11257.765559]  ksys_write+0x67/0xe0
  [11257.765561]  

[Kernel-packages] [Bug 1855177] Re: qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

2019-12-04 Thread Rafael David Tinoco
Something else is wrong.. can't plan with the second nvdimm even after
re-creating the nvdimm backing files. I'm investigating.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1855177

Title:
  qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

Status in linux package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  Confirmed
Status in linux source package in Focal:
  Confirmed
Status in qemu source package in Focal:
  Confirmed

Bug description:
  I got a probe error for pfn1.0 (from both pfn0.0 and pfn1.0) when
  dealing with ndctl:

  
  [11257.765457] memory add fail, invalid altmap
  [11257.765489] WARNING: CPU: 6 PID: 5680 at arch/x86/mm/init_64.c:852 
add_pages+0x5d/0x70
  [11257.765489] Modules linked in: nls_iso8859_1 edac_mce_amd crct10dif_pclmul 
crc32_pclmul dax_pmem_compat device_dax dax_pmem_core nd_pmem nd_btt 
ghash_clmulni_intel aesni_intel aes_x86_64 crypto_simd cryptd glue_helper 
input_leds joydev mac_hid nfit serio_raw qemu_fw_cfg sch_fq_codel ip_tables 
x_tables autofs4 virtio_net net_failover psmouse failover pata_acpi virtio_blk 
i2c_piix4 floppy
  [11257.765505] CPU: 6 PID: 5680 Comm: ndctl Not tainted 5.3.0-24-generic 
#26-Ubuntu
  [11257.765505] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 
1.12.0-1 04/01/2014
  [11257.765507] RIP: 0010:add_pages+0x5d/0x70
  [11257.765509] Code: 33 c2 01 76 20 48 89 15 99 33 c2 01 48 89 15 a2 33 c2 01 
48 c1 e2 0c 48 03 15 97 96 39 01 48 89 15 48 0e c2 01 5b 41 5c 5d c3 <0f> 0b eb 
ba 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44
  [11257.765509] RSP: 0018:a360c09dfbf0 EFLAGS: 00010282
  [11257.765510] RAX: ffea RBX: 0017ffe0 RCX: 

  [11257.765511] RDX:  RSI: 8acb7db17448 RDI: 
8acb7db17448
  [11257.765512] RBP: a360c09dfc00 R08: 8acb7db17448 R09: 
0004
  [11257.765512] R10:  R11: 0001 R12: 
0003fe20
  [11257.765513] R13: 0001 R14: a360c09dfc48 R15: 
8acb7a7226f8
  [11257.765515] FS:  7febc9fd6bc0() GS:8acb7db0() 
knlGS:
  [11257.765516] CS:  0010 DS:  ES:  CR0: 80050033
  [11257.765517] CR2: 55eec8aab398 CR3: 00013a8fa000 CR4: 
000406e0
  [11257.765519] Call Trace:
  [11257.765523]  arch_add_memory+0x41/0x50
  [11257.765525]  devm_memremap_pages+0x47c/0x640
  [11257.765529]  pmem_attach_disk+0x173/0x610 [nd_pmem]
  [11257.765531]  ? devm_memremap+0x67/0xa0
  [11257.765532]  nd_pmem_probe+0x7f/0xa0 [nd_pmem]
  [11257.765542]  nvdimm_bus_probe+0x6b/0x170
  [11257.765547]  really_probe+0xfb/0x3a0
  [11257.765549]  driver_probe_device+0x5f/0xe0
  [11257.765550]  device_driver_attach+0x5d/0x70
  [11257.765551]  bind_store+0xd3/0x110
  [11257.765553]  drv_attr_store+0x24/0x30
  [11257.765554]  sysfs_kf_write+0x3e/0x50
  [11257.76]  kernfs_fop_write+0x11e/0x1a0
  [11257.765557]  __vfs_write+0x1b/0x40
  [11257.765558]  vfs_write+0xb9/0x1a0
  [11257.765559]  ksys_write+0x67/0xe0
  [11257.765561]  __x64_sys_write+0x1a/0x20
  [11257.765567]  do_syscall_64+0x5a/0x130
  [11257.765693]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
  [11257.765696] RIP: 0033:0x7febc9e81327
  [11257.765698] Code: 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 
f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 01 00 00 00 0f 05 <48> 3d 00 
f0 ff ff 77 51 c3 48 83 ec 28 48 89 54 24 18 48 89 74 24
  [11257.765698] RSP: 002b:7ffd599433f8 EFLAGS: 0246 ORIG_RAX: 
0001
  [11257.765699] RAX: ffda RBX: 7febc9fd6ae8 RCX: 
7febc9e81327
  [11257.765700] RDX: 0007 RSI: 55eec8a9bfa0 RDI: 
0004
  [11257.765701] RBP: 0004 R08: 0006 R09: 
7375622f7379732f
  [11257.765701] R10:  R11: 0246 R12: 
55eec8a9bfa0
  [11257.765702] R13: 0001 R14: 0007 R15: 
7ffd59943448
  [11257.765703] ---[ end trace 442db04e33790cb5 ]---
  [11257.782659] nd_pmem: probe of pfn1.0 failed with error -22
  

  It seems that after this point I can't play with my second virtual
  nvdimm device (pfn1.0).

  A namespace destroy works but a namespace creation does not:

  rafaeldtinoco@ndctltest:~$ sudo ndctl list -B
  [
{
  "provider":"ACPI.NFIT",
  "dev":"ndbus0"
}
  ]

  rafaeldtinoco@ndctltest:~$ sudo ndctl list -D
  [
{
  "dev":"nmem1",
  "id":"8680-57341200",
  "handle":2,
  "phys_id":0
},
{
  "dev":"nmem0",
  "id":"8680-56341200",
  "handle":1,
  "phys_id":0
}
  ]

  rafaeldtinoco@ndctltest:~$ sudo ndctl list -R
  [
{
  "dev":"region1",
  "size":1073610752,
  "available_size":1073610752,
  "max_available_extent":1073610752,
  "type":"pmem",
  "iset_id":52512795602891997,
  

[Kernel-packages] [Bug 1855177] Re: qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

2019-12-04 Thread Rafael David Tinoco
Even after restart the kernel module the error continues, suggesting the
emulation is likely the root cause.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1855177

Title:
  qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

Status in linux package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  Confirmed
Status in linux source package in Focal:
  Confirmed
Status in qemu source package in Focal:
  Confirmed

Bug description:
  I got a probe error for pfn1.0 (from both pfn0.0 and pfn1.0) when
  dealing with ndctl:

  
  [11257.765457] memory add fail, invalid altmap
  [11257.765489] WARNING: CPU: 6 PID: 5680 at arch/x86/mm/init_64.c:852 
add_pages+0x5d/0x70
  [11257.765489] Modules linked in: nls_iso8859_1 edac_mce_amd crct10dif_pclmul 
crc32_pclmul dax_pmem_compat device_dax dax_pmem_core nd_pmem nd_btt 
ghash_clmulni_intel aesni_intel aes_x86_64 crypto_simd cryptd glue_helper 
input_leds joydev mac_hid nfit serio_raw qemu_fw_cfg sch_fq_codel ip_tables 
x_tables autofs4 virtio_net net_failover psmouse failover pata_acpi virtio_blk 
i2c_piix4 floppy
  [11257.765505] CPU: 6 PID: 5680 Comm: ndctl Not tainted 5.3.0-24-generic 
#26-Ubuntu
  [11257.765505] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 
1.12.0-1 04/01/2014
  [11257.765507] RIP: 0010:add_pages+0x5d/0x70
  [11257.765509] Code: 33 c2 01 76 20 48 89 15 99 33 c2 01 48 89 15 a2 33 c2 01 
48 c1 e2 0c 48 03 15 97 96 39 01 48 89 15 48 0e c2 01 5b 41 5c 5d c3 <0f> 0b eb 
ba 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44
  [11257.765509] RSP: 0018:a360c09dfbf0 EFLAGS: 00010282
  [11257.765510] RAX: ffea RBX: 0017ffe0 RCX: 

  [11257.765511] RDX:  RSI: 8acb7db17448 RDI: 
8acb7db17448
  [11257.765512] RBP: a360c09dfc00 R08: 8acb7db17448 R09: 
0004
  [11257.765512] R10:  R11: 0001 R12: 
0003fe20
  [11257.765513] R13: 0001 R14: a360c09dfc48 R15: 
8acb7a7226f8
  [11257.765515] FS:  7febc9fd6bc0() GS:8acb7db0() 
knlGS:
  [11257.765516] CS:  0010 DS:  ES:  CR0: 80050033
  [11257.765517] CR2: 55eec8aab398 CR3: 00013a8fa000 CR4: 
000406e0
  [11257.765519] Call Trace:
  [11257.765523]  arch_add_memory+0x41/0x50
  [11257.765525]  devm_memremap_pages+0x47c/0x640
  [11257.765529]  pmem_attach_disk+0x173/0x610 [nd_pmem]
  [11257.765531]  ? devm_memremap+0x67/0xa0
  [11257.765532]  nd_pmem_probe+0x7f/0xa0 [nd_pmem]
  [11257.765542]  nvdimm_bus_probe+0x6b/0x170
  [11257.765547]  really_probe+0xfb/0x3a0
  [11257.765549]  driver_probe_device+0x5f/0xe0
  [11257.765550]  device_driver_attach+0x5d/0x70
  [11257.765551]  bind_store+0xd3/0x110
  [11257.765553]  drv_attr_store+0x24/0x30
  [11257.765554]  sysfs_kf_write+0x3e/0x50
  [11257.76]  kernfs_fop_write+0x11e/0x1a0
  [11257.765557]  __vfs_write+0x1b/0x40
  [11257.765558]  vfs_write+0xb9/0x1a0
  [11257.765559]  ksys_write+0x67/0xe0
  [11257.765561]  __x64_sys_write+0x1a/0x20
  [11257.765567]  do_syscall_64+0x5a/0x130
  [11257.765693]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
  [11257.765696] RIP: 0033:0x7febc9e81327
  [11257.765698] Code: 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 
f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 01 00 00 00 0f 05 <48> 3d 00 
f0 ff ff 77 51 c3 48 83 ec 28 48 89 54 24 18 48 89 74 24
  [11257.765698] RSP: 002b:7ffd599433f8 EFLAGS: 0246 ORIG_RAX: 
0001
  [11257.765699] RAX: ffda RBX: 7febc9fd6ae8 RCX: 
7febc9e81327
  [11257.765700] RDX: 0007 RSI: 55eec8a9bfa0 RDI: 
0004
  [11257.765701] RBP: 0004 R08: 0006 R09: 
7375622f7379732f
  [11257.765701] R10:  R11: 0246 R12: 
55eec8a9bfa0
  [11257.765702] R13: 0001 R14: 0007 R15: 
7ffd59943448
  [11257.765703] ---[ end trace 442db04e33790cb5 ]---
  [11257.782659] nd_pmem: probe of pfn1.0 failed with error -22
  

  It seems that after this point I can't play with my second virtual
  nvdimm device (pfn1.0).

  A namespace destroy works but a namespace creation does not:

  rafaeldtinoco@ndctltest:~$ sudo ndctl list -B
  [
{
  "provider":"ACPI.NFIT",
  "dev":"ndbus0"
}
  ]

  rafaeldtinoco@ndctltest:~$ sudo ndctl list -D
  [
{
  "dev":"nmem1",
  "id":"8680-57341200",
  "handle":2,
  "phys_id":0
},
{
  "dev":"nmem0",
  "id":"8680-56341200",
  "handle":1,
  "phys_id":0
}
  ]

  rafaeldtinoco@ndctltest:~$ sudo ndctl list -R
  [
{
  "dev":"region1",
  "size":1073610752,
  "available_size":1073610752,
  "max_available_extent":1073610752,
  "type":"pmem",
  "iset_id":52512795602891997,
  "persistence_domain":"unknown"
},
 

[Kernel-packages] [Bug 1855177] [NEW] qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

2019-12-04 Thread Rafael David Tinoco
Public bug reported:

I got a probe error for pfn1.0 (from both pfn0.0 and pfn1.0) when
dealing with ndctl:


[11257.765457] memory add fail, invalid altmap
[11257.765489] WARNING: CPU: 6 PID: 5680 at arch/x86/mm/init_64.c:852 
add_pages+0x5d/0x70
[11257.765489] Modules linked in: nls_iso8859_1 edac_mce_amd crct10dif_pclmul 
crc32_pclmul dax_pmem_compat device_dax dax_pmem_core nd_pmem nd_btt 
ghash_clmulni_intel aesni_intel aes_x86_64 crypto_simd cryptd glue_helper 
input_leds joydev mac_hid nfit serio_raw qemu_fw_cfg sch_fq_codel ip_tables 
x_tables autofs4 virtio_net net_failover psmouse failover pata_acpi virtio_blk 
i2c_piix4 floppy
[11257.765505] CPU: 6 PID: 5680 Comm: ndctl Not tainted 5.3.0-24-generic 
#26-Ubuntu
[11257.765505] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 
1.12.0-1 04/01/2014
[11257.765507] RIP: 0010:add_pages+0x5d/0x70
[11257.765509] Code: 33 c2 01 76 20 48 89 15 99 33 c2 01 48 89 15 a2 33 c2 01 
48 c1 e2 0c 48 03 15 97 96 39 01 48 89 15 48 0e c2 01 5b 41 5c 5d c3 <0f> 0b eb 
ba 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44
[11257.765509] RSP: 0018:a360c09dfbf0 EFLAGS: 00010282
[11257.765510] RAX: ffea RBX: 0017ffe0 RCX: 
[11257.765511] RDX:  RSI: 8acb7db17448 RDI: 8acb7db17448
[11257.765512] RBP: a360c09dfc00 R08: 8acb7db17448 R09: 0004
[11257.765512] R10:  R11: 0001 R12: 0003fe20
[11257.765513] R13: 0001 R14: a360c09dfc48 R15: 8acb7a7226f8
[11257.765515] FS:  7febc9fd6bc0() GS:8acb7db0() 
knlGS:
[11257.765516] CS:  0010 DS:  ES:  CR0: 80050033
[11257.765517] CR2: 55eec8aab398 CR3: 00013a8fa000 CR4: 000406e0
[11257.765519] Call Trace:
[11257.765523]  arch_add_memory+0x41/0x50
[11257.765525]  devm_memremap_pages+0x47c/0x640
[11257.765529]  pmem_attach_disk+0x173/0x610 [nd_pmem]
[11257.765531]  ? devm_memremap+0x67/0xa0
[11257.765532]  nd_pmem_probe+0x7f/0xa0 [nd_pmem]
[11257.765542]  nvdimm_bus_probe+0x6b/0x170
[11257.765547]  really_probe+0xfb/0x3a0
[11257.765549]  driver_probe_device+0x5f/0xe0
[11257.765550]  device_driver_attach+0x5d/0x70
[11257.765551]  bind_store+0xd3/0x110
[11257.765553]  drv_attr_store+0x24/0x30
[11257.765554]  sysfs_kf_write+0x3e/0x50
[11257.76]  kernfs_fop_write+0x11e/0x1a0
[11257.765557]  __vfs_write+0x1b/0x40
[11257.765558]  vfs_write+0xb9/0x1a0
[11257.765559]  ksys_write+0x67/0xe0
[11257.765561]  __x64_sys_write+0x1a/0x20
[11257.765567]  do_syscall_64+0x5a/0x130
[11257.765693]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[11257.765696] RIP: 0033:0x7febc9e81327
[11257.765698] Code: 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 
f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 01 00 00 00 0f 05 <48> 3d 00 
f0 ff ff 77 51 c3 48 83 ec 28 48 89 54 24 18 48 89 74 24
[11257.765698] RSP: 002b:7ffd599433f8 EFLAGS: 0246 ORIG_RAX: 
0001
[11257.765699] RAX: ffda RBX: 7febc9fd6ae8 RCX: 7febc9e81327
[11257.765700] RDX: 0007 RSI: 55eec8a9bfa0 RDI: 0004
[11257.765701] RBP: 0004 R08: 0006 R09: 7375622f7379732f
[11257.765701] R10:  R11: 0246 R12: 55eec8a9bfa0
[11257.765702] R13: 0001 R14: 0007 R15: 7ffd59943448
[11257.765703] ---[ end trace 442db04e33790cb5 ]---
[11257.782659] nd_pmem: probe of pfn1.0 failed with error -22


It seems that after this point I can't play with my second virtual
nvdimm device (pfn1.0).

A namespace destroy works but a namespace creation does not:

rafaeldtinoco@ndctltest:~$ sudo ndctl list -B
[
  {
"provider":"ACPI.NFIT",
"dev":"ndbus0"
  }
]

rafaeldtinoco@ndctltest:~$ sudo ndctl list -D
[
  {
"dev":"nmem1",
"id":"8680-57341200",
"handle":2,
"phys_id":0
  },
  {
"dev":"nmem0",
"id":"8680-56341200",
"handle":1,
"phys_id":0
  }
]

rafaeldtinoco@ndctltest:~$ sudo ndctl list -R
[
  {
"dev":"region1",
"size":1073610752,
"available_size":1073610752,
"max_available_extent":1073610752,
"type":"pmem",
"iset_id":52512795602891997,
"persistence_domain":"unknown"
  },
  {
"dev":"region0",
"size":1073610752,
"available_size":0,
"max_available_extent":0,
"type":"pmem",
"iset_id":52512752653219036,
"persistence_domain":"unknown"
  }
]

Now, whenever trying to access namespace1.0 (from region1/nmem1/ndbus) I
get:

[11257.782659] nd_pmem: probe of pfn1.0 failed with error -22
[11332.001388] pfn0.0 initialised, 257024 pages in 8ms
[11332.001818] pmem0: detected capacity change from 0 to 1052770304
[11359.739280] pfn0.1 initialised, 257024 pages in 0ms
[11362.643212] pfn0.0 initialised, 257024 pages in 0ms
[11362.644225] pmem0: detected capacity change from 0 to 1052770304
[11406.230365] pfn0.1 initialised, 257024 pages in 0ms
[11406.231281] pmem0: detected capacity 

[Kernel-packages] [Bug 1855177] Re: qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

2019-12-04 Thread Rafael David Tinoco
I'm reporting this because I'm not sure yet if its an emulation issue,
since all nvdimm device access I'm doing here is through QEMU emulation
feature, like showed here:

https://raw.githubusercontent.com/rafaeldtinoco/provision/master/kvm/libvirt/nvdimm.xml

or a kernel issue:

rafaeldtinoco@ndctltest:~$ uname -a
Linux ndctltest 5.3.0-24-generic #26-Ubuntu SMP Thu Nov 14 01:33:18 UTC 2019 
x86_64 x86_64 x86_64 GNU/Linux

rafaeldtinoco@ndctltest:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:Ubuntu Focal Fossa (development branch)
Release:20.04
Codename:   focal

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1855177

Title:
  qemu nvdimm virtualization + linux 5.3.0-24-generic kernel PROBE ERROR

Status in linux package in Ubuntu:
  Confirmed
Status in qemu package in Ubuntu:
  Confirmed
Status in linux source package in Focal:
  Confirmed
Status in qemu source package in Focal:
  Confirmed

Bug description:
  I got a probe error for pfn1.0 (from both pfn0.0 and pfn1.0) when
  dealing with ndctl:

  
  [11257.765457] memory add fail, invalid altmap
  [11257.765489] WARNING: CPU: 6 PID: 5680 at arch/x86/mm/init_64.c:852 
add_pages+0x5d/0x70
  [11257.765489] Modules linked in: nls_iso8859_1 edac_mce_amd crct10dif_pclmul 
crc32_pclmul dax_pmem_compat device_dax dax_pmem_core nd_pmem nd_btt 
ghash_clmulni_intel aesni_intel aes_x86_64 crypto_simd cryptd glue_helper 
input_leds joydev mac_hid nfit serio_raw qemu_fw_cfg sch_fq_codel ip_tables 
x_tables autofs4 virtio_net net_failover psmouse failover pata_acpi virtio_blk 
i2c_piix4 floppy
  [11257.765505] CPU: 6 PID: 5680 Comm: ndctl Not tainted 5.3.0-24-generic 
#26-Ubuntu
  [11257.765505] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 
1.12.0-1 04/01/2014
  [11257.765507] RIP: 0010:add_pages+0x5d/0x70
  [11257.765509] Code: 33 c2 01 76 20 48 89 15 99 33 c2 01 48 89 15 a2 33 c2 01 
48 c1 e2 0c 48 03 15 97 96 39 01 48 89 15 48 0e c2 01 5b 41 5c 5d c3 <0f> 0b eb 
ba 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44
  [11257.765509] RSP: 0018:a360c09dfbf0 EFLAGS: 00010282
  [11257.765510] RAX: ffea RBX: 0017ffe0 RCX: 

  [11257.765511] RDX:  RSI: 8acb7db17448 RDI: 
8acb7db17448
  [11257.765512] RBP: a360c09dfc00 R08: 8acb7db17448 R09: 
0004
  [11257.765512] R10:  R11: 0001 R12: 
0003fe20
  [11257.765513] R13: 0001 R14: a360c09dfc48 R15: 
8acb7a7226f8
  [11257.765515] FS:  7febc9fd6bc0() GS:8acb7db0() 
knlGS:
  [11257.765516] CS:  0010 DS:  ES:  CR0: 80050033
  [11257.765517] CR2: 55eec8aab398 CR3: 00013a8fa000 CR4: 
000406e0
  [11257.765519] Call Trace:
  [11257.765523]  arch_add_memory+0x41/0x50
  [11257.765525]  devm_memremap_pages+0x47c/0x640
  [11257.765529]  pmem_attach_disk+0x173/0x610 [nd_pmem]
  [11257.765531]  ? devm_memremap+0x67/0xa0
  [11257.765532]  nd_pmem_probe+0x7f/0xa0 [nd_pmem]
  [11257.765542]  nvdimm_bus_probe+0x6b/0x170
  [11257.765547]  really_probe+0xfb/0x3a0
  [11257.765549]  driver_probe_device+0x5f/0xe0
  [11257.765550]  device_driver_attach+0x5d/0x70
  [11257.765551]  bind_store+0xd3/0x110
  [11257.765553]  drv_attr_store+0x24/0x30
  [11257.765554]  sysfs_kf_write+0x3e/0x50
  [11257.76]  kernfs_fop_write+0x11e/0x1a0
  [11257.765557]  __vfs_write+0x1b/0x40
  [11257.765558]  vfs_write+0xb9/0x1a0
  [11257.765559]  ksys_write+0x67/0xe0
  [11257.765561]  __x64_sys_write+0x1a/0x20
  [11257.765567]  do_syscall_64+0x5a/0x130
  [11257.765693]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
  [11257.765696] RIP: 0033:0x7febc9e81327
  [11257.765698] Code: 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 
f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 01 00 00 00 0f 05 <48> 3d 00 
f0 ff ff 77 51 c3 48 83 ec 28 48 89 54 24 18 48 89 74 24
  [11257.765698] RSP: 002b:7ffd599433f8 EFLAGS: 0246 ORIG_RAX: 
0001
  [11257.765699] RAX: ffda RBX: 7febc9fd6ae8 RCX: 
7febc9e81327
  [11257.765700] RDX: 0007 RSI: 55eec8a9bfa0 RDI: 
0004
  [11257.765701] RBP: 0004 R08: 0006 R09: 
7375622f7379732f
  [11257.765701] R10:  R11: 0246 R12: 
55eec8a9bfa0
  [11257.765702] R13: 0001 R14: 0007 R15: 
7ffd59943448
  [11257.765703] ---[ end trace 442db04e33790cb5 ]---
  [11257.782659] nd_pmem: probe of pfn1.0 failed with error -22
  

  It seems that after this point I can't play with my second virtual
  nvdimm device (pfn1.0).

  A namespace destroy works but a namespace creation does not:

  rafaeldtinoco@ndctltest:~$ sudo ndctl list -B
  [
{
  "provider":"ACPI.NFIT",
  "dev":"ndbus0"
}
  ]

  

[Kernel-packages] [Bug 1811785] Re: NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

2019-11-25 Thread Rafael David Tinoco
TODOs in this bug:

- End user must confirm the issue is still reproducible and test PPA package
- Mark the case as Confirmed again (instead of Incomplete)
- From that point, the SRU would continue (merge requests already present in 
this bug)
- Patches would be sent out to kernel team for inclusion in the next SRU

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1811785

Title:
  NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

Status in ndctl:
  Fix Released
Status in linux package in Ubuntu:
  Fix Released
Status in ndctl package in Ubuntu:
  Fix Released
Status in ndctl source package in Bionic:
  Incomplete
Status in ndctl source package in Disco:
  Incomplete
Status in ndctl source package in Eoan:
  Fix Released

Bug description:
  On ubuntu 18.04.1 :

  1°) With 4.15.0-43 two default namespaces in raw mode are visible
  while there shouldn't be any but no settings change could be applied.

  root@server:~# ndctl list -R
  [
{
  "dev":"region1",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":1,
  "persistence_domain":"unknown"
},
{
  "dev":"region0",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":0,
  "persistence_domain":"unknown"
}
  ]

  root@server:~# ndctl list
  [
{
  "dev":"namespace1.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem1",
  "numa_node":1
},
{
  "dev":"namespace0.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem0",
  "numa_node":0
}
  ]

  root@server:~# ndctl create-namespace --reconfig=namespace1.0 --type=pmem 
--mode=sector -f
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem6: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem6: label area (1024) too small to host 
(256 byte) labels
 

[Kernel-packages] [Bug 1811785] Re: NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

2019-11-25 Thread Rafael David Tinoco
The kernel issue pointed at the github was solved by:

commit cbaee3aa0e23
Author: Dan Williams 
Date:   Thu Feb 7 20:56:50 2019

acpi/nfit: Fix bus command validation

BugLink: https://bugs.launchpad.net/bugs/1821607

in kernel: Ubuntu-5.0.0-9.10 (Disco)

AND

commit 3b8d3410b3d8
Author: Dan Williams 
Date:   Thu Feb 7 20:56:50 2019

acpi/nfit: Fix bus command validation

BugLink: https://bugs.launchpad.net/bugs/1837952

commit ebe9f6f19d80d8978d16078dff3d5bd93ad8d102 upstream.

in kernel: Ubuntu-4.15.0-59.66 (Bionic)

So kernel part is good (or kind of.. actually it is missing 2 fixes
on top of that):



TODO: KERNEL TEAM SHOULD BACKPORT THIS TO BIONIC AND DISCO:

commit ebe9f6f19d80
Author: Dan Williams 
Date:   Thu Feb 7 20:56:50 2019

acpi/nfit: Fix bus command validation

Fixes: 11189c1089da ("acpi/nfit: Fix command-supported detection")

commit 0171b6b78131
Author: Dan Williams 
Date:   Sun Feb 3 17:17:27 2019

acpi/nfit: Require opt-in for read-only label configurations

Fixes: 11189c1089da ("acpi/nfit: Fix command-supported detection")

TO FIX THE ISSUE'S FIX

-

TODO: FEEDBACK ABOUT PROPOSED USERLAND FIX

and the userland fix was, indeed, the ndctl patch I did a SRU for.

UNFORTUNATELY I can't reproduce the issue with QEMU. I have tried
different label sizes in multiple attempts and wasn't able to cause the
labeling error (making sure it was fixed). With that it is hard for me
to guarantee the fix is good and I'll depend on a feedback from
reporter.

There is a PPA in comment #19 containing the fix. I'll flag this case as
incomplete while I have no feedback, as we wouldn't be able to verify
the fix in order for it to land -updates archive.

Nevertheless, documentation here might be important to others, in order
to understand the errors.

** Changed in: linux (Ubuntu)
   Status: Invalid => Fix Released

** Changed in: ndctl (Ubuntu Bionic)
 Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

** Changed in: ndctl (Ubuntu Disco)
     Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

** Changed in: ndctl (Ubuntu Bionic)
   Status: In Progress => Incomplete

** Changed in: ndctl (Ubuntu Disco)
   Status: In Progress => Incomplete

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1811785

Title:
  NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

Status in ndctl:
  Fix Released
Status in linux package in Ubuntu:
  Fix Released
Status in ndctl package in Ubuntu:
  Fix Released
Status in ndctl source package in Bionic:
  Incomplete
Status in ndctl source package in Disco:
  Incomplete
Status in ndctl source package in Eoan:
  Fix Released

Bug description:
  On ubuntu 18.04.1 :

  1°) With 4.15.0-43 two default namespaces in raw mode are visible
  while there shouldn't be any but no settings change could be applied.

  root@server:~# ndctl list -R
  [
{
  "dev":"region1",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":1,
  "persistence_domain":"unknown"
},
{
  "dev":"region0",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":0,
  "persistence_domain":"unknown"
}
  ]

  root@server:~# ndctl list
  [
{
  "dev":"namespace1.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem1",
  "numa_node":1
},
{
  "dev":"namespace0.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem0",
  "numa_node":0
}
  ]

  root@server:~# ndctl create-namespace --reconfig=namespace1.0 --type=pmem 
--mode=sector -f
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) label

[Kernel-packages] [Bug 1811785] Re: NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

2019-11-22 Thread Rafael David Tinoco
Hello Torel and Juliet,

If possible, could you please test the PPA above with either Bionic
and/or Disco and make sure the packages fix the issue ? I'm preparing
bdctl to be in "main" pocket for 20.04:

https://bugs.launchpad.net/ubuntu/+source/ndctl/+bug/1853506

and having this case fix would help to get traction in the MIR (main
inclusion request).

Thank you very much for reporting this and contributing to Ubuntu.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1811785

Title:
  NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

Status in ndctl:
  Fix Released
Status in linux package in Ubuntu:
  Invalid
Status in ndctl package in Ubuntu:
  Fix Released
Status in ndctl source package in Bionic:
  In Progress
Status in ndctl source package in Disco:
  In Progress
Status in ndctl source package in Eoan:
  Fix Released

Bug description:
  On ubuntu 18.04.1 :

  1°) With 4.15.0-43 two default namespaces in raw mode are visible
  while there shouldn't be any but no settings change could be applied.

  root@server:~# ndctl list -R
  [
{
  "dev":"region1",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":1,
  "persistence_domain":"unknown"
},
{
  "dev":"region0",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":0,
  "persistence_domain":"unknown"
}
  ]

  root@server:~# ndctl list
  [
{
  "dev":"namespace1.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem1",
  "numa_node":1
},
{
  "dev":"namespace0.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem0",
  "numa_node":0
}
  ]

  root@server:~# ndctl create-namespace --reconfig=namespace1.0 --type=pmem 
--mode=sector -f
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem6: label area (1024) too small to host 
(256 byte) 

[Kernel-packages] [Bug 1811785] Re: NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

2019-11-22 Thread Rafael David Tinoco
** Changed in: ndctl (Ubuntu Bionic)
   Status: Confirmed => In Progress

** Changed in: ndctl (Ubuntu Disco)
   Status: Confirmed => In Progress

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1811785

Title:
  NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

Status in ndctl:
  Fix Released
Status in linux package in Ubuntu:
  Invalid
Status in ndctl package in Ubuntu:
  Fix Released
Status in ndctl source package in Bionic:
  In Progress
Status in ndctl source package in Disco:
  In Progress
Status in ndctl source package in Eoan:
  Fix Released

Bug description:
  On ubuntu 18.04.1 :

  1°) With 4.15.0-43 two default namespaces in raw mode are visible
  while there shouldn't be any but no settings change could be applied.

  root@server:~# ndctl list -R
  [
{
  "dev":"region1",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":1,
  "persistence_domain":"unknown"
},
{
  "dev":"region0",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":0,
  "persistence_domain":"unknown"
}
  ]

  root@server:~# ndctl list
  [
{
  "dev":"namespace1.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem1",
  "numa_node":1
},
{
  "dev":"namespace0.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem0",
  "numa_node":0
}
  ]

  root@server:~# ndctl create-namespace --reconfig=namespace1.0 --type=pmem 
--mode=sector -f
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem6: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem6: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem6: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem6: label area (1024) too 

[Kernel-packages] [Bug 1811785] Re: NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

2019-11-22 Thread Rafael David Tinoco
A PPA containing the fixes (Disco and Bionic) will be available here:

https://launchpad.net/~rafaeldtinoco/+archive/ubuntu/lp1811785

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1811785

Title:
  NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

Status in ndctl:
  Fix Released
Status in linux package in Ubuntu:
  Invalid
Status in ndctl package in Ubuntu:
  Fix Released
Status in ndctl source package in Bionic:
  Confirmed
Status in ndctl source package in Disco:
  Confirmed
Status in ndctl source package in Eoan:
  Fix Released

Bug description:
  On ubuntu 18.04.1 :

  1°) With 4.15.0-43 two default namespaces in raw mode are visible
  while there shouldn't be any but no settings change could be applied.

  root@server:~# ndctl list -R
  [
{
  "dev":"region1",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":1,
  "persistence_domain":"unknown"
},
{
  "dev":"region0",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":0,
  "persistence_domain":"unknown"
}
  ]

  root@server:~# ndctl list
  [
{
  "dev":"namespace1.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem1",
  "numa_node":1
},
{
  "dev":"namespace0.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem0",
  "numa_node":0
}
  ]

  root@server:~# ndctl create-namespace --reconfig=namespace1.0 --type=pmem 
--mode=sector -f
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem9: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem6: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem6: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem6: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem6: label area (1024) too small to host 
(256 byte) 

[Kernel-packages] [Bug 1811785] Re: NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

2019-11-22 Thread Rafael David Tinoco
libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to
host (256 byte) labels

This issue is fixed by:

commit 9c6aae5
Author: Dan Williams 
Date:   Tue Jan 15 01:51:45 2019

ndctl/init-labels: Fix label slot accounting per UEFI 2.7

Quoting from Linux kernel commit 9e694d9c18dd "libnvdimm, label: change
nvdimm_num_label_slots per UEFI 2.7":

sizeof_namespace_index() fails when NVDIMM devices have the minimum
1024 bytes label storage area.  nvdimm_num_label_slots() returns 3
slots while the area is only big enough for 2 slots.

Change nvdimm_num_label_slots() to calculate a number of label slots
according to UEFI 2.7 spec.

Without this fix attempts to initialize labels on a small (1K) label
area results in the following:

libndctl: sizeof_namespace_index: nmem2: label area (1024) too small to 
host (128 byte) labels
libndctl: sizeof_namespace_index: nmem2: label area (1024) too small to 
host (256 byte) labels

Based on an original patch by Toshi Kani
Fixes: bdaec95463ca ("ndctl: introduce 
ndctl_dimm_{validate_labels,init_labels}")
Reported-by: Sujith Pandel 
Link: https://github.com/pmem/ndctl/issues/78
Signed-off-by: Dan Williams 
Signed-off-by: Vishal Verma 

Upstream.

** Changed in: linux (Ubuntu)
   Status: Confirmed => Invalid

** Changed in: ndctl (Ubuntu)
   Importance: Undecided => Medium

** Changed in: ndctl (Ubuntu)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1811785

Title:
  NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

Status in ndctl:
  Fix Released
Status in linux package in Ubuntu:
  Invalid
Status in ndctl package in Ubuntu:
  Fix Released
Status in ndctl source package in Bionic:
  Confirmed
Status in ndctl source package in Disco:
  Confirmed
Status in ndctl source package in Eoan:
  Fix Released

Bug description:
  On ubuntu 18.04.1 :

  1°) With 4.15.0-43 two default namespaces in raw mode are visible
  while there shouldn't be any but no settings change could be applied.

  root@server:~# ndctl list -R
  [
{
  "dev":"region1",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":1,
  "persistence_domain":"unknown"
},
{
  "dev":"region0",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":0,
  "persistence_domain":"unknown"
}
  ]

  root@server:~# ndctl list
  [
{
  "dev":"namespace1.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem1",
  "numa_node":1
},
{
  "dev":"namespace0.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem0",
  "numa_node":0
}
  ]

  root@server:~# ndctl create-namespace --reconfig=namespace1.0 --type=pmem 
--mode=sector -f
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: n

[Kernel-packages] [Bug 1811785] Re: NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

2019-11-22 Thread Rafael David Tinoco
It fixes an issue introduced by :

Patch: bdaec95463ca

In version v58

And the fix (9c6aae5) was introduced in v64.

$ rmadison ndctl

 ndctl | 61.2-0ubuntu1~18.04.1 | bionic-updates/universe | source, amd64
 ndctl | 63-1.3| disco/universe  | source, amd64, 
arm64, armhf, i386, ppc64el, s390x
 ndctl | 65-1  | eoan/universe   | source, amd64, 
arm64, armhf, i386, ppc64el, s390x
 ndctl | 67-1  | focal/universe  | source, amd64, 
arm64, armhf, i386, ppc64el, s390x

Bionic and Disco are affected.

** Also affects: linux (Ubuntu Bionic)
   Importance: Undecided
   Status: New

** Also affects: ndctl (Ubuntu Bionic)
   Importance: Undecided
   Status: New

** Also affects: linux (Ubuntu Eoan)
   Importance: Undecided
   Status: New

** Also affects: ndctl (Ubuntu Eoan)
   Importance: Undecided
   Status: New

** Also affects: linux (Ubuntu Disco)
   Importance: Undecided
   Status: New

** Also affects: ndctl (Ubuntu Disco)
   Importance: Undecided
   Status: New

** No longer affects: linux (Ubuntu Bionic)

** No longer affects: linux (Ubuntu Disco)

** No longer affects: linux (Ubuntu Eoan)

** Changed in: ndctl (Ubuntu)
   Status: Confirmed => Fix Released

** Changed in: ndctl (Ubuntu Eoan)
   Status: New => Fix Released

** Changed in: ndctl (Ubuntu Disco)
   Status: New => Confirmed

** Changed in: ndctl (Ubuntu Bionic)
   Status: New => Confirmed

** Changed in: ndctl (Ubuntu)
     Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

** Changed in: ndctl (Ubuntu Bionic)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

** Changed in: ndctl (Ubuntu Disco)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

** Changed in: ndctl (Ubuntu)
   Importance: Medium => Undecided

** Changed in: ndctl (Ubuntu Disco)
   Importance: Undecided => Medium

** Changed in: ndctl (Ubuntu Bionic)
   Importance: Undecided => Medium

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1811785

Title:
  NVDIMM-N doesn't work properly on Dell EMC PowerEdge R840

Status in ndctl:
  Fix Released
Status in linux package in Ubuntu:
  Invalid
Status in ndctl package in Ubuntu:
  Fix Released
Status in ndctl source package in Bionic:
  Confirmed
Status in ndctl source package in Disco:
  Confirmed
Status in ndctl source package in Eoan:
  Fix Released

Bug description:
  On ubuntu 18.04.1 :

  1°) With 4.15.0-43 two default namespaces in raw mode are visible
  while there shouldn't be any but no settings change could be applied.

  root@server:~# ndctl list -R
  [
{
  "dev":"region1",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":1,
  "persistence_domain":"unknown"
},
{
  "dev":"region0",
  "size":103079215104,
  "available_size":0,
  "type":"pmem",
  "numa_node":0,
  "persistence_domain":"unknown"
}
  ]

  root@server:~# ndctl list
  [
{
  "dev":"namespace1.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem1",
  "numa_node":1
},
{
  "dev":"namespace0.0",
  "mode":"raw",
  "size":103079215104,
  "sector_size":512,
  "blockdev":"pmem0",
  "numa_node":0
}
  ]

  root@server:~# ndctl create-namespace --reconfig=namespace1.0 --type=pmem 
--mode=sector -f
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem10: label area (1024) too small to host 
(256 byte) labels
  libndctl: sizeof_namespace_index: nmem7: label area (1024) too small to host 
(256 b

[Kernel-packages] [Bug 1847948] Re: Improve NVMe guest performance on Bionic QEMU

2019-10-25 Thread Rafael David Tinoco
After reading this:

 * I know, one could as well call that a "feature", but it really is a
   performance bug fix more than anything else. Also the SRU policy allows
   exploitation/toleration of new HW especially for LTS releases.
   Therefore I think this is fine as SRU.

I'm okay with that interpretation also. My doubt is about allowing
userspace to map the MSI-X table, which is not currently allowed.

Actually ... it would be allowed and it would have an "undefined
behavior" because of the sparse feature. So, perhaps you're right and it
could be seen as a fix both ways: fixing undefined behavior and allowing
the MSI-X table to be mmaped, which will allow better performance for
QEMU.

After re-thinking, I'm +1 on the backport for Bionic Kernel also if
others agree.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1847948

Title:
  Improve NVMe guest performance on Bionic QEMU

Status in The Ubuntu-power-systems project:
  Triaged
Status in linux package in Ubuntu:
  Fix Released
Status in qemu package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  Won't Fix
Status in qemu source package in Bionic:
  Triaged

Bug description:
  [Impact]

   * In the past qemu has generally not allowd MSI-X BAR mapping on VFIO.
     But there can be platforms (like ppc64 spapr) that can and want to do
     exactly that.

   * Backport two patches from upstream (in since qemu 2.12 / Disco).

   * Due to that there is a tremendous speedup, especially useful with page
     size bigger than 4k. This avoids that being split into chunks and makes
     direct MMIO access possible for the guest.

  [Test Case]

   * On ppc64 pass through an NVME device to the guest and run I/O
     benchmarks, see below for Details how to set that up.
     Note: this needs the HWE kernel or another kernel fixup for [1].
 Note: the test should also be done with the non-HWE kernel, the 
 expectation there is that it would not show the perf benefits, but 
 still work fine

  [Regression Potential]

   * Changes:
     a) if the host driver allows mapping of MSI-X data the entire BAR is
    mapped. This is only done if the kernel reports that capability [1].
    This ensures that only on kernels able to do so qemu does expose the
    new behavior (safe against regression in that regard)
     b) on ppc64 MSI-X emulation is disabled for VFIO devices this is local
    to just this HW and will not affect other HW.

     Generally the regressions that come to mind are slight changes in
     behavior (real HW vs the former emulation) that on some weird/old
     guests could cause trouble. But then it is limited to only PPC where
     only a small set of certified HW is really allowed.

     The mapping that might be added even on other platforms should not
     consume too much extra memory as long as it isn't used. Further since
     it depends on the kernel capability it isn't randomly issues on kernels
     where we expect it to fail.

     So while it is quite a change, it seems safe to me.

  [Other Info]

   * I know, one could as well call that a "feature", but it really is a
     performance bug fix more than anything else. Also the SRU policy allows
     exploitation/toleration of new HW especially for LTS releases.
     Therefore I think this is fine as SRU.

  [1]:
  
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=a32295c612c57990d17fb0f41e7134394b2f35f6

  == Comment: #0 - Murilo Opsfelder Araujo  - 2019-10-11 14:16:14 ==

  ---Problem Description---
  Back-port the following patches to Bionic QEMU to improve NVMe guest 
performance by more than 200%:

  ?vfio-pci: Allow mmap of MSIX BAR?
  
https://git.qemu.org/?p=qemu.git;a=commit;h=ae0215b2bb56a9d5321a185dde133bfdd306a4c0

  ?ppc/spapr, vfio: Turn off MSIX emulation for VFIO devices?
  
https://git.qemu.org/?p=qemu.git;a=commit;h=fcad0d2121976df4b422b4007a5eb7fcaac01134

  ---uname output---
  na

  ---Additional Hardware Info---
  0030:01:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe 
SSD Controller 172Xa/172Xb (rev 01)

  Machine Type = AC922

  ---Debugger---
  A debugger is not configured

  ---Steps to Reproduce---
   Install or setup a guest image and boot it.

  Once guest is running, passthrough the NVMe disk to the guest using
  the XML:

  host$ cat nvme-disk.xml
  
     
  
  
  
  

  host$ virsh attach-device  nvme-disk.xml --live

  On the guest, run fio benchmarks:

  guest$ fio --direct=1 --rw=randrw --refill_buffers --norandommap
  --randrepeat=0 --ioengine=libaio --bs=4k --rwmixread=100 --iodepth=16
  --runtime=60 --name=job1 --filename=/dev/nvme0n1 --numjobs=4

  Results are similar with numjobs=4 and numjobs=64, respectively:

     READ: bw=385MiB/s (404MB/s), 78.0MiB/s-115MiB/s (81.8MB/s-120MB/s), 
io=11.3GiB (12.1GB), run=30001-30001msec
     

[Kernel-packages] [Bug 1847948] Re: Improve NVMe guest performance on Bionic QEMU

2019-10-25 Thread Rafael David Tinoco
Agreed on Frank's last comment.

commit a32295c612c57990d17fb0f41e7134394b2f35f6
Author: Alexey Kardashevskiy 
Date:   Wed Dec 13 00:31:31 2017

vfio-pci: Allow mapping MSIX BAR

By default VFIO disables mapping of MSIX BAR to the userspace as
the userspace may program it in a way allowing spurious interrupts;
instead the userspace uses the VFIO_DEVICE_SET_IRQS ioctl.
In order to eliminate guessing from the userspace about what is
mmapable, VFIO also advertises a sparse list of regions allowed to mmap.

This works fine as long as the system page size equals to the MSIX
alignment requirement which is 4KB. However with a bigger page size
the existing code prohibits mapping non-MSIX parts of a page with MSIX
structures so these parts have to be emulated via slow reads/writes on
a VFIO device fd. If these emulated bits are accessed often, this has
serious impact on performance.

This allows mmap of the entire BAR containing MSIX vector table.

This removes the sparse capability for PCI devices as it becomes useless.

As the userspace needs to know for sure whether mmapping of the MSIX
vector containing data can succeed, this adds a new capability -
VFIO_REGION_INFO_CAP_MSIX_MAPPABLE - which explicitly tells the userspace
that the entire BAR can be mmapped.

This does not touch the MSIX mangling in the BAR read/write handlers as
we are doing this just to enable direct access to non MSIX registers.

Signed-off-by: Alexey Kardashevskiy 
[aw - fixup whitespace, trim function name]
Signed-off-by: Alex Williamson 

Seems a case for HWE kernels.

** Changed in: linux (Ubuntu Bionic)
   Status: New => Won't Fix

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1847948

Title:
  Improve NVMe guest performance on Bionic QEMU

Status in The Ubuntu-power-systems project:
  Triaged
Status in linux package in Ubuntu:
  Fix Released
Status in qemu package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  Won't Fix
Status in qemu source package in Bionic:
  Triaged

Bug description:
  [Impact]

   * In the past qemu has generally not allowd MSI-X BAR mapping on VFIO.
     But there can be platforms (like ppc64 spapr) that can and want to do
     exactly that.

   * Backport two patches from upstream (in since qemu 2.12 / Disco).

   * Due to that there is a tremendous speedup, especially useful with page
     size bigger than 4k. This avoids that being split into chunks and makes
     direct MMIO access possible for the guest.

  [Test Case]

   * On ppc64 pass through an NVME device to the guest and run I/O
     benchmarks, see below for Details how to set that up.
     Note: this needs the HWE kernel or another kernel fixup for [1].
 Note: the test should also be done with the non-HWE kernel, the 
 expectation there is that it would not show the perf benefits, but 
 still work fine

  [Regression Potential]

   * Changes:
     a) if the host driver allows mapping of MSI-X data the entire BAR is
    mapped. This is only done if the kernel reports that capability [1].
    This ensures that only on kernels able to do so qemu does expose the
    new behavior (safe against regression in that regard)
     b) on ppc64 MSI-X emulation is disabled for VFIO devices this is local
    to just this HW and will not affect other HW.

     Generally the regressions that come to mind are slight changes in
     behavior (real HW vs the former emulation) that on some weird/old
     guests could cause trouble. But then it is limited to only PPC where
     only a small set of certified HW is really allowed.

     The mapping that might be added even on other platforms should not
     consume too much extra memory as long as it isn't used. Further since
     it depends on the kernel capability it isn't randomly issues on kernels
     where we expect it to fail.

     So while it is quite a change, it seems safe to me.

  [Other Info]

   * I know, one could as well call that a "feature", but it really is a
     performance bug fix more than anything else. Also the SRU policy allows
     exploitation/toleration of new HW especially for LTS releases.
     Therefore I think this is fine as SRU.

  [1]:
  
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=a32295c612c57990d17fb0f41e7134394b2f35f6

  == Comment: #0 - Murilo Opsfelder Araujo  - 2019-10-11 14:16:14 ==

  ---Problem Description---
  Back-port the following patches to Bionic QEMU to improve NVMe guest 
performance by more than 200%:

  ?vfio-pci: Allow mmap of MSIX BAR?
  
https://git.qemu.org/?p=qemu.git;a=commit;h=ae0215b2bb56a9d5321a185dde133bfdd306a4c0

  ?ppc/spapr, vfio: Turn off MSIX emulation for VFIO devices?
  

[Kernel-packages] [Bug 1828495] Re: [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

2019-10-22 Thread Rafael David Tinoco
For the Kernel Support:

---

commit 28c1c9fabf48d6ad596273a11c46e0d0da3e14cd
Author: KarimAllah Ahmed 
Date:   Thu Feb 1 19:59:44 2018

KVM/VMX: Emulate MSR_IA32_ARCH_CAPABILITIES

Disco: OK - https://bugs.launchpad.net/bugs/1823060
Bionic: OK - https://bugs.launchpad.net/bugs/1838116

-

commit 801e459a6f3a63af9d447e6249088c76ae16efc4
Author: Tom Lendacky 
Date:   Wed Feb 21 16:39:51 2018

KVM: x86: Add a framework for supporting MSR-based features

Disco: OK
Bionic: OK - since Ubuntu-4.15.0-32.34

-

commit 772439717dbf703b39990be58d8d4e3e4ad0598a
Author: Konrad Rzeszutek Wilk 
Date:   Wed Apr 25 23:04:22 2018

x86/bugs/intel: Set proper CPU features and setup RDS

Disco: OK
Bionic: OK - since Ubuntu-4.15.0-22.24

-

commit 9f65fb29374ee37856dbad847b4e121aab72b510
Author: Konrad Rzeszutek Wilk 
Date:   Wed May 9 16:41:38 2018

x86/bugs: Rename _RDS to _SSBD

Disco: OK
Bionic: OK - since Ubuntu-4.15.0-22.24

-

commit 1eaafe91a0df4157521b6417b3dd8430bf5f52f0
Author: Jim Mattson 
Date:   Wed May 9 18:29:35 2018

kvm: x86: IA32_ARCH_CAPABILITIES is always supported

Disco: OK
Bionic: OK - http://bugs.launchpad.net/bugs/1786352

-

commit cd28325249a1ca0d771557ce823e0308ad629f98
Author: Paolo Bonzini 
Date:   Mon Jun 25 09:04:37 2018

KVM: VMX: support MSR_IA32_ARCH_CAPABILITIES as a feature MSR

Disco: OK
Bionic: OK - since Ubuntu-4.15.0-32.34

-

commit 0cf9135b773bf32fba9dd8e6699c1b331ee4b749
Author: Sean Christopherson 
Date:   Thu Mar 7 20:43:02 2019

KVM: x86: Emulate MSR_IA32_ARCH_CAPABILITIES on AMD hosts
   
Disco: OK - https://bugs.launchpad.net/bugs/1823060
Bionic: OK - https://bugs.launchpad.net/bugs/1838116

-

commit 2bdb76c015df7125783d8394d6339d181cb5bc30
Author: Xiaoyao Li 
Date:   Fri Mar 8 04:57:20 2019

kvm/x86: Move MSR_IA32_ARCH_CAPABILITIES to array emulated_msrs

Disco: OK - https://bugs.launchpad.net/bugs/1830934
Bionic: Missing - Possibly no need

---

I believe we're all set. I'll have to test in CascadeLake machine to
make though.

** Changed in: linux (Ubuntu Bionic)
   Status: Confirmed => Fix Released

** Changed in: linux (Ubuntu Disco)
   Status: Confirmed => Fix Released

** Changed in: linux (Ubuntu Eoan)
   Status: In Progress => Fix Released

** Changed in: linux (Ubuntu)
   Status: In Progress => Fix Released

** Changed in: intel
   Status: New => Fix Released

** Changed in: intel
   Importance: Undecided => Wishlist

** Changed in: libvirt (Ubuntu Disco)
     Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

** Changed in: linux (Ubuntu)
 Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

** Changed in: linux (Ubuntu Eoan)
     Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1828495

Title:
  [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

Status in intel:
  Fix Released
Status in libvirt package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  Fix Released
Status in qemu package in Ubuntu:
  Fix Released
Status in libvirt source package in Bionic:
  Won't Fix
Status in linux source package in Bionic:
  Fix Released
Status in qemu source package in Bionic:
  Fix Released
Status in libvirt source package in Disco:
  Won't Fix
Status in linux source package in Disco:
  Fix Released
Status in qemu source package in Disco:
  Fix Released
Status in libvirt source package in Eoan:
  Fix Released
Status in linux source package in Eoan:
  Fix Released
Status in qemu source package in Eoan:
  Fix Released

Bug description:
  [Impact]

   * QEMU does not support IceLake and CascadeLake CPUs specific features.
   * Most important feature to be supported is: IA32_ARCH_CAPABILITIES MSR.
   * With IA32_ARCH_CAPABILITIES, QEMU is able to advertise HW mitigations:
 - Rogue Data Cache Load
 - Enhanced IBRS
 - RSB Alternate
 - L1D flush need on VMENTRY
 - speculative Store Bypass
 to guests, as described in document:
 Intel 336996-Speculative-Execution-Side-Channel-Mitigations.pdf

  [Test Case]

   * From Original Description:

  """
  1. Boot up guest using: -cpu Cascadelake-Server

  [root@clx-2s2 yexin]# qemu-system-x86_64 -accel kvm -drive
  if=virtio,id=hd,file=/home/x/x,format=qcow2  -m 4096 -smp 4 -cpu
  Cascadelake-Server -serial stdio

  char device redirected to /dev/pts/3 (label serial0)

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  2. To che

[Kernel-packages] [Bug 1828495] Re: [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

2019-10-22 Thread Rafael David Tinoco
+1 on your summary, looks very good.

I will review kernel changes (if they are present or not) and change
status accordingly.

+1 on the team update.

o/

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1828495

Title:
  [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

Status in intel:
  New
Status in libvirt package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  In Progress
Status in qemu package in Ubuntu:
  Fix Released
Status in libvirt source package in Bionic:
  Won't Fix
Status in linux source package in Bionic:
  Confirmed
Status in qemu source package in Bionic:
  Fix Released
Status in libvirt source package in Disco:
  Won't Fix
Status in linux source package in Disco:
  Confirmed
Status in qemu source package in Disco:
  Fix Released
Status in libvirt source package in Eoan:
  Fix Released
Status in linux source package in Eoan:
  In Progress
Status in qemu source package in Eoan:
  Fix Released

Bug description:
  [Impact]

   * QEMU does not support IceLake and CascadeLake CPUs specific features.
   * Most important feature to be supported is: IA32_ARCH_CAPABILITIES MSR.
   * With IA32_ARCH_CAPABILITIES, QEMU is able to advertise HW mitigations:
 - Rogue Data Cache Load
 - Enhanced IBRS
 - RSB Alternate
 - L1D flush need on VMENTRY
 - speculative Store Bypass
 to guests, as described in document:
 Intel 336996-Speculative-Execution-Side-Channel-Mitigations.pdf

  [Test Case]

   * From Original Description:

  """
  1. Boot up guest using: -cpu Cascadelake-Server

  [root@clx-2s2 yexin]# qemu-system-x86_64 -accel kvm -drive
  if=virtio,id=hd,file=/home/x/x,format=qcow2  -m 4096 -smp 4 -cpu
  Cascadelake-Server -serial stdio

  char device redirected to /dev/pts/3 (label serial0)

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  2. To check CPU ID related to features[FEAT_7_0_EDX]
  :CPUID_7_0_EDX_ARCH_CAPABILITIES

  Expected Result: Both host and guest's CPUID.07H EDX bit 29 should be
  1.

  Actual Result:

  Host's cpuid: 0x0007 0x00: eax=0x ebx=0xd39b
  ecx=0x0818 edx=0xbc00  (EDX bit 29=1)

  Guest's cpuid : 0x0007 0x00: eax=0x ebx=0xd19f0fb9
  ecx=0x0818 edx=0x8400 (EDX bit 29=0)

  Commit:2bdb76c015df7125783d8394d6339d181cb5bc30

  Target Kerned: 5.1
  Target Release: 19.10

  """

  [Regression Potential]

   * Most changes are related to CPU type definitions and its supported
  features. They are all based in upstream changes but, for obvious
  reasons, backporting and/or cherry-picking those could bring issues.
  Biggest concern is breaking something that currently works. Right now,
  the parts being changed that could affect other CPU types would be
  related to a small refactoring of how the features are organized, and
  that would be seen right away when trying to start a new VM after the
  package is installed.

   * Other tests, related to the features being backported, are being
  done by our KVM regression tests, including migration combinations, to
  reduce chances that a regression is introduced.

  [Other Info]
   
   * N/A

To manage notifications about this bug go to:
https://bugs.launchpad.net/intel/+bug/1828495/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1828495] Re: [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

2019-10-21 Thread Rafael David Tinoco
via a CPU model) was disabled by QEMU for some reason.
Because this could break migration, snapshots, and save/restore
operaions, it's better to just forbid any use of MSR features with QEMU
which lacks "unavailable-features" CPU property.

Signed-off-by: Jiri Denemark 
Reviewed-by: Ján Tomko 

commit 2674d00ed484091faf2b6e6b1efe58ee9a72b96b
Author: Jiri Denemark 
Date:   Wed Jun 19 17:22:09 2019

qemu: Drop MSR features from host-model with old QEMU

With QEMU versions which lack "unavailable-features" we use CPUID based
detection of features which were enabled or disabled once QEMU starts.
Thus using MSR features with host-model would result in all of them
being marked as disabled in the active domain definition even though
QEMU did not actually disable them.

Let's make sure we add MSR features to host-model only when
"unavailable-features" property is supported by QEMU.

Signed-off-by: Jiri Denemark 
Reviewed-by: Ján Tomko 

and possibly many others as dependencies to these last.



There are some optional things like:

commit 5030a7450b0f0117a7903303572c6bda6c012327
Author: Jiri Denemark 
Date:   Fri Jun 7 10:00:28 2019

qemu_command: Use canonical names of CPU features

When building QEMU command line, we should use the preferred spelling of
each CPU feature without relying on compatibility aliases (which may be
removed at some point).

The "unavailable-features" CPU property is used as a witness for the
correct names of the features in our translation table.

Signed-off-by: Jiri Denemark 
Reviewed-by: Ján Tomko 

which will change the canonical names for the CPU features (which is
something used by the commits that will create the arch_capabilities and
unavailable-features features).



So, IMO, we should keep QEMU cmdline XML arguments for the mitigation
features and tell users to use *at least* Eoan's libvirt for the arch-
capabilities feature in libvirt. Orelse we would have to either backport
tons of libvirt patches OR workaround this by creating or own version,
which is a no-no for SRUs.

Any objection ?

PS: We still need to document the arch-capabilities and all the
mitigations it advertises (and features enabled/disabled in cmdline amd,
possibly, now, in libvirt as cmdline xml extra arguments).


** Changed in: libvirt (Ubuntu Disco)
   Status: Confirmed => Opinion

** Changed in: libvirt (Ubuntu Bionic)
   Status: Confirmed => Won't Fix

** Changed in: libvirt (Ubuntu Bionic)
 Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

** Changed in: linux (Ubuntu Disco)
 Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

** Changed in: linux (Ubuntu Bionic)
 Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1828495

Title:
  [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

Status in intel:
  New
Status in libvirt package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  In Progress
Status in qemu package in Ubuntu:
  Fix Released
Status in libvirt source package in Bionic:
  Won't Fix
Status in linux source package in Bionic:
  Confirmed
Status in qemu source package in Bionic:
  Fix Released
Status in libvirt source package in Disco:
  Opinion
Status in linux source package in Disco:
  Confirmed
Status in qemu source package in Disco:
  Fix Released
Status in libvirt source package in Eoan:
  Fix Released
Status in linux source package in Eoan:
  In Progress
Status in qemu source package in Eoan:
  Fix Released

Bug description:
  [Impact]

   * QEMU does not support IceLake and CascadeLake CPUs specific features.
   * Most important feature to be supported is: IA32_ARCH_CAPABILITIES MSR.
   * With IA32_ARCH_CAPABILITIES, QEMU is able to advertise HW mitigations:
 - Rogue Data Cache Load
 - Enhanced IBRS
 - RSB Alternate
 - L1D flush need on VMENTRY
 - speculative Store Bypass
 to guests, as described in document:
 Intel 336996-Speculative-Execution-Side-Channel-Mitigations.pdf

  [Test Case]

   * From Original Description:

  """
  1. Boot up guest using: -cpu Cascadelake-Server

  [root@clx-2s2 yexin]# qemu-system-x86_64 -accel kvm -drive
  if=virtio,id=hd,file=/home/x/x,format=qcow2  -m 4096 -smp 4 -cpu
  Cascadelake-Server -serial stdio

  char device redirected to /dev/pts/3 (label serial0)

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [

[Kernel-packages] [Bug 1846237] Re: Kernel Panic while virsh dump of Guest with 300G RAM is triggered.

2019-10-08 Thread Rafael David Tinoco
Manoj,

This is a soft lockup in schedule() - a task is waiting I/O completion -
inside a KVM guest.

The guest kernel has a completion that will be awaken, re-scheduling the
task back to a CPU run queue, as soon as the I/O is finished (the I/O
usually contains a handle that, as soon as I/O is confirmed to be sent
by transport layer, calls a callback function to "release" the
completion and let the application to be re-scheduled. Depending on how
the cache is configured, this logic MIGHT also check for I/O being
committed in I/O server, only allowing the task to continue its logic
after that: That is also considered as a soft lockup (tasks keeps re-
scheduling itself until the I/o is done).

The guest has just panic'ed because it had "panic on hung" configured.

It is highly probable that the "issue" here is I/O contention causing
the lockup inside the Guest, nothing else. There isn't any I/O timeouts
- because bad transport and/or block device layer - or any other hard
lockup due to a dead lock, for example.

So, unless something else, undocumented in this bug, is happening, there
is not much to be done without more information. To help kernel team, it
would be good for IBM to provide more information on what was being done
on the HOST, how the I/O devices are configured in KVM guest, etc.

Thats my 5 cents.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1846237

Title:
  Kernel Panic while virsh dump of Guest with 300G RAM is triggered.

Status in The Ubuntu-power-systems project:
  Triaged
Status in libvirt package in Ubuntu:
  Invalid
Status in linux package in Ubuntu:
  New

Bug description:
  == Comment: #0 - HARIHARAN T. SUNDARESH REDDY - 2019-04-01 12:23:14 ==
  ---Problem Description---
  Kernel panic occurred when `virsh dump` is triggered on the guest with 300G 
of RAM.

  ---uname output---
  Linux ltcgen6 4.15.0-1017.19-bz175922-ibm-gt #bz175922 SMP Thu Mar 21 
09:34:09 CDT 2019 ppc64le ppc64le ppc64le GNU/Linux

  ---Debugger---
  A debugger is not configured

  ---Steps to Reproduce---
  1. Define guest with 300G RAM, Start the guest
  2. Run the following command 
 `virsh dump ubuntui_hsr /home/vm.core --memory-only --live'
  3. Wait for some time, kernel panic will be see in the console.

  
  --Log---
  [ 1692.657251] INFO: task journal-offline:7763 blocked for more than 120 
seconds.
  [ 1692.657251] INFO: task journal-offline:7763 blocked for more than 
120 seconds.
  [ 1692.657754]   Not tainted 4.15.0-1017.19-bz175922-ibm-gt 
#bz175922
  [ 1692.657754]   Not tainted 4.15.0-1017.19-bz175922-ibm-gt 
#bz175922
  [ 1692.658220] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" 
disables this message.
  [ 1692.658220] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" 
disables this message.
  [ 1692.658839] Kernel panic - not syncing: hung_task: blocked tasks
  [ 1692.658839] Kernel panic - not syncing: hung_task: blocked tasks
  [ 1692.659238] CPU: 48 PID: 785 Comm: khungtaskd Not tainted 
4.15.0-1017.19-bz175922-ibm-gt #bz175922
  [ 1692.659238] CPU: 48 PID: 785 Comm: khungtaskd Not tainted 
4.15.0-1017.19-bz175922-ibm-gt #bz175922
  [ 1692.659835] Call Trace:
  [ 1692.659835] Call Trace:
  [ 1692.660025] [c08fd0eefbf8] [c0cea13c] 
dump_stack+0xb0/0xf4 (unreliable)
  [ 1692.660025] [c08fd0eefbf8] [c0cea13c] 
dump_stack+0xb0/0xf4 (unreliable)
  [ 1692.660564] [c08fd0eefc38] [c0110020] panic+0x148/0x328
  [ 1692.660564] [c08fd0eefc38] [c0110020] panic+0x148/0x328
  [ 1692.661004] [c08fd0eefcd8] [c0233a08] 
watchdog+0x2c8/0x420
  [ 1692.661004] [c08fd0eefcd8] [c0233a08] 
watchdog+0x2c8/0x420
  [ 1692.661429] [c08fd0eefdb8] [c0140068] 
kthread+0x1a8/0x1b0
  [ 1692.661429] [c08fd0eefdb8] [c0140068] 
kthread+0x1a8/0x1b0
  [ 1692.661881] [c08fd0eefe28] [c000b654] 
ret_from_kernel_thread+0x5c/0x88
  [ 1692.661881] [c08fd0eefe28] [c000b654] 
ret_from_kernel_thread+0x5c/0x88
  [ 1692.662439] Sending IPI to other CPUs
  [ 1692.662439] Sending IPI to other CPUs
  [ 1693.971250] IPI complete
  [ 1693.971250] IPI complete
  [ 1694.122536] kexec: Starting switchover sequence.
  [ 1694.122536] kexec: Starting switchover sequence.

  [ 1827.285354188,3] PHB#0003[0:3]: CRESET: Unexpected slot state 
0102, resetting...
  [ 1831.426449832,3] PHB#0030[8:0]: CRESET: Unexpected slot state 
0102, resetting...
  [ 1832.158844758,3] PHB#0033[8:3]: CRESET: Unexpected slot state 
0102, resetting...
  [ 1832.403055326,3] PHB#0034[8:4]: CRESET: Unexpected slot state 
0102, resetting...
  [1.924644] 

[Kernel-packages] [Bug 1788098] Re: Avoid migration issues with aligned 2MB THB

2019-09-30 Thread Rafael David Tinoco
** Changed in: linux (Ubuntu Disco)
   Importance: Undecided => Medium

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1788098

Title:
  Avoid migration issues with aligned 2MB THB

Status in The Ubuntu-power-systems project:
  Invalid
Status in linux package in Ubuntu:
  Fix Released
Status in qemu package in Ubuntu:
  Invalid
Status in linux source package in Bionic:
  Won't Fix
Status in linux source package in Cosmic:
  Invalid
Status in linux source package in Disco:
  Fix Released
Status in linux source package in Eoan:
  Fix Released
Status in qemu source package in Eoan:
  Invalid

Bug description:
  FYI: This blocks bug 1781526 - once this one here is resolved we can
  go on with SRU considerations for 1781526

  --- Comment From jhop...@us.ibm.com 2018-08-20 17:12 EDT---

  Hi, in some environments it was observed that this qemu patch to
  enable THP made it more likely to hit guest migration issues, however
  the following kernel patch resolves those migration issues:

  
https://git.kernel.org/pub/scm/linux/kernel/git/paulus/powerpc.git/commit/?h=kvm-ppc-next=c066fafc595eef5ae3c83ae3a8305956b8c3ef15
  KVM: PPC: Book3S HV: Use correct pagesize in kvm_unmap_radix()

  Once merged upstream, it would be good to include that change as well
  to avoid potential migration problems. Should I open a new bug for
  that or is it better to track here?

  Note Paelzer: I have not seen related migration issues myself, but it
  seems reasonable and confirmed by IBM.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu-power-systems/+bug/1788098/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1788098] Re: Avoid migration issues with aligned 2MB THB

2019-09-30 Thread Rafael David Tinoco
Frank, based on your previous comment I'm also flagging disco as Fix
Released. Please fix this if it makes no sense (just to be accurate).
Thx!

** Also affects: qemu (Ubuntu Disco)
   Importance: Undecided
   Status: New

** Also affects: linux (Ubuntu Disco)
   Importance: Undecided
   Status: New

** No longer affects: qemu (Ubuntu Disco)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1788098

Title:
  Avoid migration issues with aligned 2MB THB

Status in The Ubuntu-power-systems project:
  Invalid
Status in linux package in Ubuntu:
  Fix Released
Status in qemu package in Ubuntu:
  Invalid
Status in linux source package in Bionic:
  Won't Fix
Status in linux source package in Cosmic:
  Invalid
Status in linux source package in Disco:
  New
Status in linux source package in Eoan:
  Fix Released
Status in qemu source package in Eoan:
  Invalid

Bug description:
  FYI: This blocks bug 1781526 - once this one here is resolved we can
  go on with SRU considerations for 1781526

  --- Comment From jhop...@us.ibm.com 2018-08-20 17:12 EDT---

  Hi, in some environments it was observed that this qemu patch to
  enable THP made it more likely to hit guest migration issues, however
  the following kernel patch resolves those migration issues:

  
https://git.kernel.org/pub/scm/linux/kernel/git/paulus/powerpc.git/commit/?h=kvm-ppc-next=c066fafc595eef5ae3c83ae3a8305956b8c3ef15
  KVM: PPC: Book3S HV: Use correct pagesize in kvm_unmap_radix()

  Once merged upstream, it would be good to include that change as well
  to avoid potential migration problems. Should I open a new bug for
  that or is it better to track here?

  Note Paelzer: I have not seen related migration issues myself, but it
  seems reasonable and confirmed by IBM.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu-power-systems/+bug/1788098/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1771222] Re: Using sysctl to permanently disable IPv6 doesn't have any effect

2019-09-24 Thread Rafael David Tinoco
*** This bug is a duplicate of bug 50093 ***
https://bugs.launchpad.net/bugs/50093

** This bug has been marked a duplicate of bug 50093
   Some sysctls are ignored on boot

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1771222

Title:
  Using sysctl to permanently disable IPv6 doesn't have any effect

Status in linux package in Ubuntu:
  Confirmed

Bug description:
  Shows up in version 18.04 of Ubuntu.

  I added the following 2 lines in /etc/sysctl.d/99-sysctl.conf and 
/etc/sysctl.d/01-disable-ipv6.conf:
  ```
  net.ipv6.conf.all.disable_ipv6=1
  net.ipv6.conf.default.disable_ipv6=1
  ```

  Rebooting my machine sets those parameters for "all" and "default" but not for
  the sysctl options of my network interface:
  ```
  net.ipv6.conf.all.disable_ipv6 = 1
  net.ipv6.conf.default.disable_ipv6 = 1
  net.ipv6.conf.ens160.disable_ipv6 = 0
  ```

  I use disable_ipv6 above as an example.
  I've also verified this with the promote_secondaries option of ipv4.

  I can always restart  systemd-sysctl.service at every boot and this will
  set net.ipv6.conf.ens160.disable_ipv6 to 1. Unfortunately though this won't
  work for devices that are hot-plugged.

  Other info:

  - version signature: Ubuntu 4.15.0-20.21-generic 4.15.17
  - lspci is attached

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1771222/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1834522] Re: Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as passthrough

2019-09-23 Thread Rafael David Tinoco
** Tags removed: verification-needed-bionic
** Tags added: verification-done verification-done-bionic

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1834522

Title:
  Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as
  passthrough

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  Fix Committed

Bug description:
  [Impact]

   * Nested AMD KVM guest does not work in AMD CPUs when using host-passthrough 
as cpu-mode.
   * QEMU does not start, hanging before the VM initialization.

  [Test Case]

   * Bionic KVM GUEST tries to use nested KVM in AMD CPU
   * to use the following XML file: https://paste.ubuntu.com/p/BSyFY7ksR5/
   * to have AMD FX(tm)-8350 Eight-Core Processor CPU or similar
   * to use Xenial qemu on top of a HWE kernel -> works

  [Regression Potential]

   * KVM SVM could be affected but patch is from upstream, fixes the
  specific issue and has been tested by me in my currently developing
  workstation (heavy usage).

  [Other Info]

   * Patches have been sent to kernel team mailing list.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1834522/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1834522] Re: Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as passthrough

2019-09-23 Thread Rafael David Tinoco
It solves the problem and I'm sorry for taking so long to verify...

Commit:

Author: Sean Christopherson 
Date:   Thu Aug 29 14:06:58 2019

KVM: x86: SVM: Set EMULTYPE_NO_REEXECUTE for RSM emulation

BugLink: https://bugs.launchpad.net/bugs/1834522

Indeed solves the problem.

Thank you!

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1834522

Title:
  Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as
  passthrough

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  Fix Committed

Bug description:
  [Impact]

   * Nested AMD KVM guest does not work in AMD CPUs when using host-passthrough 
as cpu-mode.
   * QEMU does not start, hanging before the VM initialization.

  [Test Case]

   * Bionic KVM GUEST tries to use nested KVM in AMD CPU
   * to use the following XML file: https://paste.ubuntu.com/p/BSyFY7ksR5/
   * to have AMD FX(tm)-8350 Eight-Core Processor CPU or similar
   * to use Xenial qemu on top of a HWE kernel -> works

  [Regression Potential]

   * KVM SVM could be affected but patch is from upstream, fixes the
  specific issue and has been tested by me in my currently developing
  workstation (heavy usage).

  [Other Info]

   * Patches have been sent to kernel team mailing list.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1834522/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1834522] Re: Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as passthrough

2019-08-29 Thread Rafael David Tinoco
Waiting kernel team sponsorship. Thx.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1834522

Title:
  Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as
  passthrough

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  In Progress

Bug description:
  [Impact]

   * Nested AMD KVM guest does not work in AMD CPUs when using host-passthrough 
as cpu-mode.
   * QEMU does not start, hanging before the VM initialization.

  [Test Case]

   * Bionic KVM GUEST tries to use nested KVM in AMD CPU
   * to use the following XML file: https://paste.ubuntu.com/p/BSyFY7ksR5/
   * to have AMD FX(tm)-8350 Eight-Core Processor CPU or similar
   * to use Xenial qemu on top of a HWE kernel -> works

  [Regression Potential]

   * KVM SVM could be affected but patch is from upstream, fixes the
  specific issue and has been tested by me in my currently developing
  workstation (heavy usage).

  [Other Info]

   * Patches have been sent to kernel team mailing list.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1834522/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1834522] Re: Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as passthrough

2019-08-29 Thread Rafael David Tinoco
Sent out to kernel team:

https://lists.ubuntu.com/archives/kernel-team/2019-August/103470.html
https://lists.ubuntu.com/archives/kernel-team/2019-August/103471.html

** Description changed:

  [Impact]
  
-  * QEMU does not work in some AMD hardware when using host-passthrough as 
cpu-mode (usually to allow nested KVM to work).
-  * QEMU does not start, hanging before the VM initialization.
+  * Nested AMD KVM guest does not work in AMD CPUs when using host-passthrough 
as cpu-mode.
+  * QEMU does not start, hanging before the VM initialization.
  
  [Test Case]
  
-  * to use Xenial qemu on top of a regular Xenial kernel -> doesn't work 
(intermittent)
-  * to use the following XML file: https://paste.ubuntu.com/p/BSyFY7ksR5/
-  * to have AMD FX(tm)-8350 Eight-Core Processor CPU or similar
-  * to use Xenial qemu on top of a HWE kernel -> works
+  * Bionic KVM GUEST tries to use nested KVM in AMD CPU
+  * to use the following XML file: https://paste.ubuntu.com/p/BSyFY7ksR5/
+  * to have AMD FX(tm)-8350 Eight-Core Processor CPU or similar
+  * to use Xenial qemu on top of a HWE kernel -> works
  
  [Regression Potential]
  
-  * TODO
+  * KVM SVM could be affected but patch is from upstream, fixes the
+ specific issue and has been tested by me in my currently developing
+ workstation (heavy usage).
  
  [Other Info]
  
-  * TODO
+  * Patches have been sent to kernel team mailing list.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1834522

Title:
  Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as
  passthrough

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  In Progress

Bug description:
  [Impact]

   * Nested AMD KVM guest does not work in AMD CPUs when using host-passthrough 
as cpu-mode.
   * QEMU does not start, hanging before the VM initialization.

  [Test Case]

   * Bionic KVM GUEST tries to use nested KVM in AMD CPU
   * to use the following XML file: https://paste.ubuntu.com/p/BSyFY7ksR5/
   * to have AMD FX(tm)-8350 Eight-Core Processor CPU or similar
   * to use Xenial qemu on top of a HWE kernel -> works

  [Regression Potential]

   * KVM SVM could be affected but patch is from upstream, fixes the
  specific issue and has been tested by me in my currently developing
  workstation (heavy usage).

  [Other Info]

   * Patches have been sent to kernel team mailing list.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1834522/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1834522] Re: Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as passthrough

2019-08-29 Thread Rafael David Tinoco
Also needed:

commit 35be0aded76b54a24dc8aa678a71bca22273e8d8
Author: Sean Christopherson 
Date:   Thu Aug 23 17:56:47 2018

KVM: x86: SVM: Set EMULTYPE_NO_REEXECUTE for RSM emulation

Re-execution after an emulation decode failure is only intended to
handle a case where two or vCPUs race to write a shadowed page, i.e.
we should never re-execute an instruction as part of RSM emulation.

Add a new helper, kvm_emulate_instruction_from_buffer(), to support
emulating from a pre-defined buffer.  This eliminates the last direct
call to x86_emulate_instruction() outside of kvm_mmu_page_fault(),
which means x86_emulate_instruction() can be unexported in a future
patch.

Fixes: 7607b7174405 ("KVM: SVM: install RSM intercept")
Cc: Brijesh Singh 
Signed-off-by: Sean Christopherson 
Cc: sta...@vger.kernel.org
Signed-off-by: Radim Krčmář 

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1834522

Title:
  Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as
  passthrough

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  In Progress

Bug description:
  [Impact]

   * QEMU does not work in some AMD hardware when using host-passthrough as 
cpu-mode (usually to allow nested KVM to work).
   * QEMU does not start, hanging before the VM initialization.

  [Test Case]

   * to use Xenial qemu on top of a regular Xenial kernel -> doesn't work 
(intermittent)
   * to use the following XML file: https://paste.ubuntu.com/p/BSyFY7ksR5/
   * to have AMD FX(tm)-8350 Eight-Core Processor CPU or similar
   * to use Xenial qemu on top of a HWE kernel -> works

  [Regression Potential]

   * TODO

  [Other Info]

   * TODO

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1834522/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1834522] Re: Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as passthrough

2019-08-29 Thread Rafael David Tinoco
I've included patch above into Bionic tree:

commit 9bff5f095923aab04411cf4e9135b975b70e3ead (tag: Ubuntu-4.15.0-58.64, 
origin/master, origin/HEAD)
Author: Stefan Bader 
Date:   Tue Aug 6 10:45:37 2019

UBUNTU: Ubuntu-4.15.0-58.64

And it, indeed, fixed the issue.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1834522

Title:
  Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as
  passthrough

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  In Progress

Bug description:
  [Impact]

   * QEMU does not work in some AMD hardware when using host-passthrough as 
cpu-mode (usually to allow nested KVM to work).
   * QEMU does not start, hanging before the VM initialization.

  [Test Case]

   * to use Xenial qemu on top of a regular Xenial kernel -> doesn't work 
(intermittent)
   * to use the following XML file: https://paste.ubuntu.com/p/BSyFY7ksR5/
   * to have AMD FX(tm)-8350 Eight-Core Processor CPU or similar
   * to use Xenial qemu on top of a HWE kernel -> works

  [Regression Potential]

   * TODO

  [Other Info]

   * TODO

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1834522/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1834522] Re: Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as passthrough

2019-08-29 Thread Rafael David Tinoco
** Changed in: linux (Ubuntu Bionic)
   Status: Confirmed => In Progress

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1834522

Title:
  Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as
  passthrough

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  In Progress

Bug description:
  [Impact]

   * QEMU does not work in some AMD hardware when using host-passthrough as 
cpu-mode (usually to allow nested KVM to work).
   * QEMU does not start, hanging before the VM initialization.

  [Test Case]

   * to use Xenial qemu on top of a regular Xenial kernel -> doesn't work 
(intermittent)
   * to use the following XML file: https://paste.ubuntu.com/p/BSyFY7ksR5/
   * to have AMD FX(tm)-8350 Eight-Core Processor CPU or similar
   * to use Xenial qemu on top of a HWE kernel -> works

  [Regression Potential]

   * TODO

  [Other Info]

   * TODO

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1834522/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1834522] Re: Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as passthrough

2019-08-29 Thread Rafael David Tinoco
# BISECT LOG

git bisect start
# bad: [0adb32858b0bddf4ada5f364a84ed60b196dbcda] Linux 4.16
git bisect bad 0adb32858b0bddf4ada5f364a84ed60b196dbcda
# good: [d8a5b80568a9cb66810e75b182018e9edb68e8ff] Linux 4.15
git bisect good d8a5b80568a9cb66810e75b182018e9edb68e8ff
# good: [c14376de3a1befa70d9811ca2872d47367b48767] printk: Wake klogd when 
passing console_lock owner
git bisect good c14376de3a1befa70d9811ca2872d47367b48767
# good: [2246edfaf88dc368e8671b04afd54412625df60a] Merge tag 'for-linus' of 
git://git.kernel.org/pub/scm/linux/kernel/git/rdma/rdma
git bisect good 2246edfaf88dc368e8671b04afd54412625df60a
# good: [dfe8db22372873d205c78a9fd5370b1b088a2b87] Merge tag 
'drm-misc-fixes-2018-02-21' of git://anongit.freedesktop.org/drm/drm-misc into 
drm-fixes
git bisect good dfe8db22372873d205c78a9fd5370b1b088a2b87
# bad: [4665c6b04651e96c1e2eb9129a30d6055040ff73] Merge tag 
'linux-can-fixes-for-4.16-20180312' of 
ssh://gitolite.kernel.org/pub/scm/linux/kernel/git/mkl/linux-can
git bisect bad 4665c6b04651e96c1e2eb9129a30d6055040ff73
# bad: [3499de32fa6b608ba646380ac3838d30a2558ead] Merge tag 
'linux-kselftest-4.16-rc4' of 
git://git.kernel.org/pub/scm/linux/kernel/git/shuah/linux-kselftest
git bisect bad 3499de32fa6b608ba646380ac3838d30a2558ead
# good: [65738c6b461a8bb0b056e024299738f7cc9a28b7] Merge tag 'arm64-fixes' of 
git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux
git bisect good 65738c6b461a8bb0b056e024299738f7cc9a28b7
# good: [c23a75759191e84f4ba15b85ea4f97bd544b5362] Merge branch 
'x86-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good c23a75759191e84f4ba15b85ea4f97bd544b5362
# bad: [d4858aaf6bd8a90e2dacc0dfec2077e334dcedbf] Merge tag 'for-linus' of 
git://git.kernel.org/pub/scm/virt/kvm/kvm
git bisect bad d4858aaf6bd8a90e2dacc0dfec2077e334dcedbf
# good: [0eb578009a1d530a11846d7c4733a5db04730884] tools/kvm_stat: use a more 
pythonic way to iterate over dictionaries
git bisect good 0eb578009a1d530a11846d7c4733a5db04730884
# good: [fe2a3027e74e40a3ece3a4c1e4e51403090a907a] KVM: x86: fix backward 
migration with async_PF
git bisect good fe2a3027e74e40a3ece3a4c1e4e51403090a907a
# bad: [7607b7174405aec7441ff6c970833c463114040a] KVM: SVM: install RSM 
intercept
git bisect bad 7607b7174405aec7441ff6c970833c463114040a
# good: [e5699f56bc91a286f006b0728085e0b4e8f5749b] crypto: ccp: Fix sparse, use 
plain integer as NULL pointer
git bisect good e5699f56bc91a286f006b0728085e0b4e8f5749b
# good: [3e233385ef4a217a2812115ed84d4be36eb16817] KVM: SVM: no need to call 
access_ok() in LAUNCH_MEASURE command
git bisect good 3e233385ef4a217a2812115ed84d4be36eb16817
# first bad commit: [7607b7174405aec7441ff6c970833c463114040a] KVM: SVM: 
install RSM intercept

# NOTE

I was doing "invert" bisection.. so the bad commit is actually what
seems to have fixed the issue:

commit 7607b7174405aec7441ff6c970833c463114040a
Author: Brijesh Singh 
Date:   Mon Feb 19 10:14:44 2018 -0600

KVM: SVM: install RSM intercept

RSM instruction is used by the SMM handler to return from SMM mode.
Currently, rsm causes a #UD - which results in instruction fetch, decode,
and emulate. By installing the RSM intercept we can avoid the instruction
fetch since we know that #VMEXIT was due to rsm.

The patch is required for the SEV guest, because in case of SEV guest
memory is encrypted with guest-specific key and hypervisor will not
able to fetch the instruction bytes from the guest memory.

Cc: Paolo Bonzini 
Cc: Radim Krčmář 
Cc: Joerg Roedel 
Cc: Borislav Petkov 
Cc: Tom Lendacky 
Signed-off-by: Brijesh Singh 
Signed-off-by: Paolo Bonzini 

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1834522

Title:
  Bionic QEMU with Bionic Kernel hangs in AMD FX-8350 with cpu-host as
  passthrough

Status in linux package in Ubuntu:
  Fix Released
Status in linux source package in Bionic:
  In Progress

Bug description:
  [Impact]

   * QEMU does not work in some AMD hardware when using host-passthrough as 
cpu-mode (usually to allow nested KVM to work).
   * QEMU does not start, hanging before the VM initialization.

  [Test Case]

   * to use Xenial qemu on top of a regular Xenial kernel -> doesn't work 
(intermittent)
   * to use the following XML file: https://paste.ubuntu.com/p/BSyFY7ksR5/
   * to have AMD FX(tm)-8350 Eight-Core Processor CPU or similar
   * to use Xenial qemu on top of a HWE kernel -> works

  [Regression Potential]

   * TODO

  [Other Info]

   * TODO

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1834522/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1828495] Re: [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

2019-08-27 Thread Rafael David Tinoco
** Changed in: libvirt (Ubuntu Disco)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

** Changed in: libvirt (Ubuntu Bionic)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

** Changed in: qemu (Ubuntu Disco)
 Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

** Changed in: qemu (Ubuntu Bionic)
 Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned)

** Changed in: linux (Ubuntu Bionic)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

** Changed in: linux (Ubuntu Disco)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

** Changed in: linux (Ubuntu Eoan)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1828495

Title:
  [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

Status in intel:
  New
Status in libvirt package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  In Progress
Status in qemu package in Ubuntu:
  Fix Released
Status in libvirt source package in Bionic:
  Confirmed
Status in linux source package in Bionic:
  Confirmed
Status in qemu source package in Bionic:
  Fix Released
Status in libvirt source package in Disco:
  Confirmed
Status in linux source package in Disco:
  Confirmed
Status in qemu source package in Disco:
  Fix Released
Status in libvirt source package in Eoan:
  Fix Released
Status in linux source package in Eoan:
  In Progress
Status in qemu source package in Eoan:
  Fix Released

Bug description:
  [Impact]

   * QEMU does not support IceLake and CascadeLake CPUs specific features.
   * Most important feature to be supported is: IA32_ARCH_CAPABILITIES MSR.
   * With IA32_ARCH_CAPABILITIES, QEMU is able to advertise HW mitigations:
 - Rogue Data Cache Load
 - Enhanced IBRS
 - RSB Alternate
 - L1D flush need on VMENTRY
 - speculative Store Bypass
 to guests, as described in document:
 Intel 336996-Speculative-Execution-Side-Channel-Mitigations.pdf

  [Test Case]

   * From Original Description:

  """
  1. Boot up guest using: -cpu Cascadelake-Server

  [root@clx-2s2 yexin]# qemu-system-x86_64 -accel kvm -drive
  if=virtio,id=hd,file=/home/x/x,format=qcow2  -m 4096 -smp 4 -cpu
  Cascadelake-Server -serial stdio

  char device redirected to /dev/pts/3 (label serial0)

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  2. To check CPU ID related to features[FEAT_7_0_EDX]
  :CPUID_7_0_EDX_ARCH_CAPABILITIES

  Expected Result: Both host and guest's CPUID.07H EDX bit 29 should be
  1.

  Actual Result:

  Host's cpuid: 0x0007 0x00: eax=0x ebx=0xd39b
  ecx=0x0818 edx=0xbc00  (EDX bit 29=1)

  Guest's cpuid : 0x0007 0x00: eax=0x ebx=0xd19f0fb9
  ecx=0x0818 edx=0x8400 (EDX bit 29=0)

  Commit:2bdb76c015df7125783d8394d6339d181cb5bc30

  Target Kerned: 5.1
  Target Release: 19.10

  """

  [Regression Potential]

   * Most changes are related to CPU type definitions and its supported
  features. They are all based in upstream changes but, for obvious
  reasons, backporting and/or cherry-picking those could bring issues.
  Biggest concern is breaking something that currently works. Right now,
  the parts being changed that could affect other CPU types would be
  related to a small refactoring of how the features are organized, and
  that would be seen right away when trying to start a new VM after the
  package is installed.

   * Other tests, related to the features being backported, are being
  done by our KVM regression tests, including migration combinations, to
  reduce chances that a regression is introduced.

  [Other Info]
   
   * N/A

To manage notifications about this bug go to:
https://bugs.launchpad.net/intel/+bug/1828495/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1840847] Re: cpuinfo_linux_get_max_processors_count always warns Ubuntu default MAX cpu values (stderr)

2019-08-20 Thread Rafael David Tinoco
** Description changed:

  From bug:
  
  https://bugs.launchpad.net/bugs/1840511
  
- clockhouse builds test started failing because of the presence of stderr
+ clickhouse builds test started failing because of the presence of stderr
  whenever using the function:
  
  cpuinfo_linux_get_max_processors_count(void)
  
  From cpuid library.
  
  This happens because:
  
  
  
  #if defined(__ANDROID__) && !defined(CPU_SETSIZE)
  /*
   * Android NDK headers before platform 21 do not define CPU_SETSIZE,
   * so we hard-code its value, as defined in platform 21 headers
   */
  #if defined(__LP64__)
  static const uint32_t default_max_processors_count = 1024;
  #else
  static const uint32_t default_max_processors_count = 32;
  #endif
  #else
  static const uint32_t default_max_processors_count = CPU_SETSIZE;
  #endif
  
  
  
  #if !defined(__ANDROID__)
  /*
   * sched.h is only used for CPU_SETSIZE constant.
   * Android NDK headers before platform 21 do have this constant in sched.h
   */
  #include 
  #endif
  
  
  
  and resolving includes:
  
  x86_64-linux-gnu/bits/cpu-set.h:
  
  /* Size definition for CPU sets. */
  #define __CPU_SETSIZE 1024
  
  
  
  And the warning:
  
  Warning in cpuinfo: kernel_max value of 8191 parsed from
  /sys/devices/system/cpu/kernel_max exceeds platform-default limit 1023
  
  Will always be displayed in Ubuntu OS, when it should NOT (does not make
  any sense to trigger a warning for something that can't be changed).
  
  FOR THE KERNEL TEAM:
  
  Should ubuntu update sched.h and/or cpu-set.h to reflect its decision in
  using 8192 max CPUs ?

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1840847

Title:
  cpuinfo_linux_get_max_processors_count always warns Ubuntu default MAX
  cpu values (stderr)

Status in cpuinfo package in Ubuntu:
  In Progress
Status in linux package in Ubuntu:
  Confirmed

Bug description:
  From bug:

  https://bugs.launchpad.net/bugs/1840511

  clickhouse builds test started failing because of the presence of
  stderr whenever using the function:

  cpuinfo_linux_get_max_processors_count(void)

  From cpuid library.

  This happens because:

  

  #if defined(__ANDROID__) && !defined(CPU_SETSIZE)
  /*
   * Android NDK headers before platform 21 do not define CPU_SETSIZE,
   * so we hard-code its value, as defined in platform 21 headers
   */
  #if defined(__LP64__)
  static const uint32_t default_max_processors_count = 1024;
  #else
  static const uint32_t default_max_processors_count = 32;
  #endif
  #else
  static const uint32_t default_max_processors_count = CPU_SETSIZE;
  #endif

  

  #if !defined(__ANDROID__)
  /*
   * sched.h is only used for CPU_SETSIZE constant.
   * Android NDK headers before platform 21 do have this constant in sched.h
   */
  #include 
  #endif

  

  and resolving includes:

  x86_64-linux-gnu/bits/cpu-set.h:

  /* Size definition for CPU sets. */
  #define __CPU_SETSIZE 1024

  

  And the warning:

  Warning in cpuinfo: kernel_max value of 8191 parsed from
  /sys/devices/system/cpu/kernel_max exceeds platform-default limit 1023

  Will always be displayed in Ubuntu OS, when it should NOT (does not
  make any sense to trigger a warning for something that can't be
  changed).

  FOR THE KERNEL TEAM:

  Should ubuntu update sched.h and/or cpu-set.h to reflect its decision
  in using 8192 max CPUs ?

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/cpuinfo/+bug/1840847/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1840847] Re: cpuinfo_linux_get_max_processors_count always warns Ubuntu default MAX cpu values (stderr)

2019-08-20 Thread Rafael David Tinoco
PPA containing clickhouse build (LP: #1840511) and cpuinfo with this
fix:

https://launchpad.net/~rafaeldtinoco/+archive/ubuntu/lp1840511

Debdiff with proposed changes are attached to this bug.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1840847

Title:
  cpuinfo_linux_get_max_processors_count always warns Ubuntu default MAX
  cpu values (stderr)

Status in cpuinfo package in Ubuntu:
  In Progress
Status in linux package in Ubuntu:
  Confirmed

Bug description:
  From bug:

  https://bugs.launchpad.net/bugs/1840511

  clockhouse builds test started failing because of the presence of
  stderr whenever using the function:

  cpuinfo_linux_get_max_processors_count(void)

  From cpuid library.

  This happens because:

  

  #if defined(__ANDROID__) && !defined(CPU_SETSIZE)
  /*
   * Android NDK headers before platform 21 do not define CPU_SETSIZE,
   * so we hard-code its value, as defined in platform 21 headers
   */
  #if defined(__LP64__)
  static const uint32_t default_max_processors_count = 1024;
  #else
  static const uint32_t default_max_processors_count = 32;
  #endif
  #else
  static const uint32_t default_max_processors_count = CPU_SETSIZE;
  #endif

  

  #if !defined(__ANDROID__)
  /*
   * sched.h is only used for CPU_SETSIZE constant.
   * Android NDK headers before platform 21 do have this constant in sched.h
   */
  #include 
  #endif

  

  and resolving includes:

  x86_64-linux-gnu/bits/cpu-set.h:

  /* Size definition for CPU sets. */
  #define __CPU_SETSIZE 1024

  

  And the warning:

  Warning in cpuinfo: kernel_max value of 8191 parsed from
  /sys/devices/system/cpu/kernel_max exceeds platform-default limit 1023

  Will always be displayed in Ubuntu OS, when it should NOT (does not
  make any sense to trigger a warning for something that can't be
  changed).

  FOR THE KERNEL TEAM:

  Should ubuntu update sched.h and/or cpu-set.h to reflect its decision
  in using 8192 max CPUs ?

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/cpuinfo/+bug/1840847/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1840847] Re: cpuinfo_linux_get_max_processors_count always warns Ubuntu default MAX cpu values (stderr)

2019-08-20 Thread Rafael David Tinoco
** Patch added: "cpuinfo_0.0~git20190201.d5e37ad-1ubuntu1.debdiff"
   
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1840847/+attachment/5283577/+files/cpuinfo_0.0~git20190201.d5e37ad-1ubuntu1.debdiff

** Changed in: linux (Ubuntu)
   Status: Incomplete => Confirmed

** Changed in: linux (Ubuntu)
   Importance: Undecided => Low

** Description changed:

  From bug:
  
  https://bugs.launchpad.net/bugs/1840511
  
  clockhouse builds test started failing because of the presence of stderr
  whenever using the function:
  
  cpuinfo_linux_get_max_processors_count(void)
  
  From cpuid library.
  
  This happens because:
  
  
  
  #if defined(__ANDROID__) && !defined(CPU_SETSIZE)
  /*
   * Android NDK headers before platform 21 do not define CPU_SETSIZE,
   * so we hard-code its value, as defined in platform 21 headers
   */
  #if defined(__LP64__)
  static const uint32_t default_max_processors_count = 1024;
  #else
  static const uint32_t default_max_processors_count = 32;
  #endif
  #else
  static const uint32_t default_max_processors_count = CPU_SETSIZE;
  #endif
  
  
  
  #if !defined(__ANDROID__)
  /*
   * sched.h is only used for CPU_SETSIZE constant.
   * Android NDK headers before platform 21 do have this constant in sched.h
   */
  #include 
  #endif
  
  
  
  and resolving includes:
  
  x86_64-linux-gnu/bits/cpu-set.h:
  
  /* Size definition for CPU sets. */
  #define __CPU_SETSIZE 1024
  
  
  
  And the warning:
  
  Warning in cpuinfo: kernel_max value of 8191 parsed from
  /sys/devices/system/cpu/kernel_max exceeds platform-default limit 1023
  
  Will always be displayed in Ubuntu OS, when it should NOT (does not make
  any sense to trigger a warning for something that can't be changed).
  
+ FOR THE KERNEL TEAM:
+ 
  Should ubuntu update sched.h and/or cpu-set.h to reflect its decision in
  using 8192 max CPUs ?

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1840847

Title:
  cpuinfo_linux_get_max_processors_count always warns Ubuntu default MAX
  cpu values (stderr)

Status in cpuinfo package in Ubuntu:
  In Progress
Status in linux package in Ubuntu:
  Confirmed

Bug description:
  From bug:

  https://bugs.launchpad.net/bugs/1840511

  clockhouse builds test started failing because of the presence of
  stderr whenever using the function:

  cpuinfo_linux_get_max_processors_count(void)

  From cpuid library.

  This happens because:

  

  #if defined(__ANDROID__) && !defined(CPU_SETSIZE)
  /*
   * Android NDK headers before platform 21 do not define CPU_SETSIZE,
   * so we hard-code its value, as defined in platform 21 headers
   */
  #if defined(__LP64__)
  static const uint32_t default_max_processors_count = 1024;
  #else
  static const uint32_t default_max_processors_count = 32;
  #endif
  #else
  static const uint32_t default_max_processors_count = CPU_SETSIZE;
  #endif

  

  #if !defined(__ANDROID__)
  /*
   * sched.h is only used for CPU_SETSIZE constant.
   * Android NDK headers before platform 21 do have this constant in sched.h
   */
  #include 
  #endif

  

  and resolving includes:

  x86_64-linux-gnu/bits/cpu-set.h:

  /* Size definition for CPU sets. */
  #define __CPU_SETSIZE 1024

  

  And the warning:

  Warning in cpuinfo: kernel_max value of 8191 parsed from
  /sys/devices/system/cpu/kernel_max exceeds platform-default limit 1023

  Will always be displayed in Ubuntu OS, when it should NOT (does not
  make any sense to trigger a warning for something that can't be
  changed).

  FOR THE KERNEL TEAM:

  Should ubuntu update sched.h and/or cpu-set.h to reflect its decision
  in using 8192 max CPUs ?

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/cpuinfo/+bug/1840847/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1840847] Re: cpuinfo_linux_get_max_processors_count always warns Ubuntu default MAX cpu values (stderr)

2019-08-20 Thread Rafael David Tinoco
I'm changing CPUINFO_LOG_LEVEL from warning to error only to mitigate
this issue. Unfortunately this is the best way to address:

https://bugs.launchpad.net/ubuntu/+source/gcc-9/+bug/1840511

Right now, allowing clickhouse build to succeed and unblocking MySQL 8
upgrade.

** Changed in: cpuinfo (Ubuntu)
   Status: New => In Progress

** Changed in: cpuinfo (Ubuntu)
   Importance: Undecided => Medium

** Changed in: cpuinfo (Ubuntu)
 Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1840847

Title:
  cpuinfo_linux_get_max_processors_count always warns Ubuntu default MAX
  cpu values (stderr)

Status in cpuinfo package in Ubuntu:
  In Progress
Status in linux package in Ubuntu:
  Incomplete

Bug description:
  From bug:

  https://bugs.launchpad.net/bugs/1840511

  clockhouse builds test started failing because of the presence of
  stderr whenever using the function:

  cpuinfo_linux_get_max_processors_count(void)

  From cpuid library.

  This happens because:

  

  #if defined(__ANDROID__) && !defined(CPU_SETSIZE)
  /*
   * Android NDK headers before platform 21 do not define CPU_SETSIZE,
   * so we hard-code its value, as defined in platform 21 headers
   */
  #if defined(__LP64__)
  static const uint32_t default_max_processors_count = 1024;
  #else
  static const uint32_t default_max_processors_count = 32;
  #endif
  #else
  static const uint32_t default_max_processors_count = CPU_SETSIZE;
  #endif

  

  #if !defined(__ANDROID__)
  /*
   * sched.h is only used for CPU_SETSIZE constant.
   * Android NDK headers before platform 21 do have this constant in sched.h
   */
  #include 
  #endif

  

  and resolving includes:

  x86_64-linux-gnu/bits/cpu-set.h:

  /* Size definition for CPU sets. */
  #define __CPU_SETSIZE 1024

  

  And the warning:

  Warning in cpuinfo: kernel_max value of 8191 parsed from
  /sys/devices/system/cpu/kernel_max exceeds platform-default limit 1023

  Will always be displayed in Ubuntu OS, when it should NOT (does not
  make any sense to trigger a warning for something that can't be
  changed).

  Should ubuntu update sched.h and/or cpu-set.h to reflect its decision
  in using 8192 max CPUs ?

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/cpuinfo/+bug/1840847/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1840847] [NEW] cpuinfo_linux_get_max_processors_count always warns Ubuntu default MAX cpu values (stderr)

2019-08-20 Thread Rafael David Tinoco
Public bug reported:

>From bug:

https://bugs.launchpad.net/bugs/1840511

clockhouse builds test started failing because of the presence of stderr
whenever using the function:

cpuinfo_linux_get_max_processors_count(void)

>From cpuid library.

This happens because:



#if defined(__ANDROID__) && !defined(CPU_SETSIZE)
/*
 * Android NDK headers before platform 21 do not define CPU_SETSIZE,
 * so we hard-code its value, as defined in platform 21 headers
 */
#if defined(__LP64__)
static const uint32_t default_max_processors_count = 1024;
#else
static const uint32_t default_max_processors_count = 32;
#endif
#else
static const uint32_t default_max_processors_count = CPU_SETSIZE;
#endif



#if !defined(__ANDROID__)
/*
 * sched.h is only used for CPU_SETSIZE constant.
 * Android NDK headers before platform 21 do have this constant in sched.h
 */
#include 
#endif



and resolving includes:

x86_64-linux-gnu/bits/cpu-set.h:

/* Size definition for CPU sets. */
#define __CPU_SETSIZE 1024



And the warning:

Warning in cpuinfo: kernel_max value of 8191 parsed from
/sys/devices/system/cpu/kernel_max exceeds platform-default limit 1023

Will always be displayed in Ubuntu OS, when it should NOT (does not make
any sense to trigger a warning for something that can't be changed).

Should ubuntu update sched.h and/or cpu-set.h to reflect its decision in
using 8192 max CPUs ?

** Affects: cpuinfo (Ubuntu)
 Importance: Undecided
 Status: New

** Affects: linux (Ubuntu)
 Importance: Undecided
 Status: Incomplete

** Also affects: linux (Ubuntu)
   Importance: Undecided
   Status: New

** Description changed:

  From bug:
  
  https://bugs.launchpad.net/bugs/1840511
  
- clockhouse test started failing because of the presence of stderr
+ clockhouse builds test started failing because of the presence of stderr
  whenever using the function:
  
  cpuinfo_linux_get_max_processors_count(void)
  
  From cpuid library.
  
  This happens because:
  
  
  
  #if defined(__ANDROID__) && !defined(CPU_SETSIZE)
- /*
-  * Android NDK headers before platform 21 do not define CPU_SETSIZE,
-  * so we hard-code its value, as defined in platform 21 headers
-  */
- #if defined(__LP64__)
- static const uint32_t default_max_processors_count = 1024;
- #else
- static const uint32_t default_max_processors_count = 32;
- #endif
+ /*
+  * Android NDK headers before platform 21 do not define CPU_SETSIZE,
+  * so we hard-code its value, as defined in platform 21 headers
+  */
+ #if defined(__LP64__)
+ static const uint32_t default_max_processors_count = 1024;
+ #else
+ static const uint32_t default_max_processors_count = 32;
+ #endif
  #else
- static const uint32_t default_max_processors_count = CPU_SETSIZE;
+ static const uint32_t default_max_processors_count = CPU_SETSIZE;
  #endif
  
  
  
  #if !defined(__ANDROID__)
- /*
-  * sched.h is only used for CPU_SETSIZE constant.
-  * Android NDK headers before platform 21 do have this constant in sched.h
-  */
- #include 
+ /*
+  * sched.h is only used for CPU_SETSIZE constant.
+  * Android NDK headers before platform 21 do have this constant in sched.h
+  */
+ #include 
  #endif
  
  
  
  and resolving includes:
  
  x86_64-linux-gnu/bits/cpu-set.h:
  
  /* Size definition for CPU sets. */
  #define __CPU_SETSIZE 1024
  
  
  
  And the warning:
  
  Warning in cpuinfo: kernel_max value of 8191 parsed from
  /sys/devices/system/cpu/kernel_max exceeds platform-default limit 1023
  
  Will always be displayed in Ubuntu OS, when it should NOT (does not make
  any sense to trigger a warning for something that can't be changed).
  
  Should ubuntu update sched.h and/or cpu-set.h to reflect its decision in
  using 8192 max CPUs ?

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1840847

Title:
  cpuinfo_linux_get_max_processors_count always warns Ubuntu default MAX
  cpu values (stderr)

Status in cpuinfo package in Ubuntu:
  New
Status in linux package in Ubuntu:
  Incomplete

Bug description:
  From bug:

  https://bugs.launchpad.net/bugs/1840511

  clockhouse builds test started failing because of the presence of
  stderr whenever using the function:

  cpuinfo_linux_get_max_processors_count(void)

  From cpuid library.

  This happens because:

  

  #if defined(__ANDROID__) && !defined(CPU_SETSIZE)
  /*
   * Android NDK headers before platform 21 do not define CPU_SETSIZE,
   * so we hard-code its value, as defined in platform 21 headers
   */
  #if defined(__LP64__)
  static const uint32_t default_max_processors_count = 1024;
  #else
  static const uint32_t default_max_processors_count = 32;
     

[Kernel-packages] [Bug 1828495] Re: [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

2019-08-20 Thread Rafael David Tinoco
Definitely! Will provide feedback soon!

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1828495

Title:
  [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

Status in intel:
  New
Status in libvirt package in Ubuntu:
  In Progress
Status in linux package in Ubuntu:
  In Progress
Status in qemu package in Ubuntu:
  Fix Released
Status in libvirt source package in Bionic:
  Confirmed
Status in linux source package in Bionic:
  Confirmed
Status in qemu source package in Bionic:
  Fix Released
Status in libvirt source package in Disco:
  Confirmed
Status in linux source package in Disco:
  Confirmed
Status in qemu source package in Disco:
  Fix Released
Status in libvirt source package in Eoan:
  In Progress
Status in linux source package in Eoan:
  In Progress
Status in qemu source package in Eoan:
  Fix Released

Bug description:
  [Impact]

   * QEMU does not support IceLake and CascadeLake CPUs specific features.
   * Most important feature to be supported is: IA32_ARCH_CAPABILITIES MSR.
   * With IA32_ARCH_CAPABILITIES, QEMU is able to advertise HW mitigations:
 - Rogue Data Cache Load
 - Enhanced IBRS
 - RSB Alternate
 - L1D flush need on VMENTRY
 - speculative Store Bypass
 to guests, as described in document:
 Intel 336996-Speculative-Execution-Side-Channel-Mitigations.pdf

  [Test Case]

   * From Original Description:

  """
  1. Boot up guest using: -cpu Cascadelake-Server

  [root@clx-2s2 yexin]# qemu-system-x86_64 -accel kvm -drive
  if=virtio,id=hd,file=/home/x/x,format=qcow2  -m 4096 -smp 4 -cpu
  Cascadelake-Server -serial stdio

  char device redirected to /dev/pts/3 (label serial0)

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  2. To check CPU ID related to features[FEAT_7_0_EDX]
  :CPUID_7_0_EDX_ARCH_CAPABILITIES

  Expected Result: Both host and guest's CPUID.07H EDX bit 29 should be
  1.

  Actual Result:

  Host's cpuid: 0x0007 0x00: eax=0x ebx=0xd39b
  ecx=0x0818 edx=0xbc00  (EDX bit 29=1)

  Guest's cpuid : 0x0007 0x00: eax=0x ebx=0xd19f0fb9
  ecx=0x0818 edx=0x8400 (EDX bit 29=0)

  Commit:2bdb76c015df7125783d8394d6339d181cb5bc30

  Target Kerned: 5.1
  Target Release: 19.10

  """

  [Regression Potential]

   * Most changes are related to CPU type definitions and its supported
  features. They are all based in upstream changes but, for obvious
  reasons, backporting and/or cherry-picking those could bring issues.
  Biggest concern is breaking something that currently works. Right now,
  the parts being changed that could affect other CPU types would be
  related to a small refactoring of how the features are organized, and
  that would be seen right away when trying to start a new VM after the
  package is installed.

   * Other tests, related to the features being backported, are being
  done by our KVM regression tests, including migration combinations, to
  reduce chances that a regression is introduced.

  [Other Info]
   
   * N/A

To manage notifications about this bug go to:
https://bugs.launchpad.net/intel/+bug/1828495/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1496942] Re: Infiniband (mellanox) SR-IOV and libvirt + libnl problems

2019-08-15 Thread Rafael David Tinoco
This bug was related to incompatibilities between dkms provided by the
Mellanox OFED - implementing some new netlink protocol addons - and
Ubuntu kernel. This type of issues have already been addressed between
Canonical and Mellanox (but might occur again while Mellanox OFED is
using for RDMA and IB related setups).

** Changed in: linux (Ubuntu)
   Status: Triaged => Incomplete

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1496942

Title:
  Infiniband (mellanox) SR-IOV and libvirt + libnl problems

Status in linux package in Ubuntu:
  Incomplete
Status in linux package in Debian:
  New

Bug description:
  When trying to start an IB SR-IOV guest by using the following XML:

  


  


  

  following the Mellanox SR-IOV guide, we are able to start guests using
  kernel 3.16 (Utopic).

  We are NOT able to start guests using 3.13 OR 3.19. The following
  error occurs:

  2015-09-17 02:25:07.208+: 52157: info : libvirt version: 1.2.12, package: 
1.2.12-0ubuntu14.1~cloud0
  2015-09-17 02:25:07.208+: 52157: error : virSecurityDriverLookup:80 : 
unsupported configuration: Security driver apparmor not enabled
  2015-09-17 02:25:42.308+: 52281: info : libvirt version: 1.2.12, package: 
1.2.12-0ubuntu14.1~cloud0
  2015-09-17 02:25:42.308+: 52281: error : virSecurityDriverLookup:80 : 
unsupported configuration: Security driver apparmor not enabled
  2015-09-17 02:25:48.996+: 52274: error : virNetDevParseVfConfig:1905 : 
internal error: missing IFLA_VF_INFO in netlink response
  2015-09-17 02:25:49.006+: 52274: error : virFileReadAll:1347 : Failed to 
open file '/var/run/libvirt/hostdevmgr/ib0_vf0': No such file or directory
  2015-09-17 02:25:49.006+: 52274: error : virFileReadAll:1347 : Failed to 
open file '/var/run/libvirt/qemu/ib0_vf0': No such file or directory

  So probably there is some regression in between 3.16 and 3.19 for the
  IFLA_VF_INFO feature from netlink AND this has to be backported to
  kernel 3.13 for Trusty to have IB SR-IOV working.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1496942/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1828495] Re: [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

2019-08-06 Thread Rafael David Tinoco
>From the MR:

https://code.launchpad.net/~rafaeldtinoco/ubuntu/+source/qemu/+git/qemu/+merge/368804/+index?

I'm testing now the Bionic version in -proposed: 7.17

Containing the missing MDS-NO arch-capabilities flag.

Running the following command:

$ sudo /usr/bin/qemu-system-x86_64 -name guest="guest" -machine
accel=kvm -cpu host,+arch-capabilities,+ssbd,+md-clear,+rdctl-no,+ibrs-
all,+skip-l1dfl-vmentry,+mds-no -m 2048 -realtime mlock=off -smp
1,sockets=1,cores=1,threads=1 -uuid 7e55c71a-558f-412c-8445-db0e95fc549f
-display none -no-user-config -nodefaults -rtc base=utc,driftfix=slew
-global kvm-pit.lost_tick_policy=delay -no-shutdown -global
PIIX4_PM.disable_s3=1 -global PIIX4_PM.disable_s4=1 -boot strict=on
-kernel /var/lib/libvirt/images/guest/vmlinuz -initrd
/var/lib/libvirt/images/guest/initrd.img -append "root=/dev/vda noresume
console=tty0 console=ttyS0,38400n8 apparmor=0 net.ifnames=0
crashkernel=256M" -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2
-drive
file=/var/lib/libvirt/images/guest/disk01.ext4.qcow2,format=qcow2,if=none,id
=drive-virtio-disk0 -device virtio-blk-
pci,scsi=off,bus=pci.0,addr=0x3,drive=drive-virtio-disk0,id=virtio-
disk0,bootindex=1 -device virtio-balloon-
pci,id=balloon0,bus=pci.0,addr=0x4 -msg timestamp=on -serial stdio

This is the cpu_flags:

flags   : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov 
pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm 
constant_tsc arch_perfmon rep_good nopl xtopology cpuid tsc_known_freq pni 
pclmulqdq vmx ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt 
tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 
3dnowprefetch cpuid_fault invpcid_single ssbd ibrs ibpb ibrs_enhanced 
tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep 
bmi2 erms invpcid rtm mpxavx512f avx512dq rdseed adx smap clflushopt clwb 
avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves arat umip pku ospke 
avx512_vnni md_clear arch_capabilities
bugs: spectre_v1 spectre_v2 spec_store_bypass

And reading MSR directly:

$ sudo rdmsr 0x10a
2b

We also have bits in place: 0 1 3 5, meaning it is good for all
announced mitigations.

Note: Running the same command with Cascadelake-Server as cpu has the
same results.

--

Running Cascadelake-Server CPU without setting any CPU flags:

flags   : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov 
pat pse36 clflush mmx fxsr sse sse2 syscall nx pdpe1gb rdtscp lm constant_tsc 
rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid 
sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand 
hypervisor lahf_lm abm 3dnowprefetch cpuid_fault invpcid_single pti ssbd ibrs 
ibpb fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq 
rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec 
xgetbv1 arat pku ospke avx512_vnni arch_capabilities
bugs: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds

$ sudo rdmsr 0x10a
0

Expected as we are not enabling the mitigations by default.

--

With all the tests I'm setting disco -proposed package: 2.11+dfsg-
1ubuntu7.17 as verified.

** Tags removed: verification-needed verification-needed-bionic
** Tags added: verification-done verification-done-bionic

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1828495

Title:
  [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

Status in intel:
  New
Status in libvirt package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  In Progress
Status in qemu package in Ubuntu:
  Fix Released
Status in libvirt source package in Bionic:
  Confirmed
Status in linux source package in Bionic:
  Confirmed
Status in qemu source package in Bionic:
  Fix Committed
Status in libvirt source package in Cosmic:
  Won't Fix
Status in linux source package in Cosmic:
  Won't Fix
Status in qemu source package in Cosmic:
  Won't Fix
Status in libvirt source package in Disco:
  Confirmed
Status in linux source package in Disco:
  Confirmed
Status in qemu source package in Disco:
  Fix Committed
Status in libvirt source package in Eoan:
  Fix Released
Status in linux source package in Eoan:
  In Progress
Status in qemu source package in Eoan:
  Fix Released

Bug description:
  [Impact]

   * QEMU does not support IceLake and CascadeLake CPUs specific features.
   * Most important feature to be supported is: IA32_ARCH_CAPABILITIES MSR.
   * With IA32_ARCH_CAPABILITIES, QEMU is able to advertise HW mitigations:
 - Rogue Data Cache Load
 - Enhanced IBRS
 - RSB Alternate
 - L1D flush need on VMENTRY
 - speculative Store Bypass
 to guests, as described in document:
 Intel 336996-Speculative-Execution-Side-Channel-Mitigations.pdf

  [Test Case]

[Kernel-packages] [Bug 1828495] Re: [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

2019-08-05 Thread Rafael David Tinoco
I'll wait for the next SRU for bionic to be in -proposed to provide
Bionic full verification just like I did to Disco. It shall not take too
long and the version currently in -proposed will be superseded by the
one we have in the merge request right now.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1828495

Title:
  [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

Status in intel:
  New
Status in libvirt package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  In Progress
Status in qemu package in Ubuntu:
  Fix Released
Status in libvirt source package in Bionic:
  Confirmed
Status in linux source package in Bionic:
  Confirmed
Status in qemu source package in Bionic:
  Fix Committed
Status in libvirt source package in Cosmic:
  Won't Fix
Status in linux source package in Cosmic:
  Won't Fix
Status in qemu source package in Cosmic:
  Won't Fix
Status in libvirt source package in Disco:
  Confirmed
Status in linux source package in Disco:
  Confirmed
Status in qemu source package in Disco:
  Fix Committed
Status in libvirt source package in Eoan:
  Fix Released
Status in linux source package in Eoan:
  In Progress
Status in qemu source package in Eoan:
  Fix Released

Bug description:
  [Impact]

   * QEMU does not support IceLake and CascadeLake CPUs specific features.
   * Most important feature to be supported is: IA32_ARCH_CAPABILITIES MSR.
   * With IA32_ARCH_CAPABILITIES, QEMU is able to advertise HW mitigations:
 - Rogue Data Cache Load
 - Enhanced IBRS
 - RSB Alternate
 - L1D flush need on VMENTRY
 - speculative Store Bypass
 to guests, as described in document:
 Intel 336996-Speculative-Execution-Side-Channel-Mitigations.pdf

  [Test Case]

   * From Original Description:

  """
  1. Boot up guest using: -cpu Cascadelake-Server

  [root@clx-2s2 yexin]# qemu-system-x86_64 -accel kvm -drive
  if=virtio,id=hd,file=/home/x/x,format=qcow2  -m 4096 -smp 4 -cpu
  Cascadelake-Server -serial stdio

  char device redirected to /dev/pts/3 (label serial0)

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  qemu-system-x86_64: warning: host doesn't support requested feature:
  CPUID.07H:ECX [bit 4]

  2. To check CPU ID related to features[FEAT_7_0_EDX]
  :CPUID_7_0_EDX_ARCH_CAPABILITIES

  Expected Result: Both host and guest's CPUID.07H EDX bit 29 should be
  1.

  Actual Result:

  Host's cpuid: 0x0007 0x00: eax=0x ebx=0xd39b
  ecx=0x0818 edx=0xbc00  (EDX bit 29=1)

  Guest's cpuid : 0x0007 0x00: eax=0x ebx=0xd19f0fb9
  ecx=0x0818 edx=0x8400 (EDX bit 29=0)

  Commit:2bdb76c015df7125783d8394d6339d181cb5bc30

  Target Kerned: 5.1
  Target Release: 19.10

  """

  [Regression Potential]

   * Most changes are related to CPU type definitions and its supported
  features. They are all based in upstream changes but, for obvious
  reasons, backporting and/or cherry-picking those could bring issues.
  Biggest concern is breaking something that currently works. Right now,
  the parts being changed that could affect other CPU types would be
  related to a small refactoring of how the features are organized, and
  that would be seen right away when trying to start a new VM after the
  package is installed.

   * Other tests, related to the features being backported, are being
  done by our KVM regression tests, including migration combinations, to
  reduce chances that a regression is introduced.

  [Other Info]
   
   * N/A

To manage notifications about this bug go to:
https://bugs.launchpad.net/intel/+bug/1828495/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp


[Kernel-packages] [Bug 1828495] Re: [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

2019-08-05 Thread Rafael David Tinoco
# Disco verification:

ubuntu@disco:~$ sudo /usr/bin/qemu-system-x86_64 -name guest="guest"
-machine accel=kvm -cpu host,+arch-capabilities,+ssbd,+md-clear,+rdctl-
no,+ibrs-all,+skip-l1dfl-vmentry,+mds-no -m 2048 -realtime mlock=off
-smp 1,sockets=1,cores=1,threads=1 -uuid 7e55c71a-558f-
412c-8445-db0e95fc549f -display none -no-user-config -nodefaults -rtc
base=utc,driftfix=slew -global kvm-pit.lost_tick_policy=delay -no-
shutdown -global PIIX4_PM.disable_s3=1 -global PIIX4_PM.disable_s4=1
-boot strict=on -kernel /var/lib/libvirt/images/guest/vmlinuz -initrd
/var/lib/libvirt/images/guest/initrd.img -append "root=/dev/vda noresume
console=tty0 console=ttyS0,38400n8 apparmor=0 net.ifnames=0
crashkernel=256M" -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2
-drive
file=/var/lib/libvirt/images/guest/disk01.ext4.qcow2,format=qcow2,if=none,id
=drive-virtio-disk0 -device virtio-blk-
pci,scsi=off,bus=pci.0,addr=0x3,drive=drive-virtio-disk0,id=virtio-
disk0,bootindex=1 -device virtio-balloon-
pci,id=balloon0,bus=pci.0,addr=0x4 -msg timestamp=on -serial stdio

-> changing "host" to CascadeLake-Server also works the same way.

Provided me:

inaddy@guest:~$ cat /proc/cpuinfo
processor   : 0
vendor_id   : GenuineIntel
cpu family  : 6
model   : 85
model name  : Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
stepping: 6
microcode   : 0x1
cpu MHz : 2095.076
cache size  : 16384 KB
physical id : 0
siblings: 1
core id : 0
cpu cores   : 1
apicid  : 0
initial apicid  : 0
fpu : yes
fpu_exception   : yes
cpuid level : 13
wp  : yes
flags   : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov 
pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm 
constant_tsc arch_perfmon rep_good nopl xtopology cpuid tsc_known_freq pni 
pclmulqdq vmx ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt 
tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 
3dnowprefetch cpuid_fault invpcid_single ssbd ibrs ibpb ibrs_enhanced 
tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep 
bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb 
avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves arat umip pku ospke 
avx512_vnni md_clear arch_capabilities
bugs: spectre_v1 spectre_v2 spec_store_bypass
bogomips: 4190.15
clflush size: 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
power management:

AND reading the MSR directly:

inaddy@guest:~$ sudo rdmsr 0x10a
2b

We have bits: 0 1 3 and 5 like it should be.

-

Running same QEMU cmd line, enabling +arch-capabilities in CascadeLake-
Server but without specifying any other CPU flags:

flags   : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov 
pat pse36 clflush mmx fxsr sse sse2 syscall nx pdpe1gb rdtscp lm constant_tsc 
rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid 
sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand 
hypervisor lahf_lm abm 3dnowprefetch cpuid_fault invpcid_single pti ssbd ibrs 
ibpb fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq 
rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec 
xgetbv1 arat pku ospke avx512_vnni arch_capabilities
bugs: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds

inaddy@guest:~$ sudo rdmsr 0x10a
0

We are not enabling any mitigation flag in arch-capabilities MSR by
default, like we planned so. All CPU capabilities are going to be
enabled by hand and/or through libvirt XML definitions as soon as
libvirt gets the capabilities (this same bug).

-

Marking Disco as verified.

Thank you!


** Tags removed: verification-needed-disco
** Tags added: verification-done-disco

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1828495

Title:
  [KVM][CLX] CPUID_7_0_EDX_ARCH_CAPABILITIES is not enabled in VM.

Status in intel:
  New
Status in libvirt package in Ubuntu:
  Fix Released
Status in linux package in Ubuntu:
  In Progress
Status in qemu package in Ubuntu:
  Fix Released
Status in libvirt source package in Bionic:
  Confirmed
Status in linux source package in Bionic:
  Confirmed
Status in qemu source package in Bionic:
  Fix Committed
Status in libvirt source package in Cosmic:
  Won't Fix
Status in linux source package in Cosmic:
  Won't Fix
Status in qemu source package in Cosmic:
  Won't Fix
Status in libvirt source package in Disco:
  Confirmed
Status in linux source package in Disco:
  Confirmed
Status in qemu source package in Disco:
  Fix Committed
Status in libvirt source package in Eoan:
  Fix Released
Status in linux source package in Eoan:
  In Progress
Status in qemu source package in Eoan:
  Fix Released

Bug 

  1   2   3   4   5   6   >