Re: VM paused during multipath iSCSI reservation

2021-10-13 Thread Vojtech Juranek
I'm sorry, I send it here by mistake. Wanted to send it to libvirt-user list.
Sorry for that.
Vojta

On Wednesday, 13 October 2021 14:21:02 CEST you wrote:
> Hi,
> I'm trying to find the root cause for BZ #1898049 [1]. When setting up
> Windows HA cluster on Windows Server VMs run on top of oVirt, Windows
> cluster validator runs couple of tests and fails during test "Validate
> SCSI-3 Persistent Reservation" and one of the VMs of the cluster is paused
> with IO error. Disk definition is as follows:
> 
> 
> 
>io='native'/>  index='1'> 
> 
>path='/var/lib/libvirt/qemu/domain-1-Windows-2016-2/pr-helper0.sock'
> mode='client'/> 
>   
>   
>   
>   
>   
>   
> 
> 
> and libvirt error I get is bellow [2].
> 
> When I try to create reservation from Windows VM manually, I get following
> error (but not sure I do it whole process correctly):
> 
> .\sg_persist --out --register --param-sark=123abc e:
> QEMU   QEMU HARDDISK   2.5+
> Peripheral device type: disk
> PR out (Register): command not supported
> sg_persist failed: Illegal request, Invalid opcode
> 
> 
> Do you have any ideas what could be wrong or how to determine
> the root cause of this this issue?
> 
> Thanks in advance.
> Vojta
> 
> 
> [1] https://bugzilla.redhat.com/1898049
> [2] libvirt debug log:
> 
> 2021-10-12 11:43:25.148+: 2006427: debug : qemuMonitorEmitIOError:1243 :
> mon=0x7fb02006a020 2021-10-12 11:43:25.148+: 2006427: info :
> virObjectRef:402 : OBJECT_REF: obj=0x7fb02006a020 2021-10-12
> 11:43:25.148+: 2006427: info : virObjectRef:402 : OBJECT_REF:
> obj=0x7fafd0130020 2021-10-12 11:43:25.148+: 2000208: info :
> virObjectRef:402 : OBJECT_REF: obj=0x7fafd010d340 2021-10-12
> 11:43:25.148+: 2006427: info : virObjectNew:258 : OBJECT_NEW:
> obj=0x7fb020082590 classname=virDomainEventIOError 2021-10-12
> 11:43:25.148+: 2000208: info : vir_object_finalize:321 :
> OBJECT_DISPOSE: obj=0x7fb020082500 2021-10-12 11:43:25.148+: 2006427:
> info : virObjectNew:258 : OBJECT_NEW: obj=0x7fb020082620
> classname=virDomainEventIOError 2021-10-12 11:43:25.148+: 2000208: info
> : virObjectUnref:380 : OBJECT_UNREF: obj=0x7fb020082500 2021-10-12
> 11:43:25.148+: 2006427: debug : qemuProcessHandleIOError:907 :
> Transitioned guest Windows-2016-2 to paused state due to IO error
> 2021-10-12 11:43:25.148+: 2000208: info : virObjectUnref:380 :
> OBJECT_UNREF: obj=0x7fafd010d340 2021-10-12 11:43:25.148+: 2006427:
> info : virObjectNew:258 : OBJECT_NEW: obj=0x7fafbc1fb8c0
> classname=virDomainEventLifecycle 2021-10-12 11:43:25.148+: 2006427:
> debug : virDomainLockProcessPause:204 : plugin=0x7fafd01272a0
> dom=0x7fb01400f5e0 state=0x7fb02401d768 2021-10-12 11:43:25.148+:
> 2006427: debug : virDomainLockManagerNew:134 : plugin=0x7fafd01272a0
> dom=0x7fb01400f5e0 withResources=1 2021-10-12 11:43:25.148+: 2006427:
> debug : virLockManagerPluginGetDriver:276 : plugin=0x7fafd01272a0
> 2021-10-12 11:43:25.148+: 2006427: debug : virLockManagerNew:300 :
> driver=0x7fafd444a000 type=0 nparams=5 params=0x7fafd77de640 flags=0x0
> 2021-10-12 11:43:25.148+: 2006427: debug : virLockManagerLogParams:97 :
>   key=uuid type=uuid value=70eee88c-ba2c-4c6c-bd51-c2b663db27f8 2021-10-12
> 11:43:25.148+: 2006427: debug : virLockManagerLogParams:90 :   key=name
> type=string value=Windows-2016-2 2021-10-12 11:43:25.148+: 2006427:
> debug : virLockManagerLogParams:78 :   key=id type=uint value=1 2021-10-12
> 11:43:25.148+: 2006427: debug : virLockManagerLogParams:78 :   key=pid
> type=uint value=2006418 2021-10-12 11:43:25.148+: 2006427: debug :
> virLockManagerLogParams:93 :   key=uri type=cstring value=(null) 2021-10-12
> 11:43:25.148+: 2006427: debug : virDomainLockManagerNew:146 : Adding
> leases 2021-10-12 11:43:25.148+: 2006427: debug :
> virDomainLockManagerNew:151 : Adding disks 2021-10-12 11:43:25.149+:
> 2006427: debug : virDomainLockManagerAddImage:90 : Add disk
> /rhev/data-center/mnt/blockSD/7c4f09b6-9e87-436f-bda9-22d1f0b50955/images/f
> 5d6e074-dfe9-462d-8cfd-3e14b0eb5aea/766e36b2-84a6-43e7-a48b-a5f47e669860
> 2021-10-12 11:43:25.149+: 2006427: debug :
> virLockManagerAddResource:326 : lock=0x7fafbc19e250 type=0
> name=/rhev/data-center/mnt/blockSD/7c4f09b6-9e87-436f-bda9-22d1f0b50955/ima
> ges/f5d6e074-dfe9-462d-8cfd-3e14b0eb5aea/766e36b2-84a6-43e7-a48b-a5f47e66986
> 0 nparams=0 params=(nil) flags=0x0 2021-10-12 11:43:25.149+: 2006427:
> debug : virDomainLockManagerAddImage:90 : Add disk
> /dev/mapper/3600a09803830447a4f244c4657616f6f 2021-10-12 11:43:25.149+:
> 2006427: debug : virLockManagerAddResource:326 : lock=0x7fafbc19e250 type=0
> name=/dev/mapper/3600a09803830447a4f244c4657616f6f nparams=0 params=(nil)
> flags=0x2 2021-10-12 11:43:25.149+: 2006427: debug :
> virLockManagerRelease:359 : lock=0x7fafbc19e250 state=0x7fb02401d768
> flags=0x0 2021-10-12 11:43:25.149+: 2006427: debug

VM paused during multipath iSCSI reservation

2021-10-13 Thread Vojtech Juranek
Hi,
I'm trying to find the root cause for BZ #1898049 [1]. When setting up Windows 
HA 
cluster on Windows Server VMs run on top of oVirt, Windows cluster validator 
runs couple of tests 
and fails during test "Validate SCSI-3 Persistent Reservation" and one of the 
VMs of 
the cluster is paused with IO error. Disk definition is as follows:



  
  


  

  
  
  
  
  
  


and libvirt error I get is bellow [2].

When I try to create reservation from Windows VM manually, I get following error
(but not sure I do it whole process correctly):

.\sg_persist --out --register --param-sark=123abc e:
QEMU   QEMU HARDDISK   2.5+
Peripheral device type: disk
PR out (Register): command not supported
sg_persist failed: Illegal request, Invalid opcode


Do you have any ideas what could be wrong or how to determine
the root cause of this this issue?

Thanks in advance.
Vojta


[1] https://bugzilla.redhat.com/1898049
[2] libvirt debug log:

2021-10-12 11:43:25.148+: 2006427: debug : qemuMonitorEmitIOError:1243 : 
mon=0x7fb02006a020
2021-10-12 11:43:25.148+: 2006427: info : virObjectRef:402 : OBJECT_REF: 
obj=0x7fb02006a020
2021-10-12 11:43:25.148+: 2006427: info : virObjectRef:402 : OBJECT_REF: 
obj=0x7fafd0130020
2021-10-12 11:43:25.148+: 2000208: info : virObjectRef:402 : OBJECT_REF: 
obj=0x7fafd010d340
2021-10-12 11:43:25.148+: 2006427: info : virObjectNew:258 : OBJECT_NEW: 
obj=0x7fb020082590 classname=virDomainEventIOError
2021-10-12 11:43:25.148+: 2000208: info : vir_object_finalize:321 : 
OBJECT_DISPOSE: obj=0x7fb020082500
2021-10-12 11:43:25.148+: 2006427: info : virObjectNew:258 : OBJECT_NEW: 
obj=0x7fb020082620 classname=virDomainEventIOError
2021-10-12 11:43:25.148+: 2000208: info : virObjectUnref:380 : 
OBJECT_UNREF: obj=0x7fb020082500
2021-10-12 11:43:25.148+: 2006427: debug : qemuProcessHandleIOError:907 : 
Transitioned guest Windows-2016-2 to paused state due to IO error
2021-10-12 11:43:25.148+: 2000208: info : virObjectUnref:380 : 
OBJECT_UNREF: obj=0x7fafd010d340
2021-10-12 11:43:25.148+: 2006427: info : virObjectNew:258 : OBJECT_NEW: 
obj=0x7fafbc1fb8c0 classname=virDomainEventLifecycle
2021-10-12 11:43:25.148+: 2006427: debug : virDomainLockProcessPause:204 : 
plugin=0x7fafd01272a0 dom=0x7fb01400f5e0 state=0x7fb02401d768
2021-10-12 11:43:25.148+: 2006427: debug : virDomainLockManagerNew:134 : 
plugin=0x7fafd01272a0 dom=0x7fb01400f5e0 withResources=1
2021-10-12 11:43:25.148+: 2006427: debug : 
virLockManagerPluginGetDriver:276 : plugin=0x7fafd01272a0
2021-10-12 11:43:25.148+: 2006427: debug : virLockManagerNew:300 : 
driver=0x7fafd444a000 type=0 nparams=5 params=0x7fafd77de640 flags=0x0
2021-10-12 11:43:25.148+: 2006427: debug : virLockManagerLogParams:97 :   
key=uuid type=uuid value=70eee88c-ba2c-4c6c-bd51-c2b663db27f8
2021-10-12 11:43:25.148+: 2006427: debug : virLockManagerLogParams:90 :   
key=name type=string value=Windows-2016-2
2021-10-12 11:43:25.148+: 2006427: debug : virLockManagerLogParams:78 :   
key=id type=uint value=1
2021-10-12 11:43:25.148+: 2006427: debug : virLockManagerLogParams:78 :   
key=pid type=uint value=2006418
2021-10-12 11:43:25.148+: 2006427: debug : virLockManagerLogParams:93 :   
key=uri type=cstring value=(null)
2021-10-12 11:43:25.148+: 2006427: debug : virDomainLockManagerNew:146 : 
Adding leases
2021-10-12 11:43:25.148+: 2006427: debug : virDomainLockManagerNew:151 : 
Adding disks
2021-10-12 11:43:25.149+: 2006427: debug : virDomainLockManagerAddImage:90 
: Add disk 
/rhev/data-center/mnt/blockSD/7c4f09b6-9e87-436f-bda9-22d1f0b50955/images/f5d6e074-dfe9-462d-8cfd-3e14b0eb5aea/766e36b2-84a6-43e7-a48b-a5f47e669860
2021-10-12 11:43:25.149+: 2006427: debug : virLockManagerAddResource:326 : 
lock=0x7fafbc19e250 type=0 
name=/rhev/data-center/mnt/blockSD/7c4f09b6-9e87-436f-bda9-22d1f0b50955/images/f5d6e074-dfe9-462d-8cfd-3e14b0eb5aea/766e36b2-84a6-43e7-a48b-a5f47e669860
 nparams=0 params=(nil) flags=0x0
2021-10-12 11:43:25.149+: 2006427: debug : virDomainLockManagerAddImage:90 
: Add disk /dev/mapper/3600a09803830447a4f244c4657616f6f
2021-10-12 11:43:25.149+: 2006427: debug : virLockManagerAddResource:326 : 
lock=0x7fafbc19e250 type=0 name=/dev/mapper/3600a09803830447a4f244c4657616f6f 
nparams=0 params=(nil) flags=0x2
2021-10-12 11:43:25.149+: 2006427: debug : virLockManagerRelease:359 : 
lock=0x7fafbc19e250 state=0x7fb02401d768 flags=0x0
2021-10-12 11:43:25.149+: 2006427: debug : virLockManagerFree:381 : 
lock=0x7fafbc19e250
2021-10-12 11:43:25.149+: 2006427: debug : qemuProcessHandleIOError:920 : 
Preserving lock state ''
2021-10-12 11:43:25.150+: 2006427: info : virObjectUnref:380 : 
OBJECT_UNREF: obj=0x7fafd0130020
2021-10-12 11:43:25.150+: 2006427: info : virObjectUnref:380 : 
OBJECT_UNREF: obj=0x7fb02006a020
2021-10-12 11:43:25.150+: 2000208: info :