Re: ACS 14.16.1::XCP-ng 8.2.1 - Secondary storage mount issue|Volume Snapshot
Hi Vivek/Nux, Thanks for the response. @vivek I was able to manually mount the secondary storage to xen server, But strange factor is that it was already mounted by cloudstack with Version 4.1 As you have mentioned Changing the NFS version to v3 in global settings worked, Now Volume snapshot and Vm creation works fine. Thank you Midhun Jose - Original Message - From: "Nux" To: "users" Cc: "Vivek Kumar" Sent: Tuesday, April 5, 2022 12:01:45 PM Subject: Re: ACS 14.16.1::XCP-ng 8.2.1 - Secondary storage mount issue|Volume Snapshot Hi, What Vivek said, also make sure there is no firewall between hypervisor and sec storage, or at least disable it temporarily to rule things out. NFSv3 and v4 are slightly different at network level, some port difference etc. --- Nux! www.nux.ro On 2022-04-05 07:25, Vivek Kumar wrote: > Hey Midhun, > > This error is you see is coming from the XenServer, looks like it’s > not able to mount the NFS on the destination directory, I know you > have verified the mount point but can you try to manually mount your > secondary storage on XenServer, also try checking the global settings > - secstorage.nfs.version to check and enforce your nfs version. > > Regards, > Vivek Kumar > > > > >> On 05-Apr-2022, at 11:25 AM, Midhun Jose >> wrote: >> >> >> Hi @all, >> >> I am using Apache cloudstack 4.16.1 integrated with XCP-ng 8.2.1. I am >> not able to take VM volume snapshot and sometimes vm creation is also >> not working. I am getting the error as attached screenshot and while >> checking the logs we are getting below error, >> >> P.S: I have veriifed that nfs server is working fine and secondary >> storage is mounted in xen server. Can someome piont out the reason on >> this.. >> >> ~~ >> 2022-04-04 13:13:44,163 WARN [c.c.h.x.r.CitrixResourceBase] >> (DirectAgent-17:ctx-f6381170) (logid:4835671f) Task failed! Task >> record: uuid: e907d695-825f-24e4-5ce3-afd74eb0ece4 >>nameLabel: Async.host.call_plugin >> nameDescription: >>allowedOperations: [] >>currentOperations: {} >> created: Mon Apr 04 13:13:43 IST 2022 >> finished: Mon Apr 04 13:13:43 IST 2022 >> status: failure >> residentOn: com.xensource.xenapi.Host@5fa0255a >> progress: 1.0 >> type: >> result: >>errorInfo: [XENAPI_PLUGIN_FAILURE, >> mountNfsSecondaryStorage, SROSError, Error reporting error, unknown >> key Unexpected error while trying to mount >> 10.31.9.226:/storage/cloudstack/secondary/ to >> /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3] >> otherConfig: {} >>subtaskOf: com.xensource.xenapi.Task@aaf13f6f >> subtasks: [] >> 2022-04-04 13:13:44,173 WARN [c.c.h.x.r.CitrixResourceBase] >> (DirectAgent-17:ctx-f6381170) (logid:4835671f) callHostPlugin failed >> for cmd: mountNfsSecondaryStorage with args remoteDir: >> 10.31.9.226:/storage/cloudstack/secondary/, localDir: >> /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3, nfsVersion: >> null, due to Task failed! Task record: uuid: >> e907d695-825f-24e4-5ce3-afd74eb0ece4 >>nameLabel: Async.host.call_plugin >> nameDescription: >>allowedOperations: [] >>currentOperations: {} >> created: Mon Apr 04 13:13:43 IST 2022 >> finished: Mon Apr 04 13:13:43 IST 2022 >> status: failure >> residentOn: com.xensource.xenapi.Host@5fa0255a >> progress: 1.0 >> type: >> result: >>errorInfo: [XENAPI_PLUGIN_FAILURE, >> mountNfsSecondaryStorage, SROSError, Error reporting error, unknown >> key Unexpected error while trying to mount >> 10.31.9.226:/storage/cloudstack/secondary/ to >> /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3] >> otherConfig: {} >>subtaskOf: com.xensource.xenapi.Task@aaf13f6f >> subtasks: [] >> Task failed! Task record: uuid: >> e907d695-825f-24e4-5ce3-afd74eb0ece4 >>nameLabel: Async.host.call_plugin >> nameDescription: >>allowedOperations: [] >>currentOperations: {} >> created: Mon Apr 04 13:13:43 IST 2022 >> finished: Mon Apr 04 13:13:43 IST 2022 >> status: failure >> residentOn: com.xensource.xenapi.Host@5fa0255a >> progress: 1.0
Re: ACS 14.16.1::XCP-ng 8.2.1 - Secondary storage mount issue|Volume Snapshot
Hi, What Vivek said, also make sure there is no firewall between hypervisor and sec storage, or at least disable it temporarily to rule things out. NFSv3 and v4 are slightly different at network level, some port difference etc. --- Nux! www.nux.ro On 2022-04-05 07:25, Vivek Kumar wrote: Hey Midhun, This error is you see is coming from the XenServer, looks like it’s not able to mount the NFS on the destination directory, I know you have verified the mount point but can you try to manually mount your secondary storage on XenServer, also try checking the global settings - secstorage.nfs.version to check and enforce your nfs version. Regards, Vivek Kumar On 05-Apr-2022, at 11:25 AM, Midhun Jose wrote: Hi @all, I am using Apache cloudstack 4.16.1 integrated with XCP-ng 8.2.1. I am not able to take VM volume snapshot and sometimes vm creation is also not working. I am getting the error as attached screenshot and while checking the logs we are getting below error, P.S: I have veriifed that nfs server is working fine and secondary storage is mounted in xen server. Can someome piont out the reason on this.. ~~ 2022-04-04 13:13:44,163 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-17:ctx-f6381170) (logid:4835671f) Task failed! Task record: uuid: e907d695-825f-24e4-5ce3-afd74eb0ece4 nameLabel: Async.host.call_plugin nameDescription: allowedOperations: [] currentOperations: {} created: Mon Apr 04 13:13:43 IST 2022 finished: Mon Apr 04 13:13:43 IST 2022 status: failure residentOn: com.xensource.xenapi.Host@5fa0255a progress: 1.0 type: result: errorInfo: [XENAPI_PLUGIN_FAILURE, mountNfsSecondaryStorage, SROSError, Error reporting error, unknown key Unexpected error while trying to mount 10.31.9.226:/storage/cloudstack/secondary/ to /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3] otherConfig: {} subtaskOf: com.xensource.xenapi.Task@aaf13f6f subtasks: [] 2022-04-04 13:13:44,173 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-17:ctx-f6381170) (logid:4835671f) callHostPlugin failed for cmd: mountNfsSecondaryStorage with args remoteDir: 10.31.9.226:/storage/cloudstack/secondary/, localDir: /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3, nfsVersion: null, due to Task failed! Task record: uuid: e907d695-825f-24e4-5ce3-afd74eb0ece4 nameLabel: Async.host.call_plugin nameDescription: allowedOperations: [] currentOperations: {} created: Mon Apr 04 13:13:43 IST 2022 finished: Mon Apr 04 13:13:43 IST 2022 status: failure residentOn: com.xensource.xenapi.Host@5fa0255a progress: 1.0 type: result: errorInfo: [XENAPI_PLUGIN_FAILURE, mountNfsSecondaryStorage, SROSError, Error reporting error, unknown key Unexpected error while trying to mount 10.31.9.226:/storage/cloudstack/secondary/ to /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3] otherConfig: {} subtaskOf: com.xensource.xenapi.Task@aaf13f6f subtasks: [] Task failed! Task record: uuid: e907d695-825f-24e4-5ce3-afd74eb0ece4 nameLabel: Async.host.call_plugin nameDescription: allowedOperations: [] currentOperations: {} created: Mon Apr 04 13:13:43 IST 2022 finished: Mon Apr 04 13:13:43 IST 2022 status: failure residentOn: com.xensource.xenapi.Host@5fa0255a progress: 1.0 type: result: errorInfo: [XENAPI_PLUGIN_FAILURE, mountNfsSecondaryStorage, SROSError, Error reporting error, unknown key Unexpected error while trying to mount 10.31.9.226:/storage/cloudstack/secondary/ to /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3] otherConfig: {} subtaskOf: com.xensource.xenapi.Task@aaf13f6f subtasks: [] Task failed! Task record: uuid: e907d695-825f-24e4-5ce3-afd74eb0ece4 nameLabel: Async.host.call_plugin nameDescription: allowedOperations: [] currentOperations: {} created: Mon Apr 04 13:13:43 IST 2022 finished: Mon Apr 04 13:13:43 IST 2022 status: failure residentOn: com.xensource.xenapi.Host@5fa0255a progress: 1.0 type: result: errorInfo: [XENAPI_PLUGIN_FAILURE, mountNfsSecondaryStorage, SROSError, Error reporting error, unknown key Unexpected error while trying to mount 10.31.9.226:/storage/cloudstack/secondary/ to /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3] otherConfig: {} subtaskOf: com.xensource.xenapi.Task@aaf13f6f subtasks: [] at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.check
Re: ACS 14.16.1::XCP-ng 8.2.1 - Secondary storage mount issue|Volume Snapshot
Hey Midhun, This error is you see is coming from the XenServer, looks like it’s not able to mount the NFS on the destination directory, I know you have verified the mount point but can you try to manually mount your secondary storage on XenServer, also try checking the global settings - secstorage.nfs.version to check and enforce your nfs version. Regards, Vivek Kumar > On 05-Apr-2022, at 11:25 AM, Midhun Jose wrote: > > > Hi @all, > > I am using Apache cloudstack 4.16.1 integrated with XCP-ng 8.2.1. I am not > able to take VM volume snapshot and sometimes vm creation is also not > working. I am getting the error as attached screenshot and while checking the > logs we are getting below error, > > P.S: I have veriifed that nfs server is working fine and secondary storage is > mounted in xen server. Can someome piont out the reason on this.. > > ~~ > 2022-04-04 13:13:44,163 WARN [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-17:ctx-f6381170) (logid:4835671f) Task failed! Task record: >uuid: e907d695-825f-24e4-5ce3-afd74eb0ece4 >nameLabel: Async.host.call_plugin > nameDescription: >allowedOperations: [] >currentOperations: {} > created: Mon Apr 04 13:13:43 IST 2022 > finished: Mon Apr 04 13:13:43 IST 2022 > status: failure > residentOn: com.xensource.xenapi.Host@5fa0255a > progress: 1.0 > type: > result: >errorInfo: [XENAPI_PLUGIN_FAILURE, mountNfsSecondaryStorage, > SROSError, Error reporting error, unknown key Unexpected error while trying > to mount 10.31.9.226:/storage/cloudstack/secondary/ to > /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3] > otherConfig: {} >subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > 2022-04-04 13:13:44,173 WARN [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-17:ctx-f6381170) (logid:4835671f) callHostPlugin failed for cmd: > mountNfsSecondaryStorage with args remoteDir: > 10.31.9.226:/storage/cloudstack/secondary/, localDir: > /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3, nfsVersion: null, due > to Task failed! Task record: uuid: > e907d695-825f-24e4-5ce3-afd74eb0ece4 >nameLabel: Async.host.call_plugin > nameDescription: >allowedOperations: [] >currentOperations: {} > created: Mon Apr 04 13:13:43 IST 2022 > finished: Mon Apr 04 13:13:43 IST 2022 > status: failure > residentOn: com.xensource.xenapi.Host@5fa0255a > progress: 1.0 > type: > result: >errorInfo: [XENAPI_PLUGIN_FAILURE, mountNfsSecondaryStorage, > SROSError, Error reporting error, unknown key Unexpected error while trying > to mount 10.31.9.226:/storage/cloudstack/secondary/ to > /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3] > otherConfig: {} >subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > Task failed! Task record: uuid: > e907d695-825f-24e4-5ce3-afd74eb0ece4 >nameLabel: Async.host.call_plugin > nameDescription: >allowedOperations: [] >currentOperations: {} > created: Mon Apr 04 13:13:43 IST 2022 > finished: Mon Apr 04 13:13:43 IST 2022 > status: failure > residentOn: com.xensource.xenapi.Host@5fa0255a > progress: 1.0 > type: > result: >errorInfo: [XENAPI_PLUGIN_FAILURE, mountNfsSecondaryStorage, > SROSError, Error reporting error, unknown key Unexpected error while trying > to mount 10.31.9.226:/storage/cloudstack/secondary/ to > /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3] > otherConfig: {} >subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > Task failed! Task record: uuid: > e907d695-825f-24e4-5ce3-afd74eb0ece4 >nameLabel: Async.host.call_plugin > nameDescription: >allowedOperations: [] >currentOperations: {} > created: Mon Apr 04 13:13:43 IST 2022 > finished: Mon Apr 04 13:13:43 IST 2022 > status: failure > residentOn: com.xensource.xenapi.Host@5fa0255a > progress: 1.0 > type: > result: >errorInfo: [XENAPI_PLUGIN_FAILURE, mountNfsSecondaryStorage, > SROSError, Error reporting error, unknown key Unexpected error while trying > to mount 10.31.9.226:/storage/cloudstack/secondary/ to > /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3] > otherConfig: {} >subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > at > com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.checkForSuccess(CitrixResourceBase.java:500) > at > com.cloud.hypervisor.xenserver.resource.CitrixRes