AW: nvidia tesla grid card implementation (kvm)
Hi Marc, thanks for reply. I see the passthrough mode but i need to use it with different virtual machines. Should I open a jira ticket for implementation? Thanks Sven -Ursprüngliche Nachricht- Von: Marc-Aurèle Brothier [mailto:ma...@exoscale.ch] Gesendet: Mittwoch, 24. Mai 2017 09:38 An: dev@cloudstack.apache.org Betreff: Re: nvidia tesla grid card implementation (kvm) Hi Sven, We implemented for KVM a pci manager to give a pass through to any PCI devices. We use that to provision VM with Tesla P100 GPU card, 1 to 4 cards per VM. My code is based on CS 4.4.2 and not the upstream version as we are not following anymore upstream. But I completely got rid of Xen implementation because the design could only fit Xen server way of dealing with GPU card. It's not something that I can push upstream. Here is an example of the XML definition of a VM which has 4 GPU cards: ... You have to map the exact source pci bus of the Nvidia cards from the host in the XML. It a pass-through, meaning that the full card is given to the VM, therefore it cannot be shared across multiple VMs. Hope that helps Marco On Mon, May 22, 2017 at 4:22 PM, Vogel, Sven wrote: > Hi Nitin, > > thanks for your answer. I mean the xml file for the VM which will > always be defined from cloudstack for the kvm hyervisor when we start a > machine. > > https://access.redhat.com/documentation/en-US/Red_Hat_ > Enterprise_Linux/7/html/Virtualization_Deployment_and_ > Administration_Guide/chap-Guest_virtual_machine_device_ > configuration.html#sect-device-GPU > > https://griddownloads.nvidia.com/flex/GRID_4_2_Support_Matrix.pdf > > e.g. > > > pci__02_00_0 > /sys/devices/pci:00/:00:03.0/:02:00.0 > pci__00_03_0 > > pci-stub > > > 0 > 2 > 0 > 0 > GK106GL [Quadro K4000] > NVIDIA Corporation > > > > > > > > > > > > > I think xen should be supported. What do you think? > > Sven Vogel > > -Ursprüngliche Nachricht- > Von: Nitin Kumar Maharana [mailto:nitinkumar.mahar...@accelerite.com] > Gesendet: Montag, 22. Mai 2017 16:03 > An: dev@cloudstack.apache.org > Betreff: Re: nvidia tesla grid card implementation (kvm) > > Hi Sven, > > Currently the K1 and K2 cards are only supported in XenServer. > For other cards we have to add support even for XenServer and other > hypervisors. > > I didn’t understand what is xml defined files you are talking about. > Can you please elaborate a little bit? > > > Thanks, > Nitin > > On 22-May-2017, at 5:46 PM, Vogel, Sven > > > wrote: > > > > Hi, > > > > i saw that in cloudstack nvidia k1 and k2 are implemented. Now there > > are > new cards on market, Tesla M60, Tesla M10 and Tesla M6. > > > > It there anybody who can implement it in the xml defined files? How > > can > we help? > > > > Thanks for help > > > > Sven Vogel > > Kupper Computer GmbH > > > > > DISCLAIMER > == > This e-mail may contain privileged and confidential information which > is the property of Accelerite, a Persistent Systems business. It is > intended only for the use of the individual or entity to which it is > addressed. If you are not the intended recipient, you are not > authorized to read, retain, copy, print, distribute or use this > message. If you have received this communication in error, please > notify the sender and delete all copies of this message. Accelerite, a > Persistent Systems business does not accept any liability for virus infected > mails. >
Re: nvidia tesla grid card implementation (kvm)
Hi Sven, We implemented for KVM a pci manager to give a pass through to any PCI devices. We use that to provision VM with Tesla P100 GPU card, 1 to 4 cards per VM. My code is based on CS 4.4.2 and not the upstream version as we are not following anymore upstream. But I completely got rid of Xen implementation because the design could only fit Xen server way of dealing with GPU card. It's not something that I can push upstream. Here is an example of the XML definition of a VM which has 4 GPU cards: ... You have to map the exact source pci bus of the Nvidia cards from the host in the XML. It a pass-through, meaning that the full card is given to the VM, therefore it cannot be shared across multiple VMs. Hope that helps Marco On Mon, May 22, 2017 at 4:22 PM, Vogel, Sven wrote: > Hi Nitin, > > thanks for your answer. I mean the xml file for the VM which will always > be defined from cloudstack for the kvm hyervisor when we start a machine. > > https://access.redhat.com/documentation/en-US/Red_Hat_ > Enterprise_Linux/7/html/Virtualization_Deployment_and_ > Administration_Guide/chap-Guest_virtual_machine_device_ > configuration.html#sect-device-GPU > > https://griddownloads.nvidia.com/flex/GRID_4_2_Support_Matrix.pdf > > e.g. > > > pci__02_00_0 > /sys/devices/pci:00/:00:03.0/:02:00.0 > pci__00_03_0 > > pci-stub > > > 0 > 2 > 0 > 0 > GK106GL [Quadro K4000] > NVIDIA Corporation > > > > > > > > > > > > > I think xen should be supported. What do you think? > > Sven Vogel > > -Ursprüngliche Nachricht- > Von: Nitin Kumar Maharana [mailto:nitinkumar.mahar...@accelerite.com] > Gesendet: Montag, 22. Mai 2017 16:03 > An: dev@cloudstack.apache.org > Betreff: Re: nvidia tesla grid card implementation (kvm) > > Hi Sven, > > Currently the K1 and K2 cards are only supported in XenServer. > For other cards we have to add support even for XenServer and other > hypervisors. > > I didn’t understand what is xml defined files you are talking about. Can > you please elaborate a little bit? > > > Thanks, > Nitin > > On 22-May-2017, at 5:46 PM, Vogel, Sven > wrote: > > > > Hi, > > > > i saw that in cloudstack nvidia k1 and k2 are implemented. Now there are > new cards on market, Tesla M60, Tesla M10 and Tesla M6. > > > > It there anybody who can implement it in the xml defined files? How can > we help? > > > > Thanks for help > > > > Sven Vogel > > Kupper Computer GmbH > > > > > DISCLAIMER > == > This e-mail may contain privileged and confidential information which is > the property of Accelerite, a Persistent Systems business. It is intended > only for the use of the individual or entity to which it is addressed. If > you are not the intended recipient, you are not authorized to read, retain, > copy, print, distribute or use this message. If you have received this > communication in error, please notify the sender and delete all copies of > this message. Accelerite, a Persistent Systems business does not accept any > liability for virus infected mails. >
AW: nvidia tesla grid card implementation (kvm)
Hi Nitin, thanks for your answer. I mean the xml file for the VM which will always be defined from cloudstack for the kvm hyervisor when we start a machine. https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/Virtualization_Deployment_and_Administration_Guide/chap-Guest_virtual_machine_device_configuration.html#sect-device-GPU https://griddownloads.nvidia.com/flex/GRID_4_2_Support_Matrix.pdf e.g. pci__02_00_0 /sys/devices/pci:00/:00:03.0/:02:00.0 pci__00_03_0 pci-stub 0 2 0 0 GK106GL [Quadro K4000] NVIDIA Corporation I think xen should be supported. What do you think? Sven Vogel -Ursprüngliche Nachricht- Von: Nitin Kumar Maharana [mailto:nitinkumar.mahar...@accelerite.com] Gesendet: Montag, 22. Mai 2017 16:03 An: dev@cloudstack.apache.org Betreff: Re: nvidia tesla grid card implementation (kvm) Hi Sven, Currently the K1 and K2 cards are only supported in XenServer. For other cards we have to add support even for XenServer and other hypervisors. I didn’t understand what is xml defined files you are talking about. Can you please elaborate a little bit? Thanks, Nitin > On 22-May-2017, at 5:46 PM, Vogel, Sven > wrote: > > Hi, > > i saw that in cloudstack nvidia k1 and k2 are implemented. Now there are new > cards on market, Tesla M60, Tesla M10 and Tesla M6. > > It there anybody who can implement it in the xml defined files? How can we > help? > > Thanks for help > > Sven Vogel > Kupper Computer GmbH DISCLAIMER == This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.
Re: nvidia tesla grid card implementation (kvm)
Hi Sven, Currently the K1 and K2 cards are only supported in XenServer. For other cards we have to add support even for XenServer and other hypervisors. I didn’t understand what is xml defined files you are talking about. Can you please elaborate a little bit? Thanks, Nitin > On 22-May-2017, at 5:46 PM, Vogel, Sven > wrote: > > Hi, > > i saw that in cloudstack nvidia k1 and k2 are implemented. Now there are new > cards on market, Tesla M60, Tesla M10 and Tesla M6. > > It there anybody who can implement it in the xml defined files? How can we > help? > > Thanks for help > > Sven Vogel > Kupper Computer GmbH DISCLAIMER == This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.
nvidia tesla grid card implementation (kvm)
Hi, i saw that in cloudstack nvidia k1 and k2 are implemented. Now there are new cards on market, Tesla M60, Tesla M10 and Tesla M6. It there anybody who can implement it in the xml defined files? How can we help? Thanks for help Sven Vogel Kupper Computer GmbH
