Re: [coreboot] 16 GPUs on one board

2018-01-11 Thread Aaron Durbin via coreboot
On Sun, Jan 7, 2018 at 2:05 PM, Adam Talbot wrote: > Lets take a slight differently tactic. What would happen if we removed the > ROM from a GPU/NIC? Would the GPU's still require 256MB~304MB of PCI_MMIO? > Yes, I would expect it to. Those cards have on-board memory that would need to be address

Re: [coreboot] 16 GPUs on one board

2018-01-11 Thread Adam Talbot
Lets take a slight differently tactic. What would happen if we removed the ROM from a GPU/NIC? Would the GPU's still require 256MB~304MB of PCI_MMIO? On Sat, Jan 6, 2018 at 3:00 PM, taii...@gmx.com wrote: > I have had this issue in regards to SR-IOV, - at the moment coreboot only > supports 32

Re: [coreboot] 16 GPUs on one board

2018-01-08 Thread Aaron Durbin via coreboot
On Thu, Jan 4, 2018 at 1:33 PM, Arthur Heymans wrote: > Hi > > What target are you on? > > Coreboot tries to locate all PCI BAR's below 4G in the PCI_MMIO region and > above the lower DRAM > limit (the rest of the DRAM is mapped above 4G). Typically a GPU takes > around 256M but I guess that coul

Re: [coreboot] 16 GPUs on one board

2018-01-08 Thread taii...@gmx.com
I have had this issue in regards to SR-IOV, - at the moment coreboot only supports 32Bit MMIO unfortunately one can't have too many graphics devices or network interfaces apparently. Considering the success of the OpenBMC port fund it would be nice if we could get a fund going to fix this if i

Re: [coreboot] 16 GPUs on one board

2018-01-06 Thread Adam Talbot
What will CoreBoot do if it runs out of room in the PCI_MMIO region? On Fri, Jan 5, 2018 at 8:49 AM, Adam Talbot wrote: > "linear address space" != DRAM, got it. > > Interesting. > VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] > (rev a1) (prog-if 00 [VGA controller]) >

Re: [coreboot] 16 GPUs on one board

2018-01-05 Thread Adam Talbot
"linear address space" != DRAM, got it. Interesting. VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1) (prog-if 00 [VGA controller]) Subsystem: NVIDIA Corporation GP104 [GeForce GTX 1070] Flags: bus master, fast devsel, latency 0, IRQ 325 Memory at d800 (3

Re: [coreboot] 16 GPUs on one board

2018-01-05 Thread Adam Talbot
Yep, I am another crypto currencies miner. But in all truth, I find the hardware challenge more fun then the bitcoin stuff. Power is not the issue (any more). I have 2Kw worth of PSU. 2X HP Common slot 750W PSU + Thermaltake 500W PSU. Currently, with all 8 cards running full tilt, across two mo

Re: [coreboot] 16 GPUs on one board

2018-01-05 Thread Arthur Heymans
Adam Talbot writes: > Arthur: Thanks for the details. I have a board that with give me a "missing > memory" beep code with more then 6 GPUs. Now I understand why! > > How can I track down how much system DRAM a GPU is using? These are > all the newest Nvidia Pascal based cards. Mostly GTX 1070's.

Re: [coreboot] 16 GPUs on one board

2018-01-04 Thread Zoran Stojsavljevic
> Yep, I am another crypto currencies miner. But in all truth, > I find the hardware challenge more fun then the bitcoin stuff. Thank you for conforming. Nothing wrong with it, as far as I can tell. :-) But for the sake of time, you should have this setup working ASAP. This is the aim, isn't it?

Re: [coreboot] 16 GPUs on one board

2018-01-04 Thread Zoran Stojsavljevic
> I am totally off the deep end and don't know where else to turn > for help/advice. I am trying to get 16 GPU's on one motherboard. H. Yet another crypto currencies miner. ;-) > Whenever I attach more then 3~5 GPU's to a single motherboard, > it fails to post. To make matters worse, my pos

Re: [coreboot] 16 GPUs on one board

2018-01-04 Thread Testerman, Brett
@coreboot.org Subject: [coreboot] 16 GPUs on one board ** The Sender is from outside the Cobham Commercial Datacentre organisation ** -Coreboot I am totally off the deep end and don't know where else to turn for help/advice. I am trying to get 16 GPU's on one motherboard. Whenever I attach mor

Re: [coreboot] 16 GPUs on one board

2018-01-04 Thread Arthur Heymans
Hi What target are you on? Coreboot tries to locate all PCI BAR's below 4G in the PCI_MMIO region and above the lower DRAM limit (the rest of the DRAM is mapped above 4G). Typically a GPU takes around 256M but I guess that could be more nowadays. If that doesn't fit in the PCI MMIO region, it wi

[coreboot] 16 GPUs on one board

2018-01-04 Thread Adam Talbot
-Coreboot I am totally off the deep end and don't know where else to turn for help/advice. I am trying to get 16 GPU's on one motherboard. Whenever I attach more then 3~5 GPU's to a single motherboard, it fails to post. To make matters worse, my post code reader(s) don't seem to give me any good