[cctalk] Re: 5,34 Petaflop System Cheyenne
Cheyenne is a nice basement system. Only needs 1.75 MW. The system which replaced Cheyenne is Derecho, a 19.8 petaflop system. https://news.ucar.edu/132904/scientists-nationwide-launch-first-projects-new-ncar-supercomputer Last fall, NOAA/NWS replaced theirs (one in Manassas, one in Phoenix) with new 12.5 petaflop systems. As the models evolve, they get more demanding. They were able to implement new and enhanced forecast models on the new machines. https://www.noaa.gov/news-release/noaa-completes-upgrade-to-weather-and-climate-supercomputer-system De
[cctalk] Re: 5,34 Petaflop System Cheyenne
On Sat, May 4, 2024 at 12:28 PM W2HX via cctalk wrote: > Sure but at $60k per bitcoin it only takes 267 bitcoins to earn a $1M profit > on that $15M per year cost! But I have no idea if a machine like that could > mine 266 coins in a year or 22/month. I'm not really sure if Cheyenne could ever mine a single bitcoin at this point. Bitcoin mining (as I understand it) moved from CPUs (like Cheyenne, even if it has a lot of them) to GPUs many years ago, and it has now even been quite a few years since they abandoned the use of GPUs too. Today it's done on huge clusters of ASIC hash calculators. You need to be able to do something like 3,000 trillion SHA-256 hashes per second to make one Bitcoin per day (at least according to a quick search). If by "Bitcoin" you mean crypto-mining in general, there's probably something it could be used for, but it would be horribly inefficient compared to more modern hardware. The first uses for Cheyenne that seem to pop to mind (Crypto and AI) are actually the two WORST applications for it I think. It might still be reasonably good at the kind of simulations it was acquired to run (atmospheric sims, etc.)
[cctalk] Re: 5,34 Petaflop System Cheyenne
Sure but at $60k per bitcoin it only takes 267 bitcoins to earn a $1M profit on that $15M per year cost! But I have no idea if a machine like that could mine 266 coins in a year or 22/month. Sent from Nine<http://www.9folders.com/> From: Jon Elson via cctalk Sent: Saturday, May 4, 2024 12:41 PM To: W2HX via cctalk Cc: Jon Elson Subject: [cctalk] Re: 5,34 Petaflop System Cheyenne On 5/4/24 10:21, W2HX via cctalk wrote: > I wonder how well that machine would do at bitcoin mining > Umm, it will consume about 4000 Dollars of electricity per day! That is not counting the cooling required, just the power input. that's about $15 million per year. Jon
[cctalk] Re: 5,34 Petaflop System Cheyenne
On 5/4/24 10:21, W2HX via cctalk wrote: I wonder how well that machine would do at bitcoin mining Umm, it will consume about 4000 Dollars of electricity per day! That is not counting the cooling required, just the power input. that's about $15 million per year. Jon
[cctalk] Re: 5,34 Petaflop System Cheyenne
I wonder how well that machine would do at bitcoin mining Extremely poor? -- : Ethan O'Toole
[cctalk] Re: 5,34 Petaflop System Cheyenne
I wonder how well that machine would do at bitcoin mining Sent from Nine<http://www.9folders.com/> From: CAREY SCHUG via cctalk Sent: Saturday, May 4, 2024 12:28 AM To: General Discussion: On-Topic and Off-Topic Posts Cc: CAREY SCHUG Subject: [cctalk] Re: 5,34 Petaflop System Cheyenne I am not an expert, but are all petaflops the same? might there be some applications fo which this is relatively better than the nominally equivalent petaflops of nvidia? as in how intermediate results are shared between calculation units, this is likely to be more cross connected so values can be share faster, the nvidia would have to keep stopping and waiting to get values from another node? And of course, could it be some company that has one and wants a drop in backup or second site? and being bid against by competitors that DON'T want them to have a backup? --Carey > On 05/03/2024 7:41 PM CDT Mike Katz via cctalk wrote: > > > I wonder if some intermediary is buying it for a country that cannot > legally purchase something like that from the USA. > > I'm not normally a conspiracy guy but why would any normal company pay > half a million dollars for something that could be produced with today's > technology for considerably less? > > On 5/3/2024 6:57 PM, Gavin Scott via cctalk wrote: > > Sold at $480,085.00. > > > > On Fri, May 3, 2024 at 6:22 PM Gavin Scott wrote: > >> On Fri, May 3, 2024 at 5:14 PM Liam Proven via cctalk > >> wrote: > >> > >>> Bad news... > >> But does he have 8,000 of them haha. > >> > >> Auction is at $435K now (past the end time) with multiple active > >> bidders extending it.
[cctalk] Re: 5,34 Petaflop System Cheyenne
I am not an expert, but are all petaflops the same? might there be some applications fo which this is relatively better than the nominally equivalent petaflops of nvidia? as in how intermediate results are shared between calculation units, this is likely to be more cross connected so values can be share faster, the nvidia would have to keep stopping and waiting to get values from another node? And of course, could it be some company that has one and wants a drop in backup or second site? and being bid against by competitors that DON'T want them to have a backup? --Carey > On 05/03/2024 7:41 PM CDT Mike Katz via cctalk wrote: > > > I wonder if some intermediary is buying it for a country that cannot > legally purchase something like that from the USA. > > I'm not normally a conspiracy guy but why would any normal company pay > half a million dollars for something that could be produced with today's > technology for considerably less? > > On 5/3/2024 6:57 PM, Gavin Scott via cctalk wrote: > > Sold at $480,085.00. > > > > On Fri, May 3, 2024 at 6:22 PM Gavin Scott wrote: > >> On Fri, May 3, 2024 at 5:14 PM Liam Proven via cctalk > >> wrote: > >> > >>> Bad news... > >> But does he have 8,000 of them haha. > >> > >> Auction is at $435K now (past the end time) with multiple active > >> bidders extending it.
[cctalk] Re: 5,34 Petaflop System Cheyenne
On Fri, May 3, 2024 at 9:09 PM Chuck Guzis via cctalk wrote: > Careful disassembly and transportation could run well into 6 figures all > by itself. Just getting it out of NCAR could be a substantial fraction of that. Per the auction documents it looks like about 100,000 pounds (~45,000kg) of racks. I think smuggling Nvidia cards would be substantially more viable.
[cctalk] Re: 5,34 Petaflop System Cheyenne
On 5/3/24 17:41, Mike Katz via cctalk wrote: > I wonder if some intermediary is buying it for a country that cannot > legally purchase something like that from the USA. > > I'm not normally a conspiracy guy but why would any normal company pay > half a million dollars for something that could be produced with today's > technology for considerably less? Careful disassembly and transportation could run well into 6 figures all by itself. Disassembling for scrap is considerably easier. Bolt cutters, impact wrenches and sawzalls. --Chuck
[cctalk] Re: 5,34 Petaflop System Cheyenne
In the 1980's I attended a US Gov't auction for a Vax 780. It was being exported to South Africa and the State Dept stopped the transfer because it was ultimately going to a banned country. Don't know which one, but I do remember the system was configured for 50Hz power. 50Hz power, disks, cpu, everything. Wow. Doug On 5/3/2024 8:41 PM, Mike Katz via cctalk wrote: I wonder if some intermediary is buying it for a country that cannot legally purchase something like that from the USA. I'm not normally a conspiracy guy but why would any normal company pay half a million dollars for something that could be produced with today's technology for considerably less? On 5/3/2024 6:57 PM, Gavin Scott via cctalk wrote: Sold at $480,085.00. On Fri, May 3, 2024 at 6:22 PM Gavin Scott wrote: On Fri, May 3, 2024 at 5:14 PM Liam Proven via cctalk wrote: Bad news... But does he have 8,000 of them haha. Auction is at $435K now (past the end time) with multiple active bidders extending it.
[cctalk] Re: 5,34 Petaflop System Cheyenne
I wonder if some intermediary is buying it for a country that cannot legally purchase something like that from the USA. I'm not normally a conspiracy guy but why would any normal company pay half a million dollars for something that could be produced with today's technology for considerably less? On 5/3/2024 6:57 PM, Gavin Scott via cctalk wrote: Sold at $480,085.00. On Fri, May 3, 2024 at 6:22 PM Gavin Scott wrote: On Fri, May 3, 2024 at 5:14 PM Liam Proven via cctalk wrote: Bad news... But does he have 8,000 of them haha. Auction is at $435K now (past the end time) with multiple active bidders extending it.
[cctalk] Re: 5,34 Petaflop System Cheyenne
Not bad for scrap value? ;) Don Resor Sent from someone's iPhone > On May 3, 2024, at 4:57 PM, Gavin Scott via cctalk > wrote: > > Sold at $480,085.00. > >> On Fri, May 3, 2024 at 6:22 PM Gavin Scott wrote: >> >> On Fri, May 3, 2024 at 5:14 PM Liam Proven via cctalk >> wrote: >> >>> Bad news... >> >> But does he have 8,000 of them haha. >> >> Auction is at $435K now (past the end time) with multiple active >> bidders extending it. >
[cctalk] Re: 5,34 Petaflop System Cheyenne
Sold at $480,085.00. On Fri, May 3, 2024 at 6:22 PM Gavin Scott wrote: > > On Fri, May 3, 2024 at 5:14 PM Liam Proven via cctalk > wrote: > > > Bad news... > > But does he have 8,000 of them haha. > > Auction is at $435K now (past the end time) with multiple active > bidders extending it.
[cctalk] Re: 5,34 Petaflop System Cheyenne
On Fri, May 3, 2024 at 5:14 PM Liam Proven via cctalk wrote: > Bad news... But does he have 8,000 of them haha. Auction is at $435K now (past the end time) with multiple active bidders extending it.
[cctalk] Re: 5,34 Petaflop System Cheyenne
On Fri, 3 May 2024 at 16:31, Gavin Scott via cctalk wrote: > It has 8,064 commodity CPUs, "E5-2697v4 (18-core, 2.3 GHz base > frequency, Turbo up to 3.6GHz, 145W TDP)" which may still sell new > (NOS?) for up to $2K each Bad news... https://www.ebay.com/itm/235507916254 $47.99 each. Plus shipping, I'm sure. -- Liam Proven ~ Profile: https://about.me/liamproven Email: lpro...@cix.co.uk ~ gMail/gTalk/FB: lpro...@gmail.com Twitter/LinkedIn: lproven ~ Skype: liamproven IoM: (+44) 7624 277612: UK: (+44) 7939-087884 Czech [+ WhatsApp/Telegram/Signal]: (+420) 702-829-053
[cctalk] Re: 5,34 Petaflop System Cheyenne
> On May 3, 2024, at 3:27 PM, Gavin Scott via cctalk > wrote: > > On Fri, May 3, 2024 at 1:30 PM W2HX via cctalk wrote: > >> Someone seems to want it. Bidding is at $250,000 and counting. I guess >> someone didn’t get the memo about getting just a few nvidia cards! > > If you go to Amazon today and buy just the CPUs and RAM, that will > cost you around 21 million dollars. So I imagine those used parts are > still worth substantially more than the current high bid. The close of > the auction should be interesting. Or maybe it's just metals recycling. If there's more than 120 ounces of gold in all those racks, that's $250k right there. paul
[cctalk] Re: 5,34 Petaflop System Cheyenne
On Fri, May 3, 2024 at 1:30 PM W2HX via cctalk wrote: > Someone seems to want it. Bidding is at $250,000 and counting. I guess > someone didn’t get the memo about getting just a few nvidia cards! If you go to Amazon today and buy just the CPUs and RAM, that will cost you around 21 million dollars. So I imagine those used parts are still worth substantially more than the current high bid. The close of the auction should be interesting. Still pretty sure nobody intends to re-install and run any part of the whole system, but who knows. Maybe there are other SGI systems still out there.
[cctalk] Re: 5,34 Petaflop System Cheyenne
Someone seems to want it. Bidding is at $250,000 and counting. I guess someone didn’t get the memo about getting just a few nvidia cards! 73 Eugene W2HX My Youtube Channel: https://www.youtube.com/@w2hx/videos -Original Message- From: Gavin Scott via cctalk Sent: Friday, May 3, 2024 11:31 AM To: General Discussion: On-Topic and Off-Topic Posts Cc: Gavin Scott Subject: [cctalk] Re: 5,34 Petaflop System Cheyenne It's a different world now with GPU and AI performance, so I strongly doubt Cheyenne will ever boot again. Somewhat sad that they're doing such a nice job of de-installing the machine, labeling all the cables etc. 5PF is just not impressive these days. A single Nvidia card will do more than that in FP8 I think which is probably good enough for AI training, and something like 100PF in FP4 for inference. At worst it's a small handful of Nvidia cards to completely replace that monster. It has 8,064 commodity CPUs, "E5-2697v4 (18-core, 2.3 GHz base frequency, Turbo up to 3.6GHz, 145W TDP)" which may still sell new (NOS?) for up to $2K each (though it's probably questionable whether the total future market amounts to anything close to 8K units), and 300TB of standard DDR4 ECC memory. That's probably what people are bidding on. The rest of it is likely getting melted. And it's something like 42 racks of stuff. But tune in for the exciting auction finish at 4PM Pacific. Auction will continue until 10 minutes elapses without a bid I believe.
[cctalk] Re: 5,34 Petaflop System Cheyenne
On 5/3/24 08:07, jim stephens via cctalk wrote: >> https://arstechnica.com/information-technology/2024/04/us-government-auctions-5-34-petaflop-cheyenne-supercomputer/ 2.3-GHz Intel Xeon E5-2697v4 processors, I think that's a close relative to what I'm running on the X99 desktop... --Chuck
[cctalk] Re: 5,34 Petaflop System Cheyenne
It's a different world now with GPU and AI performance, so I strongly doubt Cheyenne will ever boot again. Somewhat sad that they're doing such a nice job of de-installing the machine, labeling all the cables etc. 5PF is just not impressive these days. A single Nvidia card will do more than that in FP8 I think which is probably good enough for AI training, and something like 100PF in FP4 for inference. At worst it's a small handful of Nvidia cards to completely replace that monster. It has 8,064 commodity CPUs, "E5-2697v4 (18-core, 2.3 GHz base frequency, Turbo up to 3.6GHz, 145W TDP)" which may still sell new (NOS?) for up to $2K each (though it's probably questionable whether the total future market amounts to anything close to 8K units), and 300TB of standard DDR4 ECC memory. That's probably what people are bidding on. The rest of it is likely getting melted. And it's something like 42 racks of stuff. But tune in for the exciting auction finish at 4PM Pacific. Auction will continue until 10 minutes elapses without a bid I believe.
[cctalk] Re: 5,34 Petaflop System Cheyenne
>Fairly sure you could find something to run Doom >that uses less than 1.7MWBut >what's the point of buying this monstrosity if not to play Doom? It is like >SEVEN years old. ;)
[cctalk] Re: 5,34 Petaflop System Cheyenne
On 5/3/24 09:35, Adrian Godwin via cctalk wrote: Fairly sure you could find something to run Doom that uses less than 1.7MW I saw that someone posted on Twitter that they repurposed a disposable home pregnancy test stick display and parts to run it. Apparently it wasn't enough (isn't?) to have lines on the stick you need to have it have a fairly capable display. And it's disposable. Unless you're a tinkerer. (from https://arstechnica.com/information-technology/2024/04/us-government-auctions-5-34-petaflop-cheyenne-supercomputer/ ) On Fri, May 3, 2024 at 3:23 PM Ali via cctalk wrote: Just 7 year old and no longer in service.>Anyone with some space in the basement ?But will it run Doom?
[cctalk] Re: 5,34 Petaflop System Cheyenne
Fairly sure you could find something to run Doom that uses less than 1.7MW (from https://arstechnica.com/information-technology/2024/04/us-government-auctions-5-34-petaflop-cheyenne-supercomputer/ ) On Fri, May 3, 2024 at 3:23 PM Ali via cctalk wrote: > > >Just 7 year old and no longer in service.>Anyone with some space in the > basement ?But will it run Doom?
[cctalk] Re: 5,34 Petaflop System Cheyenne
>Just 7 year old and no longer in service.>Anyone with some space in the >basement ?But will it run Doom?
