Wait.... 2020 May 19 https://news.microsoft.com/source/features/ai/openai-azure-supercomputer/
The supercomputer developed for OpenAI is a single system with more than 285,000 CPU cores, 10,000 GPUs and 400 gigabits per second of network connectivity for each GPU server. GPT-4: As of my last update in 2023, the largest supercomputer, Frontier, does not rely on traditional GPUs but is based on AMD Instinct MI250X GPUs, boasting over 9,400 nodes, each equipped with 4 AMD MI250X accelerators, totaling approximately 37,600 GPUs. ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T4f3b7facdd27f552-Mdc3708e77c99c23e810a776f Delivery options: https://agi.topicbox.com/groups/agi/subscription
