NVIDIA B200的Supermicro系統通過交付3倍的代幣每秒超過上一代的系統

Super Micro Computer，Inc。 （SMCI）是AI/ML，HPC，Cloud，Storage和5G/Edge的全部IT解決方案提供商

Latest Benchmarks Show Supermicro Systems with the NVIDIA B200 Outperformed the Previous Generation of Systems with 3X the Token Generation Per Second

最新的基準測試顯示了NVIDIA B200的Supermicro系統，其表現優於上一代系統，即代幣生成3倍

SAN JOSE, Calif., April 3, 2025 /PRNewswire/ -- Super Micro Computer, Inc. (NASDAQ: SMCI), a Total IT Solution Provider for AI/ML, HPC, Cloud, Storage, and 5G/Edge, is announcing first-to-market industry leading performance on several MLPerf Inference v5.0 benchmarks, using the NVIDIA HGX™ B200 8-GPU. The 4U liquid-cooled and 10U air-cooled systems achieved the best performance in select benchmarks. Supermicro demonstrated more than 3 times the tokens per second (Token/s) generation for Llama2-70B and Llama3.1-405B benchmarks compared to H200 8-GPU systems.

加利福尼亞州聖何塞，2025年4月3日/PRNewswire/-Super Micro Computer，Inc。 （NASDAQ：SMCI），是AI/ML，HPC，HPC，Cloud，Storage和5G/Edge的總IT解決方案提供商，正在宣布使用MLPERF INFERAITION v5.0 BENCHMARKS上的幾個MLPER FERTIAL PREANSTER EDRACTION to To To To To-Market行業領先的績效。 4U液冷和10U氣冷系統在精選基準中實現了最佳性能。與H200 8-GPU系統相比，SuperMicro的Llama2-70B和Llama3.1-405B基準的Llama2-70B和Llama3.1-405B基準的代幣每秒（令牌/s）生成的3倍以上。

"Supermicro remains a leader in the AI industry, as evidenced by the first new benchmarks from MLCommons in 2025," said Charles Liang, president and CEO of Supermicro. "Our building block architecture enables us to be first-to-market with a diverse range of systems optimized for various workloads. We continue to collaborate closely with NVIDIA to fine-tune our systems and secure a leadership position in AI workloads."

Supermicro總裁兼首席執行官Charles Liang說：“ Supermicro仍然是AI行業的領導者，這是2025年MLCommons的首次新基準的證據。” “我們的構件架構使我們能夠以針對各種工作負載進行優化的各種系統進行首次上市。我們繼續與NVIDIA緊密合作，以微調我們的系統並確保AI工作負載中的領導地位。”

Learn more about the new MLPerf v5.0 Inference benchmarks at: https://mlcommons.org/benchmarks/inference-datacenter/

在以下網址了解有關新的MLPERF V5.0推理基準的更多信息：https：//mlcommons.org/benchmarks/inference-datacenter/

Supermicro is the only system vendor publishing record MLPerf inference performance (on select benchmarks) for both the air-cooled and liquid-cooled NVIDIA HGX™ B200 8-GPU systems. Both air-cooled and liquid-cooled systems were operational before the MLCommons benchmark start date. Supermicro engineers optimized the systems and software to showcase the impressive performance. Within the operating margin, the Supermicro air-cooled B200 system exhibited the same level of performance as the liquid-cooled B200 system. Supermicro has been delivering these systems to customers while we conducted the benchmarks.

SuperMicro是唯一針對氣冷和液冷NVIDIA HGX™B200 8-GPU系統的系統供應商發布記錄MLPERF推理性能（在某些基準測試中）。在MLCommons基准開始日期之前，氣冷和液冷系統都在運行。超級工程師優化了系統和軟件，以展示令人印象深刻的性能。在操作餘量中，超級氣冷B200系統表現出與液冷B200系統相同的性能水平。在我們進行基準測試時，Supermicro一直向客戶交付這些系統。

MLCommons emphasizes that all results be reproducible, that the products are available and that the results can be audited by other MLCommons members. Supermicro engineers optimized the systems and software, as allowed by the MLCommons rules.

MLCommons強調所有結果都是可重現的，產品可用，並且可以由其他MLCommons成員審核結果。超級工程師根據MLCommons規則允許優化系統和軟件。

The SYS-421GE-NBRT-LCC (8x NVIDIA B200-SXM-180GB) and SYS-A21GE-NBRT (8x NVIDIA B200-SXM-180GB) showed performance leadership running the Mixtral 8x7B Inference, Mixture of Experts benchmarks with 129,000 tokens/second. The Supermicro air-cooled and liquid-cooled NVIDIA B200 based system delivered over 1,000 tokens/second inference for the large Llama3.1-405b model, whereas the previous generations of GPU systems have much smaller results. For smaller inferencing tasks, using the LLAMA2-70b benchmark, a Supermicro system with the NVIDIA B200 SXM-180GB installed shows the highest performance from a Tier 1 system supplier.

SYS-421GE-NBRT-LCC（8x NVIDIA B200-SXM-180GB）和SYS-A21GE-NBRT（8x NVIDIA B200-SXM-180GB）顯示出性能領導力，運行MixTRAL 8x7b推理，專家混合物與129,000個代幣/秒。基於Supermicro氣冷和液冷NVIDIA B200的系統，用於大型Llama3.1-405b模型的1000多個令牌/秒推斷，而GPU的前幾代GPU系統的結果較小。對於較小的推斷任務，使用Llama2-70B基準，這是一種具有NVIDIA B200 SXM-180GB的超級系統，已安裝了Tier 1 System System供應商的最高性能。

Specifically:

具體來說：

* Supermicro achieved outstanding performance on several MLPerf Inference v5.0 benchmarks with the NVIDIA HGX™ B200 8-GPU in 10U and 4U configurations.

* SuperMicro在10U和4U配置中的NVIDIA HGX™B200 8-GPU上獲得了多個MLPERF推理V5.0基準的出色性能。

* In select benchmarks, Supermicro's systems delivered the best performance.

*在精選的基準測試中，Supermicro的系統提供了最佳性能。

* Supermicro showcased more than 3x the tokens/second generation for Llama2-70B and Llama3.1-405b benchmarks compared to H200 8-GPU systems.

*與H200 8-GPU系統相比，SuperMicro的Llama2-70B和Llama3.1-405B基準的標記/第二代超過3倍。

"MLCommons congratulates Supermicro on their submission to the MLPerf Inference v5.0 benchmark. We are pleased to see their results showcasing significant performance gains compared to earlier generations of systems," said David Kanter, Head of MLPerf at MLCommons. "Customers will be pleased by the performance improvements achieved which are validated by the neutral, representative and reproducible MLPerf results."

MLCommons的MLPerf負責人David Kanter說：“ MLCommons祝賀Supermicro提交給MLPERF推斷V5.0基準。我們很高興看到他們的結果與早期的系統相比展示了顯著的性能增長。” “客戶將對所取得的績效改進感到滿意，這些績效得到了由中性，代表和可重複的MLPERF結果驗證的。”

Supermicro offers a comprehensive AI portfolio with over 100 GPU-optimized systems, both air-cooled and liquid-cooled options, with a choice of CPUs, ranging from single-socket optimized systems to 8-way multiprocessor systems. Supermicro rack-scale systems include computing, storage, and network components, which reduce the time required to install them once they are delivered to a customer.

SuperMicro提供了全面的AI投資組合，具有100多個GPU優化的系統，包括氣冷和液體冷卻選項，可選擇CPU，範圍從單插入優化的系統到8向多處理器系統。 SuperMicro機架規模的系統包括計算，存儲和網絡組件，這些系統一旦將它們運送到客戶就可以減少安裝它們所需的時間。

Supermicro's NVIDIA HGX B200 8-GPU systems utilize next-generation liquid-cooling and air-cooling technology. The newly developed cold plates and the new 250kW coolant distribution unit (CDU) more than double the cooling capacity of the previous generation in the same 4U form factor. Available in 42U, 48U, or 52U configurations

Supermicro的NVIDIA HGX B200 8-GPU系統利用下一代液體冷卻和空氣冷卻技術。新開發的冷板和新的250kW冷卻液分配單元（CDU）是上一代相同4U外形的冷卻能力的兩倍以上。在42U，48U或52U配置中可用