NVIDIA B200的超級系統勝過上一代的系統，即代幣生成每秒的3倍

加利福尼亞州聖何塞，2025年4月3日/美通社/ - Super Micro Computer，Inc。 （SMCI），AI/ML，HPC，雲，存儲和5G/Edge的全部IT解決方案提供商

SAN JOSE, Calif., April 3, 2025 /PRNewswire/ -- Super Micro Computer, Inc. (NASDAQ: SMCI), a leading provider of advanced technology enterprise computing, storage, networking solutions, and a Total IT Solution Provider for Artificial Intelligence (AI) and Machine Learning (ML), today announced first-to-market industry leading performance on several MLPerf Inference v5.0 benchmarks, using the NVIDIA HGX B200 8-GPU. The 4U liquid-cooled and 10U air-cooled systems achieved the best performance in select benchmarks. Supermicro demonstrated more than 3 times the tokens per second (Token/s) generation for Llama2-70B and Llama3.1-405B benchmarks compared to H200 8-GPU systems.

加利福尼亞州聖何塞，2025年4月3日 / PRNewswire / -Super Micro Computer，Inc。 （NASDAQ：SMCI），高級技術企業計算，存儲，網絡解決方案以及全部IT解決方案提供商人工智能（AI）和機器學習（ML）的全部IT解決方案提供商，今天宣布的第一台Bench beinder beander beanch verne venden 2. HGX B200 8-GPU。 4U液冷和10U氣冷系統在精選基準中實現了最佳性能。與H200 8-GPU系統相比，SuperMicro的Llama2-70B和Llama3.1-405B基準的Llama2-70B和Llama3.1-405B基準的代幣每秒（令牌/s）生成的3倍以上。

"Supermicro remains a leader in the AI industry, as evidenced by the first new benchmarks released by MLCommons in 2025," said Charles Liang, president and CEO, Supermicro. "Our building block architecture enables us to be first-to-market with a diverse range of systems optimized for various workloads. We continue to closely collaborate with NVIDIA to fine-tune our systems and secure a leadership position in AI workloads."

Supermicro總裁兼首席執行官Charles Liang說：“ Supermicro仍然是AI行業的領導者，這是MLCommons於2025年發布的首次新基準的證明。” “我們的構件架構使我們能夠以針對各種工作量進行優化的各種系統進行首次上市。我們將繼續與NVIDIA緊密合作，以微調我們的系統並確保AI工作負載中的領導地位。”

Learn more about the new MLPerf v5.0 Inference benchmarks at: https://mlcommons.org/benchmarks/inference-datacenter/

在以下網址了解有關新的MLPERF V5.0推理基準的更多信息：https：//mlcommons.org/benchmarks/inference-datacenter/

Supermicro is the only system vendor publishing record MLPerf inference performance (on select benchmarks) for both the air-cooled and liquid-cooled NVIDIA HGX B200 8-GPU systems. Both air-cooled and liquid-cooled systems were operational before the MLCommons benchmark start date. Supermicro engineers optimized the systems and software to showcase the impressive performance. Within the operating margin, the Supermicro air-cooled B200 system exhibited the same level of performance as the liquid-cooled B200 system. Supermicro has been delivering these systems to customers while we conducted the benchmarks.

SuperMicro是唯一針對氣冷和液冷NVIDIA HGX B200 8-GPU系統的系統供應商發布記錄MLPERF推理性能（在某些基準測試中）。在MLCommons基准開始日期之前，氣冷和液冷系統都在運行。超級工程師優化了系統和軟件，以展示令人印象深刻的性能。在操作餘量中，超級氣冷B200系統表現出與液冷B200系統相同的性能水平。在我們進行基準測試時，Supermicro一直向客戶交付這些系統。

MLCommons emphasizes that all results be reproducible, that the products are available and that the results can be audited by other MLCommons members. Supermicro engineers optimized the systems and software, as allowed by the MLCommons rules.

MLCommons強調所有結果都是可重現的，產品可用，並且可以由其他MLCommons成員審核結果。超級工程師根據MLCommons規則允許優化系統和軟件。

The SYS-421GE-NBRT-LCC (8x NVIDIA B200-SXM-180GB) and SYS-A21GE-NBRT (8x NVIDIA B200-SXM-180GB) showed performance leadership running the Mixtral 8x7B Inference, Mixture of Experts benchmarks with 129,000 tokens/second. The Supermicro air-cooled and liquid-cooled NVIDIA B200 based system delivered over 1,000 tokens/second inference for the large Llama3.1-405b model, whereas the previous generations of GPU systems have much smaller results. For smaller inferencing tasks, using the LLAMA2-70b benchmark, a Supermicro system with the NVIDIA B200 SXM-180GB installed shows the highest performance from a Tier 1 system supplier.

SYS-421GE-NBRT-LCC（8x NVIDIA B200-SXM-180GB）和SYS-A21GE-NBRT（8x NVIDIA B200-SXM-180GB）顯示出性能領導力，運行MixTRAL 8x7b推理，專家混合物與129,000個代幣/秒。基於Supermicro氣冷和液冷NVIDIA B200的系統，用於大型Llama3.1-405b模型的1000多個令牌/秒推斷，而GPU的前幾代GPU系統的結果較小。對於較小的推斷任務，使用Llama2-70B基準，這是一種具有NVIDIA B200 SXM-180GB的超級系統，已安裝了Tier 1 System System供應商的最高性能。

Specifically:

具體來說：

* The Supermicro liquid-cooled system SYS-421GE-NBRT-LCC (8x NVIDIA B200-SXM-180GB) achieved the best performance in select benchmarks.

* Supermicro液體冷卻系統SYS-421GE-NBRT-LCC（8x NVIDIA B200-SXM-180GB）在精選的基準測試中取得了最佳性能。

* The Supermicro air-cooled system SYS-A21GE-NBRT (8x NVIDIA B200-SXM-180GB) also achieved the best performance in select benchmarks.

* Supermicro氣冷系統SYS-A21GE-NBRT（8x NVIDIA B200-SXM-180GB）在精選基準測試中也取得了最佳性能。

* Both systems achieved the best performance in the Mixtral 8x7B Inference, Mixture of Experts benchmarks with 129,000 tokens/second.

*這兩個系統在混合8x7b推理中都達到了最佳性能，專家的混合物用129,000個令牌/秒進行了基準。

* The Supermicro air-cooled and liquid-cooled NVIDIA B200 based system delivered over 1,000 tokens/second inference for the large Llama3.1-405b model.

*基於SuperMicro氣冷和液冷NVIDIA B200的系統，用於大型Llama3.1-405b型號的1,000個令牌/秒推斷。

* For smaller inferencing tasks, using the LLAMA2-70b benchmark, a Supermicro system with the NVIDIA B200 SXM-180GB installed shows the highest performance from a Tier 1 system supplier.

*對於較小的推論任務，使用Llama2-70B基準，這是一種具有NVIDIA B200 SXM-180GB的超級系統，顯示了Tier 1 System System供應商的最高性能。

"We at MLCommons are pleased to see results from members demonstrating significant performance gains compared to earlier generations of systems,” said David Kanter, Head of MLPerf at MLCommons. “Customers will be pleased by the performance improvements achieved which are validated by the neutral, representative and reproducible MLPerf results. We encourage members to continue pushing the boundaries of deep learning technology and we look forward to seeing the results of future generations of hardware and software.”

MLCommons的MLPERF負責人David Kanter說：“ MLCommons很高興看到成員與早期系統相比表現出顯著性能增長的結果。” “客戶將對所取得的績效改進感到滿意，這些改進得到了中性，代表性和可重複的MLPERF結果的驗證。我們鼓勵成員繼續推動深度學習技術的界限，我們期待看到後代的硬件和軟件的結果。”

Supermicro offers a comprehensive AI portfolio with over 100 GPU-optimized systems, both air-cooled and liquid-cooled options, with a choice of CPUs, ranging from single-socket optimized systems to 8-way multiprocessor systems. Supermicro rack-scale systems include computing

SuperMicro提供了全面的AI投資組合，具有100多個GPU優化的系統，包括氣冷和液體冷卻選項，可選擇CPU，範圍從單插入優化的系統到8向多處理器系統。超級機架規模系統包括計算