NVIDIA B200的Supermicro系统通过交付3倍的代币每秒超过上一代的系统

Super Micro Computer，Inc。（SMCI）是AI/ML，HPC，Cloud，Storage和5G/Edge的全部IT解决方案提供商

Latest Benchmarks Show Supermicro Systems with the NVIDIA B200 Outperformed the Previous Generation of Systems with 3X the Token Generation Per Second

最新的基准测试显示了NVIDIA B200的Supermicro系统，其表现优于上一代系统，即代币生成3倍

SAN JOSE, Calif., April 3, 2025 /PRNewswire/ -- Super Micro Computer, Inc. (NASDAQ: SMCI), a Total IT Solution Provider for AI/ML, HPC, Cloud, Storage, and 5G/Edge, is announcing first-to-market industry leading performance on several MLPerf Inference v5.0 benchmarks, using the NVIDIA HGX™ B200 8-GPU. The 4U liquid-cooled and 10U air-cooled systems achieved the best performance in select benchmarks. Supermicro demonstrated more than 3 times the tokens per second (Token/s) generation for Llama2-70B and Llama3.1-405B benchmarks compared to H200 8-GPU systems.

加利福尼亚州圣何塞，2025年4月3日/PRNewswire/-Super Micro Computer，Inc。（NASDAQ：SMCI），是AI/ML，HPC，HPC，Cloud，Storage和5G/Edge的总IT解决方案提供商，正在宣布使用MLPERF INFERAITION v5.0 BENCHMARKS上的几个MLPER FERTIAL PREANSTER EDRACTION to To To To To-Market行业领先的绩效。 4U液冷和10U气冷系统在精选基准中实现了最佳性能。与H200 8-GPU系统相比，SuperMicro的Llama2-70B和Llama3.1-405B基准的Llama2-70B和Llama3.1-405B基准的代币每秒（令牌/s）生成的3倍以上。

"Supermicro remains a leader in the AI industry, as evidenced by the first new benchmarks from MLCommons in 2025," said Charles Liang, president and CEO of Supermicro. "Our building block architecture enables us to be first-to-market with a diverse range of systems optimized for various workloads. We continue to collaborate closely with NVIDIA to fine-tune our systems and secure a leadership position in AI workloads."

Supermicro总裁兼首席执行官Charles Liang说：“ Supermicro仍然是AI行业的领导者，这是2025年MLCommons的首次新基准的证据。” “我们的构件架构使我们能够以针对各种工作负载进行优化的各种系统进行首次上市。我们继续与NVIDIA紧密合作，以微调我们的系统并确保AI工作负载中的领导地位。”

Learn more about the new MLPerf v5.0 Inference benchmarks at: https://mlcommons.org/benchmarks/inference-datacenter/

在以下网址了解有关新的MLPERF V5.0推理基准的更多信息：https：//mlcommons.org/benchmarks/inference-datacenter/

Supermicro is the only system vendor publishing record MLPerf inference performance (on select benchmarks) for both the air-cooled and liquid-cooled NVIDIA HGX™ B200 8-GPU systems. Both air-cooled and liquid-cooled systems were operational before the MLCommons benchmark start date. Supermicro engineers optimized the systems and software to showcase the impressive performance. Within the operating margin, the Supermicro air-cooled B200 system exhibited the same level of performance as the liquid-cooled B200 system. Supermicro has been delivering these systems to customers while we conducted the benchmarks.

SuperMicro是唯一针对气冷和液冷NVIDIA HGX™B200 8-GPU系统的系统供应商发布记录MLPERF推理性能（在某些基准测试中）。在MLCommons基准开始日期之前，气冷和液冷系统都在运行。超级工程师优化了系统和软件，以展示令人印象深刻的性能。在操作余量中，超级气冷B200系统表现出与液冷B200系统相同的性能水平。在我们进行基准测试时，Supermicro一直向客户交付这些系统。

MLCommons emphasizes that all results be reproducible, that the products are available and that the results can be audited by other MLCommons members. Supermicro engineers optimized the systems and software, as allowed by the MLCommons rules.

MLCommons强调所有结果都是可重现的，产品可用，并且可以由其他MLCommons成员审核结果。超级工程师根据MLCommons规则允许优化系统和软件。

The SYS-421GE-NBRT-LCC (8x NVIDIA B200-SXM-180GB) and SYS-A21GE-NBRT (8x NVIDIA B200-SXM-180GB) showed performance leadership running the Mixtral 8x7B Inference, Mixture of Experts benchmarks with 129,000 tokens/second. The Supermicro air-cooled and liquid-cooled NVIDIA B200 based system delivered over 1,000 tokens/second inference for the large Llama3.1-405b model, whereas the previous generations of GPU systems have much smaller results. For smaller inferencing tasks, using the LLAMA2-70b benchmark, a Supermicro system with the NVIDIA B200 SXM-180GB installed shows the highest performance from a Tier 1 system supplier.

SYS-421GE-NBRT-LCC（8x NVIDIA B200-SXM-180GB）和SYS-A21GE-NBRT（8x NVIDIA B200-SXM-180GB）显示出性能领导力，运行MixTRAL 8x7b推理，专家混合物与129,000个代币/秒。基于Supermicro气冷和液冷NVIDIA B200的系统，用于大型Llama3.1-405b模型的1000多个令牌/秒推断，而GPU的前几代GPU系统的结果较小。对于较小的推断任务，使用Llama2-70B基准，这是一种具有NVIDIA B200 SXM-180GB的超级系统，已安装了Tier 1 System System供应商的最高性能。

Specifically:

具体来说：

* Supermicro achieved outstanding performance on several MLPerf Inference v5.0 benchmarks with the NVIDIA HGX™ B200 8-GPU in 10U and 4U configurations.

* SuperMicro在10U和4U配置中的NVIDIA HGX™B200 8-GPU上获得了多个MLPERF推理V5.0基准的出色性能。

* In select benchmarks, Supermicro's systems delivered the best performance.

*在精选的基准测试中，Supermicro的系统提供了最佳性能。

* Supermicro showcased more than 3x the tokens/second generation for Llama2-70B and Llama3.1-405b benchmarks compared to H200 8-GPU systems.

*与H200 8-GPU系统相比，SuperMicro的Llama2-70B和Llama3.1-405B基准的标记/第二代超过3倍。

"MLCommons congratulates Supermicro on their submission to the MLPerf Inference v5.0 benchmark. We are pleased to see their results showcasing significant performance gains compared to earlier generations of systems," said David Kanter, Head of MLPerf at MLCommons. "Customers will be pleased by the performance improvements achieved which are validated by the neutral, representative and reproducible MLPerf results."

MLCommons的MLPerf负责人David Kanter说：“ MLCommons祝贺Supermicro提交给MLPERF推断V5.0基准。我们很高兴看到他们的结果与早期的系统相比展示了显着的性能增长。” “客户将对所取得的绩效改进感到满意，这些绩效得到了由中性，代表和可重复的MLPERF结果验证的。”

Supermicro offers a comprehensive AI portfolio with over 100 GPU-optimized systems, both air-cooled and liquid-cooled options, with a choice of CPUs, ranging from single-socket optimized systems to 8-way multiprocessor systems. Supermicro rack-scale systems include computing, storage, and network components, which reduce the time required to install them once they are delivered to a customer.

SuperMicro提供了全面的AI投资组合，具有100多个GPU优化的系统，包括气冷和液体冷却选项，可选择CPU，范围从单插入优化的系统到8向多处理器系统。 SuperMicro机架规模的系统包括计算，存储和网络组件，这些系统一旦将它们运送到客户就可以减少安装它们所需的时间。

Supermicro's NVIDIA HGX B200 8-GPU systems utilize next-generation liquid-cooling and air-cooling technology. The newly developed cold plates and the new 250kW coolant distribution unit (CDU) more than double the cooling capacity of the previous generation in the same 4U form factor. Available in 42U, 48U, or 52U configurations

Supermicro的NVIDIA HGX B200 8-GPU系统利用下一代液体冷却和空气冷却技术。新开发的冷板和新的250kW冷却液分配单元（CDU）是上一代相同4U外形的冷却能力的两倍以上。在42U，48U或52U配置中可用