NVIDIA B200的超级系统超过上一代的3倍

Super Micro Computer，Inc。（SMCI），AI/ML，HPC，Cloud，Storage和5G/Edge的全部IT解决方案提供商

Leading industry-standard performance in select MLPerf V5.0 Inference benchmarks is announced today by Super Micro Computer, Inc. (Nasdaq: SMCI), a premier provider of complete IT solutions for AI/ML, HPC, cloud, storage, and 5G/edge.

Super Micro Computer，Inc。（NASDAQ：SMCI）今天宣布了精选MLPERF V5.0推理基准的领先行业标准性能，这是AI/ML，HPC，Cloud，Storage和5G/Edge的完整IT解决方案的总理提供商。

In several V5.0 Inference benchmarks, Supermicro systems achieved the best performance. The company's 4U liquid-cooled and 10U air-cooled systems, which used the NVIDIA HGX B200 8-GPU, outperformed H200 8-GPU systems by more than 3 times in the generation of tokens per second (Token/s) for the Llama2-70B and Llama3.1-405B benchmarks.

在几个V5.0推理基准测试中，SuperMicro系统实现了最佳性能。该公司的4U液冷和10U气冷系统，使用NVIDIA HGX B200 8-GPU，在每秒代币（llama2-70b和Llama3.1-405b benchmarkss）的代币（soken/s）中，每秒钟（soken/s）的产生代价超过3倍以上。

"We are pleased to see the first new benchmarks from MLCommons in 2025, with Supermicro remaining a leader in the AI industry," said Charles Liang, president and CEO of Supermicro. "Our building block architecture allows us to be first to market with a diverse range of systems optimized for various workloads. We continue to collaborate closely with NVIDIA to fine-tune our systems and secure a leadership position in AI workloads."

Supermicro总裁兼首席执行官Charles Liang说：“我们很高兴看到2025年MLCommons的第一个新基准，Supermicro仍然是AI行业的领导者。” “我们的构件架构使我们能够首先通过针对各种工作量进行优化的各种系统来推销。我们继续与NVIDIA紧密合作，以微调我们的系统并确保AI工作负载中的领导地位。”

Learn more about the new MLPerf v5.0 Inference benchmarks at: https://mlcommons.org/benchmarks/inference-datacenter/

在以下网址了解有关新的MLPERF V5.0推理基准的更多信息：https：//mlcommons.org/benchmarks/inference-datacenter/

Supermicro is the only system vendor to publish record MLPerf inference performance (on select benchmarks) for both the air-cooled and liquid-cooled NVIDIA HGX B200 8-GPU systems. Both air-cooled and liquid-cooled systems were operational before the MLCommons benchmark start date. Supermicro engineers optimized the systems and software to showcase the impressive performance.

SuperMicro是唯一针对风冷和液冷NVIDIA HGX B200 8-GPU系统发布记录MLPERF推理性能（在精选基准测试中）的系统供应商。在MLCommons基准开始日期之前，气冷和液冷系统都在运行。超级工程师优化了系统和软件，以展示令人印象深刻的性能。

Within the operating margin, the Supermicro air-cooled B200 system exhibited the same level of performance as the liquid-cooled B200 system. Supermicro has been delivering these systems to customers while we conducted the benchmarks.

在操作余量中，超级气冷B200系统表现出与液冷B200系统相同的性能水平。在我们进行基准测试时，Supermicro一直向客户交付这些系统。

MLCommons emphasizes that all results be reproducible, that the products are available and that the results can be audited by other MLCommons members. Supermicro engineers optimized the systems and software, as allowed by the MLCommons rules.

MLCommons强调所有结果都是可重现的，产品可用，并且可以由其他MLCommons成员审核结果。超级工程师根据MLCommons规则允许优化系统和软件。

The SYS-421GE-NBRT-LCC (8x NVIDIA B200-SXM-180GB) and SYS-A21GE-NBRT (8x NVIDIA B200-SXM-180GB) showed performance leadership running the Mixtral 8x7B Inference, Mixture of Experts benchmarks with 129,000 tokens/second. The Supermicro air-cooled and liquid-cooled NVIDIA B200 based system delivered over 1,000 tokens/second inference for the large Llama3.1-405b model, whereas the previous generations of GPU systems have much smaller results. For smaller inferencing tasks, using the LLAMA2-70b benchmark, a Supermicro system with the NVIDIA B200 SXM-180GB installed shows the highest performance from a Tier 1 system supplier.

SYS-421GE-NBRT-LCC（8x NVIDIA B200-SXM-180GB）和SYS-A21GE-NBRT（8x NVIDIA B200-SXM-180GB）显示出性能领导力，运行MixTRAL 8x7b推理，专家混合物与129,000个代币/秒。基于Supermicro气冷和液冷NVIDIA B200的系统，用于大型Llama3.1-405b模型的1000多个令牌/秒推断，而GPU的前几代GPU系统的结果较小。对于较小的推断任务，使用Llama2-70B基准，这是一种具有NVIDIA B200 SXM-180GB的超级系统，已安装了Tier 1 System System供应商的最高性能。

Specifically:

具体来说：

* The SYS-421GE-NBRT-LCC (8x NVIDIA B200-SXM-180GB) liquid-cooled system achieved the highest performance for the Mixtral 8x7B, Mixture of Experts benchmark, delivering 129,000 tokens/s. It also achieved the highest performance for the Llama3.1-405b benchmark with 1,330 tokens/s.

* SYS-421GE-NBRT-LCC（8x NVIDIA B200-SXM-180GB）液冷系统的混合8x7b的性能最高，专家的混合物基准的混合物提供了129,000个代币/s。它还以1,330代币/s的速度获得了Llama3.1-405B基准的最高性能。

* The SYS-A21GE-NBRT (8x NVIDIA B200-SXM-180GB) air-cooled system achieved the highest performance for the Mixtral 8x7B, Mixture of Experts benchmark, delivering 129,000 tokens/s. It achieved the second-highest performance for the Llama3.1-405b benchmark with 1,009 tokens/s.

* SYS-A21GE-NBRT（8x NVIDIA B200-SXM-180GB）气冷系统的混合8x7b的性能最高，专家基准的混合物提供了129,000个令牌/s。它获得了Llama3.1-405B基准的第二高性能，并获得1,009个令牌/s。

* The SYS-110R3-L (8x NVIDIA A200-SXM-80GB) system achieved the highest performance for the BERT Large benchmark.

* SYS-1110R3-L（8x NVIDIA A200-SXM-80GB）系统的性能最高，用于BERT大型基准。

* The SYS-110R3-L (8x NVIDIA A200-SXM-80GB) and SYS-A21GE-NBRT (8x NVIDIA B200-SXM-180GB) systems achieved the highest performance for the DeepLabV3 and REsNet-50 benchmarks.

* SYS-1110R3-L（8x NVIDIA A200-SXM-80GB）和SYS-A21GE-NBRT（8x NVIDIA B200-SXM-180GB）系统的DeepLaBV3和Resnet-50基准的性能最高。

* The SYS-110R3-L (8x NVIDIA A200-SXM-80GB) system achieved the highest performance for the 3D object detection benchmark.

* SYS-1110R3-L（8x NVIDIA A200-SXM-80GB）系统的3D对象检测基准的性能最高。

Supermicro offers a comprehensive AI portfolio with over 100 GPU-optimized systems, both air-cooled and liquid-cooled options

SuperMicro提供了全面的AI投资组合，具有100多个GPU优化的系统，包括气冷和液冷选项