彻底改变 AI 性能：Apple 和 Nvidia 的语言模型新时代

Apple Inc. 和 Nvidia Corporation 进行了一项突破性合作，联手提高大型语言模型 (LLM) 的性能。

Tech giants Apple Inc. and Nvidia Corporation are joining forces to enhance the performance of large language models (LLMs). This partnership will see Apple’s Recurrent Drafter (ReDrafter) technique being integrated with Nvidia’s TensorRT-LLM system to significantly boost text generation speeds.

科技巨头苹果公司和英伟达公司正在联手提高大型语言模型 (LLM) 的性能。此次合作将使 Apple 的 Recurrent Drafter (ReDrafter) 技术与 Nvidia 的 TensorRT-LLM 系统集成，从而显着提高文本生成速度。

During the collaboration, Apple’s ReDrafter, a method that combines beam search with dynamic tree attention, will be merged into Nvidia’s TensorRT-LLM. This integration aims to optimize the performance of LLMs on Nvidia GPUs, pushing the boundaries of AI technology.

在合作期间，Apple 的 ReDrafter（一种将波束搜索与动态树注意力相结合的方法）将被合并到 Nvidia 的 TensorRT-LLM 中。此次集成旨在优化 Nvidia GPU 上的法学硕士的性能，突破人工智能技术的界限。

The merger will also involve adding new operators to enhance TensorRT-LLM’s capability to handle intricate models and their decoding processes. The results of these enhancements are impressive, showing a 2.7x increase in token generation speed for greedy decoding on Nvidia GPUs. This achievement promises to substantially cut down latency and power consumption, offering more efficient computational possibilities.

此次合并还将涉及添加新的运算符，以增强 TensorRT-LLM 处理复杂模型及其解码过程的能力。这些增强的结果令人印象深刻，显示 Nvidia GPU 上贪婪解码的令牌生成速度提高了 2.7 倍。这一成就有望大幅减少延迟和功耗，提供更高效的计算可能性。

The advancement holds significant implications, as highlighted by Apple’s machine learning experts, who anticipate reduced computational costs and improved user experiences through lower latency in production environments.

正如苹果机器学习专家所强调的那样，这一进步具有重大意义，他们预计通过降低生产环境中的延迟来降低计算成本并改善用户体验。

Financially, both companies are on a high. Apple reported a fourth-quarter revenue of $94.9 billion, outperforming analyst predictions, while Nvidia’s third-quarter revenue shot up by 94% from the previous year to $35.1 billion. Collectively, Apple and Nvidia’s market value hovers around $7 trillion, marking them as pillars in the tech industry.

从财务角度来看，两家公司都处于高位。苹果公布第四季度营收为 949 亿美元，超出分析师预期，而英伟达第三季度营收较上年增长 94%，达到 351 亿美元。苹果和英伟达的市值合计徘徊在 7 万亿美元左右，成为科技行业的支柱。