NVIDIA ModelExpress：以光速分发模型文件
ModelExpress: Distributing Model Artifacts at the Speed of Light
NVIDIA 推出 ModelExpress，用于在集群内高速分发模型文件。随着模型 checkpoint 增长到数百 GB 乃至 1 TB，冷启动拉取权重、自动扩缩容与滚动更新填充新副本、RL 后训练持续搬运权重等场景让传输开销迅速累积。
Every byte moved has a cost. As model checkpoints grow to hundreds of gigabytes or even a terabyte, that cost adds up quickly. To make things even worse, moving...
Every byte moved has a cost. As model checkpoints grow to hundreds of gigabytes or even a terabyte, that cost adds up quickly. To make things even worse, moving these model weights around the cluster is extremely common. For instance, a cold start may pull weights from remote storage into GPU memory; autoscaling and rolling updates must populate each new replica; and RL post-training continuously…
来源：NVIDIA Developer Blog · developer.nvidia.com