Design Fast Model Distribution Across Workers

System Design Question Preview

Design a system that deploys a large machine learning model checkpoint to a fleet of GPU workers. The model is approximately 500 GB and must be downloaded from a central model repository, then made available on every worker before the new model version can serve traffic.