ZCube, a collaborative effort by Zhipu, Yuxun Network, and Tsinghua University, has introduced a novel networking architecture to address congestion in large model inference deployments. Implemented in the GLM-5.1 coding production environment with a thousand GPUs, ZCube's architecture eliminates traditional Spine layer switches, adopting a fully flattened topology with a 2-hop network diameter. This design, coupled with a hybrid access mechanism, ensures balanced traffic load across all network switches.
Benchmark tests reveal that ZCube reduces hardware costs by 33% and boosts average GPU inference throughput by 15%, while significantly cutting the P99 first-token latency by 40.6%. These improvements highlight ZCube's potential to enhance performance and cost-efficiency in large-scale AI model deployments.
ZCube Network Architecture Enhances Large Model Inference Efficiency
Disclaimer: The content provided on Phemex News is for informational purposes only. We do not guarantee the quality, accuracy, or completeness of the information sourced from third-party articles. The content on this page does not constitute financial or investment advice. We strongly encourage you to conduct you own research and consult with a qualified financial advisor before making any investment decisions.
