442Stars主要语言: Shell创建时间: 2026-07-03
AI 总结
A comprehensive guide to building a high-end local LLM inference rig with 4× RTX PRO 6000 GPUs and PCIe switches for near-wire-speed peer-to-peer communication, achieving 50.4 GB/s bidirectional bandwidth at sub-microsecond latency.
项目描述
Everything I know about running LLMs locally