Microsoft announces USB4 collaborative AI solution for multiple Win11 PCs, stacking memory / GPU compute like building blocks to run local models
IT之家, November 20: Microsoft yesterday (November 19) published a blog post announcing a USB4-based remote direct memory access (RDMA) experience in developer preview, enabling multiple Windows 11 PCs to jointly run AI models.
IT之家 note: RDMA allows one computer to efficiently read from and write to authorized memory regions on another computer, reducing OS and CPU involvement in data movement. Its main advantages are low latency, high throughput, and lower CPU usage.


According to the official description, after two or more compatible PCs are connected via USB4 cables, there is no need to buy dedicated RDMA NICs or configure switches; with compatible inference frameworks, they can pool their respective memory and GPU compute to jointly run a single AI model.

In terms of latency, Microsoft's tests show that for small single-transfer payloads, the round-trip latency of inter-PC communication is about 28 to 50 microseconds, only one quarter that of traditional Ethernet UDP over the same USB4 link.

In preliminary tests, Microsoft used three AMD mini PCs each with 128GB unified memory, connected via 40Gbps USB4, running a 4-bit quantized 235-billion-parameter Qwen3 model, achieving a generation