Tech News
← Home  ·  All topics

Kv Cache Sharing

1 GoKawiil brief on this topic

Viiwork tests KV-cache sharing across two RTX 5090 hosts over 1GbE vs 10GbE

A benchmark compared viiwork's kv_share feature on two RTX 5090 machines connected via 1 GbE, a direct 10 GbE cable running Tailscale, and the same 10 GbE cable sending kv_share traffic directly. The test ran a coding-agent workload building a todo app, measuring 12-session and 16-session runs over 90 minutes to see how network speed affects whether a session's cached prompt reaches a second host before it's needed.