localMoE
Run Deepseek-v4-pro (1600B MoE) on a 32GB-RAM consumer machine with WSL — Rust, experts streamed from disk.
Rust
More Everything else
Run Deepseek-v4-pro (1600B MoE) on a 32GB-RAM consumer machine with WSL — Rust, experts streamed from disk.