wifi-llm
A technical demo of streaming LLM weights over wifi to run a 16 MB quantized llama2 in an ESP32 with 300KB of ram
C++
More Video & audio
A technical demo of streaming LLM weights over wifi to run a 16 MB quantized llama2 in an ESP32 with 300KB of ram