LLMSlim v0.3.0

Cut LLM token costs 40-70% with offline prompt compression

Visit product ↗

v0.3.0 ships hybrid prompt compression: offline TF-IDF extraction pre-prunes context, then an optional LLM rewrite pass semantically optimizes what remains. Result: 40-70% fewer tokens billed, sub-30ms CPU latency, and 100% retention of system directives, code blocks, and JSON schemas. Works with OpenAI, Anthropic, Gemini, LangChain, LlamaIndex, Ollama and more. Zero dependencies. Pure Python. pip install llmslim

More Developer tools

Open Weights Breakoutqsa.shCuts Long Horizon Inference Costs by 50% via external KV Cache OffloadCrossle – A daily puzzle game where you find 3 intersecting wordsTermic – desktop app for running CLI coding agents (Claude Code, Codex)