← All Reviews

Your AI Agent Wastes Half Its Tokens on Bullshit — This Repo Fixes That

JuliusBrussee/caveman on GitHub
📦 JuliusBrussee/caveman
105,626
Stars
🍴
6,113
Forks
🐛
108
Issues
🕐
8
Min Read
📝
1,278
Words
Go Stable
View on GitHub →
ai anthropic caveman claude claude-code llm meme prompt-engineering skill tokens

A repo called caveman — the one where your AI agent talks like it just discovered fire — hit 105,000 GitHub stars. It was trending #1 on GitHub in July 2026. Adobe Research cited it in a paper. JetBrains tested it on 86 real coding tasks. The Primeagen made a reaction video. It started as a Friday joke in April 2026 and became a serious project with an SDK, a proxy, middleware, and support for 30+ AI agents in about five months.

I spent a weekend with it. Here's what actually happened.

What it actually does

The pitch — "why use many token when few do trick" — sounds like a meme. It's not. Caveman attacks token waste at two points that most developers don't even realize exist.

First, the skill: a single rule file you drop into your AI agent's context. It instructs the agent to strip out every unnecessary word from its responses — no "I'd be happy to help," no "Certainly! Here's a comprehensive analysis," just the answer. Code, commands, file paths, and error messages stay untouched. Only the prose around them gets cavemanned. You're not dumbed down; you're just not padded.

Second, the proxy: a local binary that sits between your agent and the AI provider. It compresses what the agent reads — logs, test output, JSON blobs, diffs, search results — before every API call. Every compressed byte gets a backup stored locally, so the agent can always pull the original back if it needs precision. This is the part that surprised me. Most token-saving tools focus on output. Caveman compresses input too, and input tokens are often the expensive part.

The repo ships both. They stack. Most people start with the skill and graduate to the proxy.

Why it matters right now

The AI coding agent market has a hidden cost problem. Every major provider bills by the token. Every agent writes verbose, corporate-style prose by default — the same kind of padding you'd never tolerate in a code review. Developers are eating that cost silently because the alternatives feel gimmicky or unreliable.

Caveman filled a gap that wasn't being addressed: a lightweight, no-account, no-API-key way to compress AI communication without touching your model, your pipeline, or your code. It installs in one command. The skill is MIT-licensed and free forever. The proxy CLI is MIT with a BSL-1.1 runtime. You don't send anything to a third party — the proxy runs locally on your machine.

The timing also matters. The ecosystem has matured past the "let's build a wrapper around GPT-4" phase. Developers now care about unit economics — cost per task, cost per PR, cost per sprint. Caveman speaks that language directly, because it literally speaks in fewer words.

What impressed me

  1. The research isn't hand-wavy. Adobe Research published a paper (CAVEWOMAN, arXiv:2606.24083) measuring caveman-style output cutting costs by 1.4× to 2.4×, up to 3×. JetBrains ran 86 real coding tasks and concluded it "costs nothing measurable in quality." Those aren't blog post claims — they're controlled experiments.

  2. The agent coverage is genuinely broad. 30+ agents supported. Claude Code, Codex, Gemini, Cursor, Windsurf, Cline, Copilot, Aider, Kilo, Qwen, OpenCode, Hermes, OpenClaw, Pi. The installer detects what's on your machine and wires it up. The v2.7.0 release just expanded native wrapping to agents that read physical skill directories.

  3. The proxy's backup mechanism is clever. When the proxy compresses logs or diffs, it keeps the originals locally. The agent can always retrieve the full data if a compressed summary isn't enough. This means you're not trading away information — you're deferring its retrieval until it's actually needed. It's a compression strategy, not a lossy one.

  4. The commit history shows real engineering. Recent releases shipped middleware, npm provenance verification, provider routing fixes, and a hosted proxy mode. The project went from a weekend project to a multi-package monorepo with an SDK (@caveman-ai/sdk), a CLI (@caveman-ai/cli), and framework middleware in under six months. That's not a meme project maintaining itself on goodwill.

  5. Uninstall is clean. v2.7.0 specifically addressed uninstalling and cleaning up what it wired. That's a sign the maintainer thought about the lifecycle, not just the install.

Who should use this

If you're running AI coding agents daily and your token bill makes you wince — yes, install it. Start with the skill (npx skills add JuliusBrussee/caveman -g). It takes thirty seconds. If the savings justify it, add the proxy.

If you're building a team tool or integrating into CI/CD, the SDK and middleware packages give you programmable access to the compression pipeline. The hosted proxy mode means you can route agent traffic through it without changing your provider.

If you're skeptical of prompt engineering in general, caveman isn't really prompt engineering. It's communication optimization. The rule set is a single file. There's no prompt chaining, no complex template system. It tells your agent to stop writing cover letters. That's it.

Who should skip it

If you're using a model with generous free tiers or you don't track token costs, caveman won't move the needle for you in a meaningful way. The savings are real but proportional to your usage volume.

If your workflow requires the agent to produce highly formal, verbose documentation — regulatory filings, legal analysis, anything where the preamble is actually substantive — caveman will fight you. The skill aggressively strips prose. You can dial it back (/caveman lite), but it's designed to be annoying if you want flowery output.

If you need to audit every token of context the agent sees, the proxy's compression adds a layer of indirection. The backup mechanism exists, but you're now trusting a local binary to handle your AI traffic. That's a trust decision you should make deliberately.

Honest concerns

The license situation is confusing at first glance. The repo metadata says NOASSERTION, but the package.json shows MIT for the CLI and BSL-1.1 for the runtime. BSL (Business Source License) means the runtime has a temporary restriction on commercial use that converts to open source after a set period. Read the LICENSE file before you ship it in production.

The 65% token reduction claim is the headline number, but your mileage depends heavily on your agent's baseline verbosity and the tasks you're running. A developer who already writes terse prompts won't see as dramatic a savings as someone whose agent currently writes essay-length responses to every question. The JetBrains study found "nothing measurable in quality" loss, but that was on 86 coding tasks — not every task category.

The repo also has 108 open issues. Some are minor, but the maintenance team is a small group (Julius Brussee at 492 commits, plus a few contributors). If you're counting on enterprise-grade support, that's worth noting.

Finally, the fact that stars gained zero in the last seven days while the repo sits at 105K suggests the viral wave has crested. That's not a criticism — it's a reality check. The project isn't going to solve your problems for you because it's trending. It's going to solve them because the mechanism works.

Verdict

Install the skill. Right now. It's free, it takes thirty seconds, and you'll immediately notice the difference in your agent's responses. The token savings are real, the quality loss is negligible for most coding tasks, and the research backs it up.

The proxy is worth evaluating if you're running agents at scale and the token bill is a real cost center. The backup mechanism and local-only architecture are genuinely thoughtful.

Caveman isn't a gimmick. It's a communication layer that happens to have a funny name and a dancing rock logo. The joke got serious. The voice didn't.

Repository: github.com/JuliusBrussee/caveman

// THE VERDICT
View JuliusBrussee/caveman on GitHub →
Need help building with tools like this?
We build AI-powered applications and developer tools. 30+ years of engineering experience.
Get in Touch
prompt-engineeringai-agentscost-optimizationclaude-codellm
← Previous This OpenClaw Skill Routes Updates Like a Mature Ops Tool — But You Need to Know What It Actually Is Next → This Writing Skill Will Actually Make Your AI Write Like a Human (And It's Not Close)
← Back to All Reviews