← All projects

Developer Tooling

5 projects

AgentGauge

PyPI
shipped 5d ago

Answers whether rewriting an AI agent's tool descriptions actually made it better at its job, with an A/B harness for MCP servers. The research behind my tool-description paper.

pip install agentgauge-harnessv0.5.3 · 5 releases≈49 downloads/week (pypistats, excl. mirrors) Sum of the 7 most recently completed calendar days pypistats.org reports with known PyPI mirrors excluded, UTC, today's partial day not counted.
  • MCP
  • Causal measurement
  • Python

-13.3ppBLOCKING description defect, task-success effect (qwen2.5:7b)

Case study →Source ↗

Reclaim

Live
shipped today

Cleans up disk space on Windows and shows you exactly what it will remove before it removes anything, so a safe cleanup stays safe.

  • SafetyValidator
  • OpenCLIP
  • pHash + MinHash
  • LightGBM

~48GB → 23.09GB → 4.26GB → 3.92GB, never corrected upwardExact-duplicate reclaimable estimate, corrected as real safety bugs were found

Case study →Live ↗Source ↗

tracegauge

PyPI
shipped today

Scores a Claude Code session on how efficient it was, and shows you where the tokens went to waste.

pip install tracegaugev0.16.0 · 22 releases≈193 downloads/week (pypistats, excl. mirrors) Sum of the 7 most recently completed calendar days pypistats.org reports with known PyPI mirrors excluded, UTC, today's partial day not counted.
  • Python
  • PyPI
Case study →Source ↗

adk-tracegauge

PyPI
shipped 5d ago

Fails your build when an agent starts costing more per run, and tells you, every run, the smallest rise it could actually have caught.

pip install adk-tracegaugev0.10.1 · 21 releases≈148 downloads/week (pypistats, excl. mirrors) Sum of the 7 most recently completed calendar days pypistats.org reports with known PyPI mirrors excluded, UTC, today's partial day not counted.
  • Google ADK
  • Bootstrap CI
  • PyPI
Case study →Source ↗

eval-defect-bench

Research
shipped 27d ago

A held-out benchmark for a class of silent-verdict-degradation bugs, plus 3 detection baselines (AST, local LLM consensus, frontier judge) that all failed a pre-registered viability gate.

  • AST
  • Ollama
  • Frontier judge
Case study →Source ↗

← Back to all projects