Skip to content
▌beetlix/swarm

Methodology

How I score AI tools

Every review follows the same rubric, so a score means the same thing from one tool to the next.

What I look at

Reviews here are desk research, not hands-on testing. Nobody on this site installs, runs, or pays for the tools before writing, and no review will claim otherwise.

  • The vendor's own documentation: what the tool commits to doing, and what it stays quiet about.
  • Pricing read from official sources and refreshed regularly.
  • Capability boundaries as documented: what is supported, what is explicitly not, and where the docs go vague.
  • Live signals: model pricing and GitHub stars, tracked over time.
  • Trade-offs: every tool has them, and the review names them.

The rating

Scores are out of 5 and reflect overall value for the tool's intended user, not a feature checkbox count. A high price is fine if the tool earns it; a free tool still loses points if it wastes your time. The verdict spells out who should use it and who should skip it.

What I don't do

No tool pays for a higher score or a better spot in a ranking. Affiliate links are disclosed and kept out of the rubric. I don't cherry-pick the one benchmark that flatters a tool, and I don't tuck the weaknesses below the fold. When a popular tool is overrated, the review says so.

Live data

Pricing and popularity figures are pulled from public APIs and refreshed daily, so reviews stay current instead of decaying. Where a number appears, it reflects the most recent sync.

When a score changes

Reviews aren't frozen. A tool can climb when it ships a genuinely better release, or slip when a price hike or a quality regression changes the math. The live pricing and popularity numbers update on their own; the written verdict gets revisited when a tool has changed enough to matter. Each review shows when it was last looked at, so you can judge how current the call is.

Versions move fast

AI tools ship breaking changes on a weekly cadence, so a review shows the date it was last looked at. A verdict written against last quarter's release is labelled as such, not passed off as current. When a new version lands that changes the picture, the review is rewritten against the updated documentation and pricing.