This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
Product upvotes vs the next 3
Waiting for data. Loading
Product comments vs the next 3
Waiting for data. Loading
Product upvote speed vs the next 3
Waiting for data. Loading
Product upvotes and comments
Waiting for data. Loading
Product vs the next 3
Loading
Verify LLM API
Check which model your AI agent is really using
Verify LLM API checks whether the model behind your AI agent or API matches its claim. Tell a Codex agent to run verifyllmapi.com/run, or test an OpenAI- or Anthropic-compatible endpoint. It reuses the Agent’s login in fresh sessions, samples one-token outputs, and matches their distribution with public fingerprints using Jensen–Shannon distance. Credentials and raw samples stay local. The library covers 161 exact model IDs; unknown or weak matches return INCONCLUSIVE.
Hey Product Hunt 👋
I built Verify LLM API after reading “One Token Is Enough,” a paper that shows how repeated single-token output distributions can act as behavioral model fingerprints.
The smallest useful flow is one prompt:
Run https://verifyllmapi.com/run to verify this AI Agent’s model.
For a Codex session, the Skill reuses the Agent’s host-managed login and starts fresh isolated sessions. It keeps credentials and raw samples local, then compares answer distributions with public references using Jensen–Shannon distance. The result is CONSISTENT, MISMATCH, or INCONCLUSIVE. It is behavioral evidence, not vendor attestation.
The main limit today is coverage. The bundled library spans 161 exact model IDs, not every current model or routing layer. New releases, provider changes, and wrappers can shift a fingerprint. I hope other builders will use the same method to measure the newest models and share reproducible results. If you test a newer model fingerprint, please email me at [email protected]. The same address is listed on verifyllmapi.com.
Thank you to the authors of “One Token Is Enough” for publishing the paper, dataset, and code. This tool is a small practical build on top of their work.
I’d value blunt feedback: where does the report feel clear, and where does it overstate or under-explain the evidence?
About Verify LLM API on Product Hunt
“Check which model your AI agent is really using”
Verify LLM API was submitted on Product Hunt and earned 9 upvotes and 9 comments, placing #126 on the daily leaderboard. Verify LLM API checks whether the model behind your AI agent or API matches its claim. Tell a Codex agent to run verifyllmapi.com/run, or test an OpenAI- or Anthropic-compatible endpoint. It reuses the Agent’s login in fresh sessions, samples one-token outputs, and matches their distribution with public fingerprints using Jensen–Shannon distance. Credentials and raw samples stay local. The library covers 161 exact model IDs; unknown or weak matches return INCONCLUSIVE.
On the analytics side, Verify LLM API competes within API, Developer Tools, Artificial Intelligence and GitHub — topics that collectively have 1.1M followers on Product Hunt. The dashboard above tracks how Verify LLM API performed against the three products that launched closest to it on the same day.
Who hunted Verify LLM API?
Verify LLM API was hunted by Evan Reed. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
For a complete overview of Verify LLM API including community comment highlights and product details, visit the product overview.
Evan Reed