This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
Tessary
Stop your agents from failing silently in production
Tessary is an open-source agent reliability platform. It monitors every production trace, detects failures that sampled evals miss, and investigates the root cause with your agent codebase. It runs cheap, narrow classifiers across every trace. When it detects a recurring issue or change in behaviour, it groups the affected traces into a finding, validates the issue, and investigates what caused it. This keeps monitoring cheap, with deeper analysis reserved for issues that warrant investigation.
About a year ago, @nina_nixes and I started building synthetic users for usability testing of B2B software. We built agents that would personify real users and use the software, but we couldn't get them to work reliably enough over long sessions.
We built a massive eval set to tune them, but then evaluating a single agent session became about 5x more expensive than actually running it because we needed to grade across its many narrow intents.
That's where Tessary originated. We wanted to catch more of these failures and understand what caused them without making evaluation prohibitively expensive.
The approach we've built uses cheap, narrow classifiers to monitor every production trace, with deeper analysis reserved for issues that warrant investigation. It's open source, and you can self-host it or try it on our free Cloud plan. Here's a quick interactive walkthrough to check it out - Demo.
I'd love to hear from others working on agent reliability. What failures are you still catching manually, and what have you had to build your own checks for?
Thanks for taking a look. @nina_nixes and I are here for questions and feedback.
Congrats on the launch! What's the cost difference between my current grading evals and your approach?
That story about the evaluation bill is a pretty good reason to build this. Narrow checks on every trace, with a closer look at recurring problems, sounds like a sensible place to start.
Hey everyone! I'm Nidhi, co-founder of Tessary. I'm really looking forward to hearing from you folks about our product!
Across the many agents we've seen being deployed in production, one behaviour seems to be consistent. Builders are constantly agonized by the edge cases that go unhandled, or LLMs being pedantic with excessive instructions. Having to find these out has been painstakingly difficult, parsing through millions of traces manually, followed by writing expensive evals to prevent them.
We built Tessary to help teams avoid this mess. Metrics for agents should be as easy to track as traditional software, know exactly the kind of behaviour that goes for a toss, with data to back it up.
If you've experienced a similar pain before, we'd love to chat! Try us out for free at app.tessary.ai :)
Congrats on the launch! We currently use Braintrust and use scoring on trace samples for evals, how is yours different?
About Tessary on Product Hunt
“Stop your agents from failing silently in production”
Tessary was submitted on Product Hunt and earned 23 upvotes and 9 comments, placing #31 on the daily leaderboard. Tessary is an open-source agent reliability platform. It monitors every production trace, detects failures that sampled evals miss, and investigates the root cause with your agent codebase. It runs cheap, narrow classifiers across every trace. When it detects a recurring issue or change in behaviour, it groups the affected traces into a finding, validates the issue, and investigates what caused it. This keeps monitoring cheap, with deeper analysis reserved for issues that warrant investigation.
Tessary was featured in Open Source (69k followers), Developer Tools (521.6k followers) and Artificial Intelligence (481.7k followers) on Product Hunt. Together, these topics include over 238.1k products, making this a competitive space to launch in.
Who hunted Tessary?
Tessary was hunted by Akhil Varma. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how Tessary stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Akhil Varma
Hey PH 👋, I'm Akhil, co-founder of Tessary.
About a year ago, @nina_nixes and I started building synthetic users for usability testing of B2B software. We built agents that would personify real users and use the software, but we couldn't get them to work reliably enough over long sessions.
We built a massive eval set to tune them, but then evaluating a single agent session became about 5x more expensive than actually running it because we needed to grade across its many narrow intents.
That's where Tessary originated. We wanted to catch more of these failures and understand what caused them without making evaluation prohibitively expensive.
The approach we've built uses cheap, narrow classifiers to monitor every production trace, with deeper analysis reserved for issues that warrant investigation. It's open source, and you can self-host it or try it on our free Cloud plan. Here's a quick interactive walkthrough to check it out - Demo.
I'd love to hear from others working on agent reliability. What failures are you still catching manually, and what have you had to build your own checks for?
Thanks for taking a look. @nina_nixes and I are here for questions and feedback.