PenguinHarness is an open-source self-improving harness built by the team behind LlamaFactory. Its AI-native SDK enables agents to build, evaluate, and optimize other agents. It supports 1,000+ models, reusable skills, tool and context management, automatic data generation, multi-agent evaluation, and closed-loop harness evolution. With one prompt and about $0.02, an agent can build a complete RAG application.
Hey Product Hunt 👋
We're the team behind LlamaFactory, and today we're launching PenguinHarness, an open-source self-improving harness that we've spent the past six months building.
Most agent frameworks are designed for humans to manually connect prompts, tools, and workflows. We wanted to build something different: a harness designed for agents themselves.
With PenguinHarness, agents can build other agents, generate evaluation data, analyze failures, optimize Skills and workflows, run regression tests, and retain successful improvements—forming a complete self-improvement loop.
What’s included today:
🐧 AI-native agent runtime
🔌 Unified access to 1,000+ models
🧰 Tool execution and context/state management
🧠 Reusable and optimizable Skills
📊 Automatic data generation and multi-agent evaluation
🔁 Closed-loop harness evolution
🏠 Fully open-source and self-hostable
In one experiment, an agent built a complete RAG application from a single prompt for about $0.02.
On our complex data-analysis benchmark, PenguinHarness + DeepSeek achieved the highest accuracy among the tested configurations, at around 1/70 the cost of Claude Code + Opus.
We'd love your feedback on the agent-facing SDK, self-improvement workflow, and which models or integrations we should support next.
Thanks for checking out PenguinHarness 🐧
https://penguin.ooo/
The closed loop evolution part is what I would stress test first. Letting agents build other agents, generate their own eval data, and retain the improvements that scored well sounds great until the eval data itself has a bias baked in from whatever the agent already believes is good. If the same system that proposes changes is also grading them, there is a real risk of it optimizing for whatever its own benchmark rewards rather than what actually works better in practice.
How do you keep the evaluation honest when the thing being evaluated had a hand in generating the test. Also the $0.02 RAG app number is a fun headline, but I would want to know what that run actually included. Did it cover retries, failed attempts that got thrown away, or just the one successful pass. A lot of agent cost numbers quietly leave out the exploration that happened before the thing that worked.
About PenguinHarness on Product Hunt
“Let Agents Autonomously Build Better Agents for $0.02”
PenguinHarness launched on Product Hunt on July 23rd, 2026 and earned 63 upvotes and 3 comments, placing #55 on the daily leaderboard. PenguinHarness is an open-source self-improving harness built by the team behind LlamaFactory. Its AI-native SDK enables agents to build, evaluate, and optimize other agents. It supports 1,000+ models, reusable skills, tool and context management, automatic data generation, multi-agent evaluation, and closed-loop harness evolution. With one prompt and about $0.02, an agent can build a complete RAG application.
PenguinHarness was featured in Open Source (68.6k followers), Developer Tools (516.3k followers), GitHub (41.3k followers), SDK (810 followers) and OpenAI Day (8 followers) on Product Hunt. Together, these topics include over 117.2k products, making this a competitive space to launch in.
Who hunted PenguinHarness?
PenguinHarness was hunted by Yaowei Zheng. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how PenguinHarness stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Yaowei Zheng