This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
Product upvotes vs the next 3
Waiting for data. Loading
Product comments vs the next 3
Waiting for data. Loading
Product upvote speed vs the next 3
Waiting for data. Loading
Product upvotes and comments
Waiting for data. Loading
Product vs the next 3
Loading
shad0w
System 0 for your LLM: repeat answers in microseconds
shad0w watches your LLM answer the same small questions (which intent, which team, spam or not), learns the answers, and gives them back in microseconds. It only answers what it's proven to agree on; the rest goes to your LLM. Open source π
Hey Product Hunt π I'm Gaurav.
For months one number bugged me: 1.4 seconds. That's how long our LLM took to answer "which intent is this message?" Not a hard question. The same one it had answered thousands of times. π
So I built shad0w, my LLM's shadow.
It sits in front of your LLM and quietly watches its answers. Once it has seen enough (about 1,000), it compiles them into a tiny table and starts answering the repeats itself, in microseconds, on a plain CPU. Anything it isn't sure about still goes to your LLM, and that answer gets logged so it keeps learning.
The moment that made me grin: π I let it learn Snake just by watching an LLM play. At 10 moves a second the LLM can't keep up and crashes into the wall. The 2 KB table it learned from that same LLM keeps eating. You can watch the real recordings here:
https://2796gaurav.github.io/sha...
Or try to beat it at Pong, right in your browser (it decides every frame in 1.5 Β΅s):
https://2796gaurav.github.io/sha...
The part I care about most: it knows when it doesn't know. Before it answers anything, it's tested on answers it never saw, and it only answers where it agrees with your LLM 95%+ of the time. On fuzzy stuff like movie-review sentiment it answers 0% and hands everything back. That's on purpose.
I call it System 0: System 2 thinks, System 1 decides, System 0 remembers.
It's free and open source (Python, JavaScript, C). Using the OpenAI Decisions API? It's one URL change.
π¬ 2-minute explainer: https://2796gaurav.github.io/sha...
π» Code: https://github.com/2796gaurav/sh...
I'd love to know: what small question does your app ask its LLM over and over? Atraffic, tell me where it breaks. I'm here all day. π
About shad0w on Product Hunt
βSystem 0 for your LLM: repeat answers in microsecondsβ
shad0w was submitted on Product Hunt and earned 3 upvotes and 1 comments, placing #116 on the daily leaderboard. shad0w watches your LLM answer the same small questions (which intent, which team, spam or not), learns the answers, and gives them back in microseconds. It only answers what it's proven to agree on; the rest goes to your LLM. Open source π
On the analytics side, shad0w competes within Open Source, Developer Tools, Artificial Intelligence, GitHub and Google Cloud Run β topics that collectively have 1.1M followers on Product Hunt. The dashboard above tracks how shad0w performed against the three products that launched closest to it on the same day.
Who hunted shad0w?
shad0w was hunted by Gaurav Chauhan. A βhunterβ on Product Hunt is the community member who submits a product to the platform β uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
For a complete overview of shad0w including community comment highlights and product details, visit the product overview.
Gaurav Chauhan