Resource
Fix Invalid JSON from AI
The JSON won't parse and you can't see why. Deterministic cause-sniffing — trailing commas, single quotes, unclosed brackets — and the repair prompt that fixes it.
AI Output Validator resources
Paste an AI's output and validate it against the expected format — with a repair prompt for every failure found.
Resource
Validate AI Output — Catch Format Violations
Paste the response, get the verdict: real JSON parsing, missing-field detection, and a repair prompt for everything found.
Resource
Agent Evaluation Scorecard Prompt
Grade agent output the same way every time — a rubric scoring correctness, grounding, safety, tone, and completeness, with a pass threshold instead of a gut call.
Resource
Agent Failure Analysis Prompt
Turn a failed case into a fix — diagnose where in the agent's flow it went wrong, categorize the failure, and point at the prompt, tool, or context that caused it.
Resource
Catch Invalid AI Labels
The model answered "Complaints" — your set says "Complaint". One character of drift, one broken dashboard. Caught before it counts.
Resource
Check AI Output for Missing Sections
The PRD looks done — but Non-Goals is gone and Requirements jumped above Goals. Section presence and order, checked in one pass.
Resource
Conversation Quality Evaluation Prompt
Judge the whole conversation, not one reply — evaluate a multi-turn exchange for context retention, coherence, goal completion, and recovery from misunderstanding.
Resource
Fix AI Format Drift
Run 40 looks nothing like run 1: sections reordered, one came back empty. Detect the drift, repair the run, keep the pipeline honest.
Resource
Groundedness Check Prompt
Verify a RAG answer is actually from its retrieved context — every claim traced to a retrieved passage, and any answer that outran its sources flagged.
Resource
Hallucination Detection Prompt
Catch the confident invention — check an AI output's claims against its source and flag every statement that isn't supported, with the unsupported span quoted.
Resource
Repair AI Output with a Repair Prompt
Don't re-roll the whole response — send back a surgical prompt that fixes the violations and keeps everything that was right.
Resource
Validate Classification Output
Label in the set? Case exact? Confidence in range? The checks that keep classification output usable for routing.
Resource
Validate Markdown Structure
Heading scan against the skeleton: missing sections, broken order, absent title — the README that shipped without its Examples.
Resource
Validate Structured Output from AI
Fields checked against the contract: missing ones flagged, invented ones caught, prose around the object detected.
Resource
Validate Summary Output
Did the summary keep its contract? Section presence, preamble detection, and the "Here is the summary" tax — checked and repaired.