Prompt Engineering Debugging Revision

What Changed in My Prompt? A Revision Diff

When a prompt's output suddenly shifts, the first question is what changed in the prompt. A diff answers it in seconds — additions, removals, and edits, itemized.

Overview

The usual debugging story: a prompt that produced reliable output starts behaving differently, and the only suspect is an edit someone made along the way. Re-reading the prompt won't surface the change — you remember the intent, not the wording. Diffing the current version against the last known-good one shows the exact instructions that were added, removed, or reworded, and flags whether any of them moved a risk signal. The loaded pair reproduces this scenario: a small 'harmless' edit that actually dropped a constraint.

Workflow

  1. Diff the loaded pair

    Version B looks like a harmless extension — it adds milestones with dates. Run the diff.

  2. Find the silent removal

    The 'do not mention internal discussions or unconfirmed timelines' constraint is gone — and B now asks for dates, which that constraint used to guard.

  3. Read the risk changes

    Removed constraints register as an output-control decrease. That's the regression the edit's author never noticed.

  4. Apply to your incident

    Paste the last known-good version as A and the current one as B — the suspect edit is in the removed or modified list.

Why This Works

  • Memory recalls a prompt's intent, not its wording — diffs recall the wording
  • Silent constraint removals are the most common cause of 'the prompt suddenly got worse'
  • Itemized changes turn 'something is off' into a specific, fixable edit

Best for

  • Prompts where output quality regressed after an edit
  • Shared prompts edited by more than one person
  • Guardrail-heavy prompts where silent removals are costly

Not for

  • Deciding which of two prompt drafts to adopt — that's the Prompt Comparator
  • Cleaning repetition out of one prompt — that's the Prompt Cleaner

Use cases

  • Debugging why a stable prompt's output suddenly changed
  • Auditing an edit a teammate made to a shared prompt
  • Verifying a 'small tweak' didn't remove a guardrail

Tip: Save time by exploring related resources and tools that integrate with this workflow.

Explore all resources