Registry Auditor

Command Palette

Search for a command to run...

Back

Registry Auditor

v1.0.0Tool

Automated audit and repair tool for the Langfuse prompt registry including label hydration, metadata backfill, and broken prompt repair

auditlangfuseregistrymaintenancehydration
Edit
Capabilities

Executes the defined tool functionality

Content

Registry Auditor Tool

Overview

Automated audit and repair tool for the Langfuse prompt registry. Hydrates lifecycle labels, backfills missing metadata on gene prompts, and repairs broken production prompts with fallback templates.

Available Operations

Label Hydration

  • Labels - Promote all latest-only prompts to appropriate lifecycle labels
  • Automatically determines label based on prompt name (production, staging, experimental)
  • Idempotent: skips prompts that already have multiple labels

Metadata Backfill

  • Metadata - Backfill missing metadata fields on gene-* prompts
  • Required fields: model_family, provider, latency_tier, status
  • Only targets gene prompts; skips agents and other types

Broken Prompt Repair

  • Repair - Re-initialize broken production prompts with fallback templates
  • Requires force: true for destructive operations
  • Creates minimal but valid prompt structure

Full Audit

  • All - Run all three operations in sequence
  • Default operation when none specified

Parameters

ParameterTypeRequiredDescription
operationstringNoOne of: labels, metadata, repair, all (default: all)
dryRunbooleanNoPreview changes without applying (default: false)
forcebooleanNoEnable destructive operations like repair (default: false)

Safety Modes

  • Dry Run (dryRun: true): Preview all changes without applying any
  • Force (force: true): Required for broken prompt repair operations
  • Default mode is safe: no changes applied without explicit dryRun=false

Use Cases

  • Initial registry hydration after setup
  • Periodic health checks on prompt registry
  • Recovering from corrupted or incomplete prompt deployments
  • Standardizing metadata across all gene prompts
Details

Version

1.0.0

Created

July 4, 2026

Updated

July 4, 2026

Tags

audit, langfuse, registry, maintenance, hydration

Actions
Test in Playground