Skip to content
Skillpedia
Analysis & spreadsheets48k · #3635

monte-carlo-validation-notebook

Generates SQL reports to check dbt changes. Compares before and after versions to ensure code quality and correctness.

What it does

This tool creates a SQL test notebook to check changes in your data. It compares how the data looked before with how it looks after the changes, using SQL queries.

When to use it

  • ✓When reviewing changes in a data project (dbt).
  • ✓When you want to ensure changes didn't break anything.
  • ✓To compare data between a production and a development environment.

Example of what to ask your AI

“Create a SQL validation notebook for the GitHub PR changes [PR URL] for the 'sales' and 'customers' models.”

Want more? Open the sections below.

How to use

The easiest way: copy the message below and paste it into Claude, ChatGPT, Cursor or any AI. It reads the skill and follows the instructions.

Skill link

https://github.com/sickn33/agentic-awesome-skills/blob/main/plugins/agentic-awesome-skills-claude/skills/monte-carlo-validation-notebook/SKILL.md

Ready-to-paste message

Use this skill to help me: https://github.com/sickn33/agentic-awesome-skills/blob/main/plugins/agentic-awesome-skills-claude/skills/monte-carlo-validation-notebook/SKILL.md Read the SKILL.md file at that link and follow its instructions for my task.
How it works

The tool analyzes the changes in your data project (either from a GitHub link or your local machine) and generates specific SQL queries. These queries are bundled into a link that opens an interactive notebook for you to see the results.

Installation

Easiest way: copy the skill link and paste it into Claude, ChatGPT or Cursor asking it to follow the instructions.

In the terminal (Claude Code, Codex, Cursor), in your project folder:

npx skills add sickn33/agentic-awesome-skills --skill monte-carlo-validation-notebook

Or download just the file:

curl -L https://raw.githubusercontent.com/sickn33/agentic-awesome-skills/main/plugins/agentic-awesome-skills-claude/skills/monte-carlo-validation-notebook/SKILL.md -o SKILL.md
Technical content (original SKILL.md)

Original text by the author, straight from GitHub.

Tip: This skill works well with Sonnet. Run /model sonnet before invoking for faster generation.

Generate a SQL Notebook with validation queries for dbt changes.

Arguments: $ARGUMENTS

Detailed Guide

Read the detailed guide before executing this skill. It retains the complete procedure and reference material. Treat its safety, prerequisites, and validation requirements as mandatory. For focused work, load the relevant sections; for end-to-end work, read the guide completely.

When to Use

Use this skill when the user wants to validate dbt model or snapshot changes with Monte Carlo SQL Notebook queries, either from a GitHub PR or a local dbt repository.

Parse the arguments:

  • Target (required): first argument — a GitHub PR URL or local dbt repo path
  • MC Base URL (optional): --mc-base-url <URL> — defaults to https://getmontecarlo.com
  • Models (optional): --models <model1,model2,...> — comma-separated list of model filenames (without .sql extension) to generate queries for. Only these models will be included. By default, all changed models are included up to a maximum of 10.

Setup

Prerequisites:

  • gh (GitHub CLI) — required for PR mode. Must be authenticated (gh auth status).
  • python3 — required for helper scripts.
  • pyyaml — install with pip3 install pyyaml (or pip install pyyaml, uv pip install pyyaml, etc.)

Note: Generated SQL uses ANSI-compatible syntax that works across Snowflake, BigQuery, Redshift, and Athena. Minor adjustments may be needed for specific warehouse quirks.

This skill includes two helper scripts in ${CLAUDE_PLUGIN_ROOT}/skills/monte-carlo-validation-notebook/scripts/:

  • resolve_dbt_schema.py - Resolves dbt model output schemas from dbt_project.yml routing rules and model config overrides.
  • generate_notebook_url.py - Encodes notebook YAML into a base64 import URL and opens it in the browser.

Mode Detection

Auto-detect mode from the target argument:

  • If target looks like a URL (contains :// or github.com) -> PR mode
  • If target is a path (., /path/to/repo, relative path) -> Local mode

Context

This command generates a SQL Notebook containing validation queries for dbt changes. The notebook can be opened in the MC Bridge SQL Notebook interface for interactive validation.

The output is an import URL that opens directly in the notebook interface:

<MC_BASE_URL>/notebooks/import#<base64-encoded-yaml>

Key Features:

  • Database Parameters: Two text parameters (prod_db and dev_db) for selecting databases
  • Schema Inference: Automatically infers schema per model from dbt_project.yml and model configs
  • Single-table queries: Basic validation queries using {{prod_db}}.<SCHEMA>.<TABLE>
  • Comparison queries: Before/after queries comparing {{prod_db}} vs {{dev_db}}
  • Flexible usage: Users can set both parameters to the same database for single-database analysis

Notebook YAML Spec Reference

Key structure:

version: 1
metadata:
  id: string           # kebab-case + random suffix
  name: string         # display name
  created_at: string   # ISO 8601
  updated_at: string   # ISO 8601
default_context:       # optional database/schema context
  database: string
  schema: string
cells:
  - id: string
    type: sql | markdown | parameter
    content: string    # SQL, markdown, or parameter config (JSON)
    display_type: table | bar | timeseries

Limitations

  • Use this skill only when the task clearly matches the scope described above.
  • Do not treat the output as a substitute for environment-specific validation, testing, or expert review.
  • Stop and ask for clarification if required inputs, permissions, safety boundaries, or success criteria are missing.
FAQ

Do I need to install anything?

Yes, you need to have the GitHub CLI (gh), Python 3, and the PyYAML library installed on your computer.

Where can I use the generated queries?

The queries are compatible with databases like Snowflake, BigQuery, Redshift, and Athena. Minor adjustments might be needed for each.

What are the 'prod_db' and 'dev_db' parameters?

These are fields in the notebook that allow you to choose which database to use for comparing 'production' and 'development' data.

Details

Original description by the author

Generates SQL validation notebooks for dbt PR changes with before/after comparison queries.

repo: sickn33/agentic-awesome-skills

Popularity

GitHub stars
48k
Ranking position
#3635
License
MIT
Updated
10/15/2026

Is this skill useful?

0

Sign in to vote.

Comments

  • …

More skills from this repository

Similar skills