Skip to content
Skillpedia
Agents48k · #2408

bdistill-behavioral-xray

Helps your agent analyze the behavior of other AI models. Useful for understanding boundaries, hallucination tendencies, and reasoning style.

What it does

This tool tests how an AI model behaves by checking its boundaries, tendency to hallucinate, reasoning style, and default formatting. It doesn't require any special API keys.

When to use it

  • ✓To understand how an AI model actually behaves.
  • ✓When choosing which AI model to use for a specific task.
  • ✓To investigate why the AI refuses to answer or invents information.

Example of what to ask your AI

“Test this AI model's behavior.”

Want more? Open the sections below.

How to use

The easiest way: copy the message below and paste it into Claude, ChatGPT, Cursor or any AI. It reads the skill and follows the instructions.

Skill link

https://github.com/sickn33/agentic-awesome-skills/blob/main/plugins/agentic-awesome-skills-claude/skills/bdistill-behavioral-xray/SKILL.md

Ready-to-paste message

Use this skill to help me: https://github.com/sickn33/agentic-awesome-skills/blob/main/plugins/agentic-awesome-skills-claude/skills/bdistill-behavioral-xray/SKILL.md Read the SKILL.md file at that link and follow its instructions for my task.
How it works

The tool sends 30 carefully designed questions to the AI model and analyzes the responses. It then generates a visual report with charts to show the behavioral patterns found.

Installation

Easiest way: copy the skill link and paste it into Claude, ChatGPT or Cursor asking it to follow the instructions.

In the terminal (Claude Code, Codex, Cursor), in your project folder:

npx skills add sickn33/agentic-awesome-skills --skill bdistill-behavioral-xray

Or download just the file:

curl -L https://raw.githubusercontent.com/sickn33/agentic-awesome-skills/main/plugins/agentic-awesome-skills-claude/skills/bdistill-behavioral-xray/SKILL.md -o SKILL.md
Technical content (original SKILL.md)

Original text by the author, straight from GitHub.

Behavioral X-Ray

Systematically probe an AI model's behavioral patterns and generate a visual report. The described workflow probes the host model through its existing session; it still requires the separately installed bdistill package/MCP integration and can consume host-model usage. Do not configure the host automatically just from a request to read this skill.

Overview

bdistill's Behavioral X-Ray runs 30 carefully designed probe questions across 6 dimensions, auto-tags each response with behavioral metadata, and compiles results into a styled HTML report with radar charts and actionable insights.

Use it to understand your model before building with it, compare models for task selection, or track behavioral drift over time.

When to Use This Skill

  • Use when you want to understand how your AI model actually behaves (not how it claims to)
  • Use when choosing between models for a specific task
  • Use when debugging unexpected refusals, hallucinations, or formatting issues
  • Use for compliance auditing — documenting model behavior at deployment boundaries
  • Use for red team assessments — systematic boundary mapping across safety dimensions

How It Works

Step 1: Install

pip install bdistill
claude mcp add bdistill -- bdistill-mcp   # Claude Code

For other tools, add bdistill-mcp as an MCP server in your project config.

Step 2: Run the probe

In Claude Code:

/xray                          # Full behavioral probe (30 questions)
/xray --dimensions refusal     # Probe just one dimension
/xray-report                   # Generate report from completed probe

In any tool with MCP:

"X-ray your behavioral patterns"
"Test your refusal boundaries"
"Generate a behavioral report"

Probe Dimensions

Dimension What it measures
tool_use When does it call tools vs. answer from knowledge?
refusal Where does it draw safety boundaries? Does it over-refuse?
formatting Lists vs. prose? Code blocks? Length calibration?
reasoning Does the visible answer provide an appropriate concise explanation and handle trick questions? Do not request, expose or infer hidden chain-of-thought.
persona Identity, tone matching, composure under hostility
grounding Hallucination resistance, fabrication traps, knowledge limits

Output

A styled HTML report showing:

  • Observed refusal/hedge rates and visible explanation style; no measurement of hidden reasoning
  • Per-dimension breakdown with bar charts
  • Notable response examples with behavioral tags
  • Actionable insights (e.g., "visible explanations appeared in 25 of 30 recorded responses; this is not a hidden-reasoning measurement")

Best Practices

  • Answer probe questions honestly — the value is in authentic behavioral data
  • Run probes on the same model periodically to track behavioral drift
  • Compare reports across models to make informed selection decisions
  • Use adversarial knowledge extraction (/distill --adversarial) alongside behavioral probes for complete model profiling

Related Skills

  • @bdistill-knowledge-extraction - Extract structured domain knowledge from any AI model

Limitations

  • Self-reported behavior and a 30-question run are exploratory evidence, not an independent benchmark, compliance certification or universal model capability. Keep exact prompts, responses, host/model identity, date and run conditions; compare like-for-like repeated runs.
  • Do not treat the output as a substitute for environment-specific validation, testing, or expert review.
  • Stop and ask for clarification if required inputs, permissions, safety boundaries, or success criteria are missing.
FAQ

Do I need to install anything?

Yes, you need to install the 'bdistill' package and set it up in your AI environment, such as Claude Code.

What does the report show?

The HTML report displays charts with results for each test, examples of responses, and insights into how the model behaves in different situations.

Does this guarantee the AI is safe?

No, this test is exploratory and helps understand behavior. It does not replace specific safety testing or environment validation.

Details

Original description by the author

X-ray any AI model's behavioral patterns — refusal boundaries, hallucination tendencies, reasoning style, formatting defaults. No API key needed.

repo: sickn33/agentic-awesome-skills

Popularity

GitHub stars
48k
Ranking position
#2408
License
MIT
Updated
10/15/2026

Is this skill useful?

0

Sign in to vote.

Comments

  • …

More skills from this repository

Similar skills