Skip to content
Skillpedia
Agents280k · #84

mle-workflow

Enables your agent to manage the entire machine learning lifecycle in production, from data handling to monitoring and rollbacks.

What it does

This tool helps turn an artificial intelligence (AI) project into a robust and reliable system. It ensures the data used is consistent, the model training can be repeated, and the model's quality is checked before it's used.

When to use it

  • ✓When planning a new AI system for production.
  • ✓When converting AI code from an experiment into a system that can be used repeatedly.
  • ✓When checking if an AI system is working correctly and can be rolled back if issues arise.

Example of what to ask your AI

“How can I turn my AI code from a notebook into a repeatable training and evaluation system?”

Want more? Open the sections below.

How to use

The easiest way: copy the message below and paste it into Claude, ChatGPT, Cursor or any AI. It reads the skill and follows the instructions.

Skill link

https://github.com/affaan-m/ECC/blob/main/pi/core/skills/mle-workflow/SKILL.md

Ready-to-paste message

Use this skill to help me: https://github.com/affaan-m/ECC/blob/main/pi/core/skills/mle-workflow/SKILL.md Read the SKILL.md file at that link and follow its instructions for my task.
How it works

The tool guides you through steps to define how data and the model should behave (data contracts). It also helps set up tests to ensure the model performs well and plan how it will be deployed and monitored.

Installation

Easiest way: copy the skill link and paste it into Claude, ChatGPT or Cursor asking it to follow the instructions.

In the terminal (Claude Code, Codex, Cursor), in your project folder:

npx skills add affaan-m/ECC --skill mle-workflow

Or download just the file:

curl -L https://raw.githubusercontent.com/affaan-m/ECC/main/pi/core/skills/mle-workflow/SKILL.md -o SKILL.md
Technical content (original SKILL.md)

Original text by the author, straight from GitHub.

Machine Learning Engineering Workflow

Use this skill to turn model work into a production ML system with clear data contracts, repeatable training, measurable quality gates, deployable artifacts, and operational monitoring.

When to Activate

  • Planning or reviewing a production ML feature, model refresh, ranking system, recommender, classifier, embedding workflow, or forecasting pipeline
  • Converting notebook code into a reusable training, evaluation, batch inference, or online inference pipeline
  • Designing model promotion criteria, offline/online evals, experiment tracking, or rollback paths
  • Debugging failures caused by data drift, label leakage, stale features, artifact mismatch, or inconsistent training and serving logic
  • Adding model monitoring, canary rollout, shadow traffic, or post-deploy quality checks

Scope Calibration

Use only the lanes that fit the system in front of you. This skill is useful for ranking, search, recommendations, classifiers, forecasting, embeddings, LLM workflows, anomaly detection, and batch analytics, but it should not force one architecture onto all of them.

  • Do not assume every model has supervised labels, online serving, a feature store, PyTorch, GPUs, human review, A/B tests, or real-time feedback.
  • Do not add heavyweight MLOps machinery when a data contract, baseline, eval script, and rollback note would make the change reviewable.
  • Do make assumptions explicit when the project lacks labels, delayed outcomes, slice definitions, production traffic, or monitoring ownership.
  • Treat examples as interchangeable scaffolds. Replace metrics, serving mode, data stores, and rollout mechanics with the project-native equivalents.

Related Skills

  • python-patterns and python-testing for Python implementation and pytest coverage
  • pytorch-patterns for deep learning models, data loaders, device handling, and training loops
  • eval-harness and ai-regression-testing for promotion gates and agent-assisted regression checks
  • database-migrations, postgres-patterns, and clickhouse-io for data storage and analytics surfaces
  • deployment-patterns, docker-patterns, and security-review for serving, secrets, containers, and production hardening

Reuse the SWE Surface

Do not treat MLE as separate from software engineering. Most ECC SWE workflows apply directly to ML systems, often with stricter failure modes:

The recommended minimal --with capability:machine-learning install keeps the core agent surface available alongside this skill. For skill-only or agent-limited harnesses, pair skill:mle-workflow with agent:mle-reviewer where the target supports agents.

SWE surface MLE use
product-capability / architecture-decision-records Turn model work into explicit product contracts and record irreversible data, model, and rollout choices
repo-scan / codebase-onboarding / code-tour Find existing training, feature, serving, eval, and monitoring paths before introducing a parallel ML stack
plan / feature-dev Scope model changes as product capabilities with data, eval, serving, and rollback phases
tdd-workflow / python-testing Test feature transforms, split logic, metric calculations, artifact loading, and inference schemas before implementation
code-reviewer / mle-reviewer Review code quality plus ML-specific leakage, reproducibility, promotion, and monitoring risks
build-fix / pr-test-analyzer Diagnose broken CI, flaky evals, missing fixtures, and environment-specific model or dependency failures
quality-gate / test-coverage Require automated evidence for transforms, metrics, inference contracts, promotion gates, and rollback behavior
eval-harness / verification-loop Turn offline metrics, slice checks, latency budgets, and rollback drills into repeatable gates
ai-regression-testing Preserve every production bug as a regression: missing feature, stale label, bad artifact, schema drift, or serving mismatch
api-design / backend-patterns Design prediction APIs, batch jobs, idempotent retraining endpoints, and response envelopes
database-migrations / postgres-patterns / clickhouse-io Version labels, feature snapshots, prediction logs, experiment metrics, and drift analytics
deployment-patterns / docker-patterns Package reproducible training and serving images with health checks, resource limits, and rollback

…

FAQ

Do I need to know how to code to use this?

You don't need to be an experienced programmer. The tool is designed to guide you through the process, even if you don't know the technical programming details.

What are 'data contracts'?

Data contracts are like rules that ensure the data going into and out of your AI system is always in the expected format, preventing unexpected errors.

What does 'reproducible' mean?

Reproducible means you can repeat the training process of your AI model and get the exact same result, ensuring consistency and reliability.

Details

Original description by the author

Production machine-learning engineering workflow for data contracts, reproducible training, model evaluation, deployment, monitoring, and rollback. Use when building, reviewing, or hardening ML systems beyond one-off notebooks.

repo: affaan-m/ECC

Popularity

GitHub stars
280k
Ranking position
#84
License
MIT
Updated
10/15/2026

Is this skill useful?

0

Sign in to vote.

Comments

  • …

More skills from this repository

Similar skills