mle-workflow
Enables your agent to manage the entire machine learning lifecycle in production, from data handling to monitoring and rollbacks.
What it does
This tool helps turn an artificial intelligence (AI) project into a robust and reliable system. It ensures the data used is consistent, the model training can be repeated, and the model's quality is checked before it's used.
When to use it
- ✓When planning a new AI system for production.
- ✓When converting AI code from an experiment into a system that can be used repeatedly.
- ✓When checking if an AI system is working correctly and can be rolled back if issues arise.
Example of what to ask your AI
“How can I turn my AI code from a notebook into a repeatable training and evaluation system?”
Want more? Open the sections below.
How to use
The easiest way: copy the message below and paste it into Claude, ChatGPT, Cursor or any AI. It reads the skill and follows the instructions.
Skill link
Ready-to-paste message
How it works
The tool guides you through steps to define how data and the model should behave (data contracts). It also helps set up tests to ensure the model performs well and plan how it will be deployed and monitored.
Installation
Easiest way: copy the skill link and paste it into Claude, ChatGPT or Cursor asking it to follow the instructions.
In the terminal (Claude Code, Codex, Cursor), in your project folder:
npx skills add affaan-m/ECC --skill mle-workflowOr download just the file:
curl -L https://raw.githubusercontent.com/affaan-m/ECC/main/pi/core/skills/mle-workflow/SKILL.md -o SKILL.mdTechnical content (original SKILL.md)
Original text by the author, straight from GitHub.
Machine Learning Engineering Workflow
Use this skill to turn model work into a production ML system with clear data contracts, repeatable training, measurable quality gates, deployable artifacts, and operational monitoring.
When to Activate
- Planning or reviewing a production ML feature, model refresh, ranking system, recommender, classifier, embedding workflow, or forecasting pipeline
- Converting notebook code into a reusable training, evaluation, batch inference, or online inference pipeline
- Designing model promotion criteria, offline/online evals, experiment tracking, or rollback paths
- Debugging failures caused by data drift, label leakage, stale features, artifact mismatch, or inconsistent training and serving logic
- Adding model monitoring, canary rollout, shadow traffic, or post-deploy quality checks
Scope Calibration
Use only the lanes that fit the system in front of you. This skill is useful for ranking, search, recommendations, classifiers, forecasting, embeddings, LLM workflows, anomaly detection, and batch analytics, but it should not force one architecture onto all of them.
- Do not assume every model has supervised labels, online serving, a feature store, PyTorch, GPUs, human review, A/B tests, or real-time feedback.
- Do not add heavyweight MLOps machinery when a data contract, baseline, eval script, and rollback note would make the change reviewable.
- Do make assumptions explicit when the project lacks labels, delayed outcomes, slice definitions, production traffic, or monitoring ownership.
- Treat examples as interchangeable scaffolds. Replace metrics, serving mode, data stores, and rollout mechanics with the project-native equivalents.
Related Skills
python-patternsandpython-testingfor Python implementation and pytest coveragepytorch-patternsfor deep learning models, data loaders, device handling, and training loopseval-harnessandai-regression-testingfor promotion gates and agent-assisted regression checksdatabase-migrations,postgres-patterns, andclickhouse-iofor data storage and analytics surfacesdeployment-patterns,docker-patterns, andsecurity-reviewfor serving, secrets, containers, and production hardening
Reuse the SWE Surface
Do not treat MLE as separate from software engineering. Most ECC SWE workflows apply directly to ML systems, often with stricter failure modes:
The recommended minimal --with capability:machine-learning install keeps the core agent surface available alongside this skill. For skill-only or agent-limited harnesses, pair skill:mle-workflow with agent:mle-reviewer where the target supports agents.
| SWE surface | MLE use |
|---|---|
product-capability / architecture-decision-records |
Turn model work into explicit product contracts and record irreversible data, model, and rollout choices |
repo-scan / codebase-onboarding / code-tour |
Find existing training, feature, serving, eval, and monitoring paths before introducing a parallel ML stack |
plan / feature-dev |
Scope model changes as product capabilities with data, eval, serving, and rollback phases |
tdd-workflow / python-testing |
Test feature transforms, split logic, metric calculations, artifact loading, and inference schemas before implementation |
code-reviewer / mle-reviewer |
Review code quality plus ML-specific leakage, reproducibility, promotion, and monitoring risks |
build-fix / pr-test-analyzer |
Diagnose broken CI, flaky evals, missing fixtures, and environment-specific model or dependency failures |
quality-gate / test-coverage |
Require automated evidence for transforms, metrics, inference contracts, promotion gates, and rollback behavior |
eval-harness / verification-loop |
Turn offline metrics, slice checks, latency budgets, and rollback drills into repeatable gates |
ai-regression-testing |
Preserve every production bug as a regression: missing feature, stale label, bad artifact, schema drift, or serving mismatch |
api-design / backend-patterns |
Design prediction APIs, batch jobs, idempotent retraining endpoints, and response envelopes |
database-migrations / postgres-patterns / clickhouse-io |
Version labels, feature snapshots, prediction logs, experiment metrics, and drift analytics |
deployment-patterns / docker-patterns |
Package reproducible training and serving images with health checks, resource limits, and rollback |
…
FAQ
Do I need to know how to code to use this?
You don't need to be an experienced programmer. The tool is designed to guide you through the process, even if you don't know the technical programming details.
What are 'data contracts'?
Data contracts are like rules that ensure the data going into and out of your AI system is always in the expected format, preventing unexpected errors.
What does 'reproducible' mean?
Reproducible means you can repeat the training process of your AI model and get the exact same result, ensuring consistency and reliability.
Details
Original description by the author
Production machine-learning engineering workflow for data contracts, reproducible training, model evaluation, deployment, monitoring, and rollback. Use when building, reviewing, or hardening ML systems beyond one-off notebooks.
repo: affaan-m/ECC
Popularity
- GitHub stars
- 280k
- Ranking position
- #84
- License
- MIT
- Updated
- 10/15/2026
Comments
- …
More skills from this repository
accessibility
Helps your agent create interfaces that everyone can use. Ensures websites and apps work well for people with disabilities, like those who are blind or have reduced mobility.
affaan-m/ECC
agent-architecture-audit
Makes your agent check if everything is working correctly. It finds and fixes problems in AI systems, ensuring they perform as expected.
affaan-m/ECC
agent-eval
Helps your agent compare different AI coding tools. It measures which one is faster, cheaper, and more reliable for specific tasks.
affaan-m/ECC
agent-harness-construction
Makes your agent better understand how to perform tasks. It optimizes the tools and instructions the agent uses to increase its chances of success.
affaan-m/ECC
Similar skills
mcp-builder
Helps your agent create servers that connect LLMs to external services. Essential for integrating APIs and services using Python or Node/TypeScript.
anthropics/skills
prepare-mcp-integration
Prepares vendor (MCP) integrations through research and human approval. It follows a guided process for new integrations.
paperclipai/paperclip
first-task
Guides the agent on the user's first task. It interprets the initial answer, clarifies the goal, and proposes a plan or single task for approval.
paperclipai/paperclip