Turn Repeated Fixes into Skills, Then into a Team Practice
A correction typed into every session should become something that runs without you. A skill for API tests with a small eval and five pillars, a one-page team policy measured against a baseline, and four levels to place yourself.
Key takeaways
- A fix you repeat should become a rule, a hook, a skill or an eval rather than a sentence you type again.
- Write a skill only when the task repeats, has a house method, and can be checked.
- Score each skill version on a small eval of real inputs; a change that lowers the score does not ship.
- AI amplifies a team's existing strengths and problems; in DORA's 2024 data more adoption went with a 7.2% drop in stability.
- Measure delivery and quality against a baseline, not usage or how fast people feel.
Contents
FAQ
Skill, rules file or slash command?
A rules file for facts needed on every task, a skill for a method for one kind of task, a slash command for a fixed prompt with arguments, and a hook for anything that must always happen.
What should a team AI policy cover first?
Approved tools on a business tier, data that never goes into prompts, who owns AI-written code, review rules, and limits on autonomous agents.
Do I need the API to get good at AI?
Not for levels one and two. Level three is for people building features or pipelines on top of a model.
Sources
Only you and the owner see your answer and rating. Send private feedback
Enjoyed it? Support fx-blog with a coffee.
Related posts
Your LLM Proxy Retries the Wrong Errors
What an LLM proxy has to decide on every failure: limits are per organization, which statuses to retry, why nothing is retried after the first streamed byte, and the headroom headers the API already sends.
Your LLM Demo Works. What Every Call Needs in Production
One timestamp in the system prompt and every call misses the cache. Pricing each call, making failures loud, logging per feature, and treating outside text as untrusted.
RAG That Works: Why Retrieval Matters More Than the Prompt
Most bad RAG answers are retrieval problems. How RAG works end to end, the three parts of the grounded prompt, how to measure retrieval alone, and when long context is enough.
Comments
Oldest firstNo comments yet. Start the conversation.
Part 5 ended on a correction you keep paying for: "reuse the fixtures, don't create a raw HTTP client", typed into every fresh session that writes the login API tests, by you and by your teammates. This part makes the repo learn it once, and the team with it.
By the tenth time, the problem isn't the agent. The fix lives in your head instead of in the repo, so every new session, and every teammate, starts without it.
AI Practices for Engineers, in 6 parts:
Where a repeated fix belongs
The fixture rule is a method for one kind of task, writing API tests, so it belongs in a skill. A skill loads only when the task calls for it, which keeps it out of the
AGENTS.mdyou trimmed in part 2.A skill, proven by an eval
Point it at
cases/api/auth/login-rate-limit.mdand step 3 is applied every time, by anyone. Thedescriptiondecides whether it loads at all, so write triggers, not a tagline.Prove it with five to ten real inputs, including a missing case file and a request that must not trigger it. Score each version as cases passed over total; a change that lowers the score doesn't ship. Then hold it to the five pillars I use for every agentic-fx project, each with a measure that can go red: intelligence, memory and learning, judgment and integrity, verification and safety, value and experience.
From you to the team
In 2024, Google's DORA research found that a 25% rise in AI adoption went with a 7.2% drop in delivery stability, alongside gains in documentation and review speed. Their 2025 summary: "AI doesn't fix a team; it amplifies what's already there."
So the skill only helps if the team shares it, and a teammate who pastes the login code into a personal account needs a written rule. Start with one page:
Where you go from here
The login rate limit went from a number the model invented to a spec, a fenced agent run, a test proven to fail, a skill and a team policy. The guide's four levels place you on that path:
Move up when the checkpoint feels easy. Level 3 is the API, which this series did not teach.
Try it
Read this with your AI