Learning Objectives
- Test your automation across real scenarios
- Refine your skill based on what testing reveals
- Calculate and document your ROI with real, measured numbers
🎯 What You'll Learn: How to validate your automation with real numbers
⏱️ Time Required: 50 minutes
📦 What You'll Build: Tested skill + documented ROI proof
Riley's Week 1 Finale
Riley has built everything:
One thing remains: proof.
💬 "My boss asked 'Is this AI thing actually saving you time?' I had a feeling it was. But feelings don't go in performance reviews. Numbers do. This lesson gave me the numbers."
— Riley Harper
What We're Building in This Lesson
Estimated time savings are guesses. Measured time savings are proof.
In this lesson:
The Three Parts of Validation
| Part | What You Do | Why It Matters |
|---|---|---|
| 🧪 Test | Try multiple scenarios | Ensures reliability |
| 🔧 Refine | Fix what you find | Improves quality |
| 📊 Measure | Calculate real ROI | Proves value |
The ROI Formula
┌─────────────────────────────────────────────────────────┐
│ ROI CALCULATION │
├─────────────────────────────────────────────────────────┤
│ │
│ TIME SAVED = Old Time - New Time │
│ │
│ ANNUAL SAVINGS = Time Saved × Frequency × 52 │
│ │
│ VALUE (£) = Annual Savings × Hourly Rate │
│ │
│ INVESTMENT = Build Time + Test Time │
│ │
│ ROI % = (Value - Investment) / Investment × 100 │
│ │
└─────────────────────────────────────────────────────────┘
Riley's Preview:
Exercise: Validate Your Automation
⏱️ Total Time: 40 minutes
What You'll Build
📊 Documented proof that your automation works and delivers measurable value.
Before You Start
You'll need:
☐Your working skill from Lesson 1.2
☐A timer (phone works great)
☐Your Quick Win documentation from Lesson 1.1
☐Something to record notes
Step 1: Time the OLD Way
⏱️ Time: 15-20 minutes (depends on your task)
Do your task the OLD way, WITHOUT your skill.
Yes, really. We need a real baseline.
Instructions:
╔════════════════════════════════════════╗
║ OLD WAY MEASUREMENT ║
╠════════════════════════════════════════╣
║ ║
║ Task: _____________________________ ║
║ ║
║ Date: _____________________________ ║
║ ║
║ Start time: _______________________ ║
║ ║
║ End time: _________________________ ║
║ ║
║ TOTAL TIME: _______ minutes ║
║ ║
║ Notes: ║
║ - What took longest? _____________ ║
║ - What was tedious? ______________ ║
║ ║
╚════════════════════════════════════════╝
Riley's measurement:
💬 "I timed myself doing the margin report the old way. A full 4 hours, on the dot. Right about what I'd estimated, but now I had it measured, not guessed. That's the power of measuring."
✅ Success Check:
☐Completed task the old way
☐Recorded actual time (not estimated)
Step 2: Time with YOUR SKILL
⏱️ Time: 5-15 minutes
Now do the same task using your skill.
Instructions:
/clear╔════════════════════════════════════════╗
║ SKILL WAY MEASUREMENT ║
╠════════════════════════════════════════╣
║ ║
║ Task: _____________________________ ║
║ ║
║ Date: _____________________________ ║
║ ║
║ Start time: _______________________ ║
║ ║
║ End time: _________________________ ║
║ ║
║ TOTAL TIME: _______ minutes ║
║ ║
║ Issues noticed: ║
║ □ Output format needed adjustment ║
║ □ Missing prompts for some info ║
║ □ Had to do manual steps after ║
║ □ Other: ______________________ ║
║ ║
║ Quality check: ║
║ □ Output is correct ║
║ □ Output is complete ║
║ □ Ready to use as-is ║
║ ║
╚════════════════════════════════════════╝
Riley's measurement:
💬 "With the skill: 18 minutes. And I noticed the output quality was actually MORE consistent than my manual version. The skill doesn't forget steps."
✅ Success Check:
☐Completed task using skill
☐Recorded actual time
☐Noted any issues for refinement
Step 3: Refine Your Skill
⏱️ Time: 10 minutes
Based on issues found, make improvements.
Common refinements:
| Issue | Refinement |
|---|---|
| Missing information | Add prompt for that data |
| Wrong format | Update the example output |
| Extra manual steps | Add instructions for those steps |
| Inconsistent output | Make instructions more specific |
Open your SKILL.md and improve at least ONE thing.
Riley's refinement:
💬 "I noticed the skill wasn't asking for the portfolio manager names to include in the distribution list. Added one line to Step 4, tested again, perfect."
Document your changes:
## Refinements Made (Lesson 1.5)
Change 1: ________________________________
Why: ____________________________________
Change 2: ________________________________
Why: ____________________________________
✅ Success Check:
☐At least one improvement made
☐Tested refined skill
☐Quality is now acceptable
Step 4: Calculate Your ACTUAL ROI
⏱️ Time: 5 minutes
Fill in with REAL numbers:
╔══════════════════════════════════════════════════════════════╗
║ YOUR ROI CALCULATION ║
╠══════════════════════════════════════════════════════════════╣
║ ║
║ TIME MEASUREMENTS ║
║ ──────────────── ║
║ Old way time: _______ minutes ║
║ Skill time: _______ minutes ║
║ Time saved per use: _______ minutes ║
║ ║
╠══════════════════════════════════════════════════════════════╣
║ ║
║ ANNUAL PROJECTION ║
║ ───────────────── ║
║ Frequency: _______ times per week/month ║
║ Weeks/months per yr: _______ (usually 52 or 12) ║
║ Annual time saved: _______ hours ║
║ ║
╠══════════════════════════════════════════════════════════════╣
║ ║
║ VALUE ║
║ ───── ║
║ Your effective hourly rate: £_______ (salary ÷ 2000) ║
║ Annual value: £_______ ║
║ ║
╠══════════════════════════════════════════════════════════════╣
║ ║
║ INVESTMENT ║
║ ────────── ║
║ Week 1 learning time: ~4 hours ║
║ Building skill: _______ hours ║
║ Testing & refining: _______ hours ║
║ Total investment: _______ hours = £_______ ║
║ ║
╠══════════════════════════════════════════════════════════════╣
║ ║
║ ROI CALCULATION ║
║ ─────────────── ║
║ Annual value: £_______ ║
║ Investment: £_______ ║
║ Net value: £_______ (value - investment) ║
║ ║
║ ★ ROI: _______% ★ ║
║ ║
║ Payback period: _______ weeks ║
║ ║
╚══════════════════════════════════════════════════════════════╝
Riley's Final ROI:
╔══════════════════════════════════════════════════════════════╗
║ Riley'S ROI CALCULATION ║
╠══════════════════════════════════════════════════════════════╣
║ ║
║ TIME MEASUREMENTS ║
║ Old way: 240 minutes (4h 0m) ║
║ Skill way: 18 minutes ║
║ Time saved: 222 minutes per week (3h 42m) ║
║ ║
║ ANNUAL PROJECTION ║
║ Frequency: Weekly (50 working weeks/year) ║
║ Annual time saved: 185 hours ║
║ ║
║ VALUE ║
║ Effective hourly rate: £75 ║
║ Annual value: £13,875 ║
║ ║
║ INVESTMENT ║
║ Week 1 learning: 4 hours ║
║ Building skill: 1.5 hours ║
║ Testing & refining: 0.5 hours ║
║ Total: 6 hours = £450 ║
║ ║
║ ★ ROI: 2,983% ★ ║
║ ║
║ Payback: 1.7 weeks ║
║ ║
╚══════════════════════════════════════════════════════════════╝
💬 "Almost 3,000% ROI. I had to double-check my math. But it's real. Six hours invested, £13,800+ returned annually. And that's just ONE automation."
✅ Success Check:
☐All numbers are REAL (measured, not estimated)
☐ROI calculated
☐Payback period identified
Step 5: Share Your Results
⏱️ Time: 5 minutes
Post in #week1-complete:
🎉 WEEK 1 COMPLETE!
My Quick Win: [Your automation]
📊 The Numbers:
• Old way: [X] minutes
• New way: [Y] minutes
• Time saved/week: [Z] minutes
• Annual value: £[amount]
• ROI: [percentage]%
💡 Best part: [What excited you most]
🔧 Refined: [What you improved]
🚀 Next automation idea: [What you want to build next]
Riley's post:
"🎉 WEEK 1 COMPLETE!
My Quick Win: Weekly margin report automation
📊 The Numbers:
• Old way: 240 minutes
• New way: 18 minutes
• Time saved/week: 222 minutes
• Annual value: £13,875
• ROI: 2,983%
💡 Best part: Monday mornings are no longer dreaded
🔧 Refined: Added portfolio manager name prompts
🚀 Next: Client meeting prep briefs"
✅ Success Check:
☐Posted in Slack
☐Included your real numbers
Week 1 Complete Checklist
Before moving to Week 2, verify everything:
Lesson 1.1: Find Your Quick Win
☐Quick Win identified and documented
☐ROI estimate calculated
Lesson 1.2: Create Your First Skill
☐SKILL.md file created
☐Skill triggers correctly
☐Output matches expectations
Lesson 1.3: Commands and Planning
☐Can use /clear, /skills, /memory
☐Used plan mode at least once
Lesson 1.4: Settings and Configuration
☐settings.json configured
☐Auto-approvals working
☐Dangerous commands blocked
Lesson 1.5: Test, Refine, Calculate ROI
☐Measured actual time savings
☐Made at least one refinement
☐Calculated real ROI
☐Shared results in Slack
All boxes checked? 🎉 You're ready for Week 2!
You Completed Week 1!
What you accomplished:
| Started With | Ended With |
|---|---|
| "What should I automate?" | Clear Quick Win with ROI |
| "How do I build a skill?" | Working automation |
| "What are all these commands?" | Efficient workflow |
| "Are the settings right?" | Customized environment |
| "Does this actually save time?" | Measured proof |
Riley's Week 1 Summary:
💬 "I came in skeptical. 'AI coding for non-coders' sounded too good to be true. Five lessons later, I have a working automation saving me 3 hours 42 minutes every week, with math to prove it. The best part? I'm already thinking about what to automate next."
Week 1 Results
| Person | Automation | Time saved | ROI |
|---|---|---|---|
| Riley (Financial Services) | Weekly margin report | 222 min/week | 2,983% |
| Healthcare IT Director | Daily patient census | 33 min/day | 1,823% |
| Management Consultant | Client status updates | 145 min/week | 3,450% |
Average Week 1 ROI: 2,752%
Not hype. Math.
💡 These figures are illustrative examples calculated using the ROI formula above. Your actual numbers will depend on your task, frequency, and hourly rate, use the formula to calculate yours. The methodology is the same; the inputs are yours.