profile

Ai Coaching Newsletter

The Evaluation Loop: How AI Improves Its Own Output

Published about 1 month ago • 2 min read

⚖️ “With a leveraged worker, judgment is far more important than how much time they put in or how hard they work.” - Naval

Hello Reader,

AI is better at evaluating content than generating content.​
​
This makes sense, when you stop to think about it. For a large language model to interpret your instructions, and create output, all in the same step, it dilutes the same token budget over two requests.
​
But if you have ask AI to evaluate its own outputs, it can focus all its attention on identifying how to improve. Then it can rewrite, separately.
​
Here’s a simple copy/paste process you can use to rapidly improve your LLM responses:

  1. Ask an LLM to create some content for you
  2. In a second tab, have another LLM evaluate the output.
  3. Ask the second LLM for a clear brief documenting improvements.
  4. Copy that brief, and paste it into the first LLM tab with the prefix, “Analyse this feedback.”
  5. Ask for a V2.
  6. Repeat until satisfied
  7. Compare with diffchecker.com if you want to see the changes

This simple process will help you stir your prompt around in a cauldron, like the wizard of the future that you are.

🎥 Replay: Create a Coaching Relationship with AI

video preview​

If you missed my webinar last week, you can watch the replay, and use 30 copy/paste prompts to deepen your relationship with an AI thinking partner.

📰 New AI News This Week

  • Anthropic released Claude Sonnet 4.6 which gives Opus-like reasoning for a fraction of the cost
  • Google launched Gemini 3.1 Pro which has twice the reasoning capacity of Gemini 3
  • Digital Ocean reports the biggest blocker in implementing AI agents in enterprise is the cost of inference

👓 What I’m Reading

📢 Feedback Time!

Are you ready to grow your Ai capabilities?

Join me in the Ai Coaching Academy:

[REPLAY] Create a Coaching Relationship with AI

[REPLAY] Create a Coaching Relationship with AI

Last week's webinar provided 30 copy/paste prompts you can use to deepen your relationship to your LLM thinking partner. Slides https://ai-coaching-academy.s3-ap-southeast-2.amazonaws.com/slides/2026/aica-0226.pdf Copy/Paste Prompts Author In The Machine Speak in the voice of the author from this PDF. Ask me questions based on their ideas. You a...

Read Article

Keep on growing!

- Caelan Huntress

​[email protected]​

🎥

Upcoming Live Workshops

​RSVP Now→​

🎨

Play some of my AI Games

​Start Learning →​

📘

Join my Community

​Upskill Now​ →​

You've subscribed to a newsletter, downloaded a lead magnet, or attended an event with Caelan Huntress.

You can unsubscribe, but you will miss out on funny memes in the future.

You can modify your preferences, to reduce frequency.

PO Box 8081, Riccarton, Christchurch 8440
·

Ai Coaching Newsletter

by Caelan Huntress

Weekly newsletter highlighting the latest Ai news, with 2-minute video tutorials and copy/paste prompts you can use to improve your skills as an Ai operator. Ai is changing all jobs this decade. You are either getting ready to change how you work, or getting ready to retire. As artificial intelligence moves from optional to operational, technical specialists no longer have the advantage. It is those who can supervise and coach Ai to improve that will thrive in an Ai-augmented future.

Read more from Ai Coaching Newsletter

🧐 “The best way to drive AI adoption is by marrying domain knowledge with foundational AI training. Generalist skills, creativity, and technical integration are more critical than deep specialization in today’s AI-driven world.” Bhavesh Dayalji Hello Reader, I’ve been writing content on the Internet for a long time, and I must confess - I’m vain about what I publish. I have always produced a large volume of content. I was a marketing automation expert for a decade, so I can make a lot. I like...

6 days ago • 3 min read

⚖️ “Use AI for the work that drains you, not the work that defines you.” Hello Reader, Last week I was invited by Rita Cincotta onto the Deliberate Leader Podcast. If you don't know Rita, she is a is a leadership coach and who helps leaders grow through strengths-based practice, reflection, and deliberate action. She's also a trusted colleague and an old friend. We were able to quickly get into deep conversation about the overlap of our two worlds. Here are 5 takeaways we uncovered during our...

13 days ago • 4 min read

🃏 “The goal of the future is full unemployment, so we can play.” - Arthur C. Clarke Hello Reader, One of my core values is that learning should be fun. That’s why I use games to teach in my AI training workshops — so we can get more done in good cheer. Most people approach learning like it’s medicine. They expect serious work to feel heavy, and to wait for fun until after work is finished. But our near future won't reward endurance, it will reward curiosity. Throughout history, technology has...

20 days ago • 3 min read