The Evaluation Loop: How AI Improves Its Own Output


⚖️ “With a leveraged worker, judgment is far more important than how much time they put in or how hard they work.” - Naval

Hello Reader,

AI is better at evaluating content than generating content.

This makes sense, when you stop to think about it. For a large language model to interpret your instructions, and create output, all in the same step, it dilutes the same token budget over two requests.

But if you have ask AI to evaluate its own outputs, it can focus all its attention on identifying how to improve. Then it can rewrite, separately.

Here’s a simple copy/paste process you can use to rapidly improve your LLM responses:

  1. Ask an LLM to create some content for you
  2. In a second tab, have another LLM evaluate the output.
  3. Ask the second LLM for a clear brief documenting improvements.
  4. Copy that brief, and paste it into the first LLM tab with the prefix, “Analyse this feedback.”
  5. Ask for a V2.
  6. Repeat until satisfied
  7. Compare with diffchecker.com if you want to see the changes

This simple process will help you stir your prompt around in a cauldron, like the wizard of the future that you are.

🎥 Replay: Create a Coaching Relationship with AI

video preview

If you missed my webinar last week, you can watch the replay, and use 30 copy/paste prompts to deepen your relationship with an AI thinking partner.

📰 New AI News This Week

  • Anthropic released Claude Sonnet 4.6 which gives Opus-like reasoning for a fraction of the cost
  • Google launched Gemini 3.1 Pro which has twice the reasoning capacity of Gemini 3
  • Digital Ocean reports the biggest blocker in implementing AI agents in enterprise is the cost of inference

👓 What I’m Reading

📢 Feedback Time!

Are you ready to grow your Ai capabilities?

Join me in the Ai Coaching Academy:

[REPLAY] Create a Coaching Relationship with AI

[REPLAY] Create a Coaching Relationship with AI

Last week's webinar provided 30 copy/paste prompts you can use to deepen your relationship to your LLM thinking partner. Slides https://ai-coaching-academy.s3-ap-southeast-2.amazonaws.com/slides/2026/aica-0226.pdf Copy/Paste Prompts Author In The Machine Speak in the voice of the author from this PDF. Ask me questions based on their ideas. You a...

Read Article

Keep on growing!

- Caelan Huntress

[email protected]

🎥

Upcoming Live Workshops

RSVP Now→

🎨

Play some of my AI Games

Start Learning →

📘

Join my Community

Upskill Now

You've subscribed to a newsletter, downloaded a lead magnet, or attended an event with Caelan Huntress.

You can unsubscribe, but you will miss out on funny memes in the future.

You can modify your preferences, to reduce frequency.

PO Box 8081, Riccarton, Christchurch 8440
·

Ai Coaching Newsletter

Weekly newsletter highlighting the latest Ai news, with 2-minute video tutorials and copy/paste prompts you can use to improve your skills as an Ai operator. Ai is changing all jobs this decade. You are either getting ready to change how you work, or getting ready to retire. As artificial intelligence moves from optional to operational, technical specialists no longer have the advantage. It is those who can supervise and coach Ai to improve that will thrive in an Ai-augmented future.

Read more from Ai Coaching Newsletter
pointing ahead

🤖 “By the end of this decade, there will be machines that can carry out most human professions at least as well as a typical human.” – Ray Kurzweil Hello Reader, There's a point on every skill curve where dabbling doesn't work. You've watched the demos. Read the articles. Tried a few prompts that sort-of worked. Maybe you've even paid for a subscription that you forget to use. And somewhere in the back of your mind, a quiet voice is asking: am I actually getting better at this, or am I just...

“cynthia mahoneyWeekly coaching sessions with Caelan have been a gamechanger for me. I am following through on my commitments, and I feel I have real momentum. I leave each session feeling motivated, more confident, and with new tools and ideas to be more

“I use AI every day now, and I hardly did before taking this training programme. Caelan’s positivity and enthusiasm is really engaging. His workshops are full of facts and anecdotes, and a lot of fun.” - Silena Kirkconnell-Kawana Hello Reader, If AI is becoming more important in your work, but you still don’t have a real system for getting better at it, this is your opportunity to excel. For the rest of April, you can join the AI Campus Founders Plan for $500/year and keep that rate for life....

🗂️ "When L&D professionals consciously decide where to engage AI and where to stay human, work becomes lighter rather than heavier. Use AI to help you craft, collect and publish - but sort and polish on your own." Hello Reader, In my recent article for the Australian Institute of Training & Development, I used my 5-Step Creative Process to help Learning & Development practitioners redesign learning workflows around human judgment. If you've never seen my 5-Step Creative Process before, it...