The Evaluation Loop: How AI Improves Its Own Output


⚖️ “With a leveraged worker, judgment is far more important than how much time they put in or how hard they work.” - Naval

Hello Reader,

AI is better at evaluating content than generating content.

This makes sense, when you stop to think about it. For a large language model to interpret your instructions, and create output, all in the same step, it dilutes the same token budget over two requests.

But if you have ask AI to evaluate its own outputs, it can focus all its attention on identifying how to improve. Then it can rewrite, separately.

Here’s a simple copy/paste process you can use to rapidly improve your LLM responses:

  1. Ask an LLM to create some content for you
  2. In a second tab, have another LLM evaluate the output.
  3. Ask the second LLM for a clear brief documenting improvements.
  4. Copy that brief, and paste it into the first LLM tab with the prefix, “Analyse this feedback.”
  5. Ask for a V2.
  6. Repeat until satisfied
  7. Compare with diffchecker.com if you want to see the changes

This simple process will help you stir your prompt around in a cauldron, like the wizard of the future that you are.

🎥 Replay: Create a Coaching Relationship with AI

video preview

If you missed my webinar last week, you can watch the replay, and use 30 copy/paste prompts to deepen your relationship with an AI thinking partner.

📰 New AI News This Week

  • Anthropic released Claude Sonnet 4.6 which gives Opus-like reasoning for a fraction of the cost
  • Google launched Gemini 3.1 Pro which has twice the reasoning capacity of Gemini 3
  • Digital Ocean reports the biggest blocker in implementing AI agents in enterprise is the cost of inference

👓 What I’m Reading

📢 Feedback Time!

Are you ready to grow your Ai capabilities?

Join me in the Ai Coaching Academy:

[REPLAY] Create a Coaching Relationship with AI

[REPLAY] Create a Coaching Relationship with AI

Last week's webinar provided 30 copy/paste prompts you can use to deepen your relationship to your LLM thinking partner. Slides https://ai-coaching-academy.s3-ap-southeast-2.amazonaws.com/slides/2026/aica-0226.pdf Copy/Paste Prompts Author In The Machine Speak in the voice of the author from this PDF. Ask me questions based on their ideas. You a...

Read Article

Keep on growing!

- Caelan Huntress

[email protected]

🎥

Upcoming Live Workshops

RSVP Now→

🎨

Play some of my AI Games

Start Learning →

📘

Join my Community

Upskill Now

You've subscribed to a newsletter, downloaded a lead magnet, or attended an event with Caelan Huntress.

You can unsubscribe, but you will miss out on funny memes in the future.

You can modify your preferences, to reduce frequency.

PO Box 8081, Riccarton, Christchurch 8440
·

Ai Coaching Newsletter

Weekly newsletter highlighting the latest Ai news, with 2-minute video tutorials and copy/paste prompts you can use to improve your skills as an Ai operator. Ai is changing all jobs this decade. You are either getting ready to change how you work, or getting ready to retire. As artificial intelligence moves from optional to operational, technical specialists no longer have the advantage. It is those who can supervise and coach Ai to improve that will thrive in an Ai-augmented future.

Read more from Ai Coaching Newsletter
Create a Coaching Relationship with AI

🌱 "A coach is just a placebo – it's a commitment to make yourself a better person." Barrett Brooks Hello Reader, Most people treat AI like a search engine. They ask simple questions and accept whatever it replies. But if you want truly great results, you need to stop being a consumer of AI and start being a coach to AI. In my next interactive workshop, you’ll learn how to train AI to think better, iterate on its responses, and refine its output—just like a great coach helps an athlete or...

👨🎓 “In times of change, learners inherit the earth, while the learned find themselves beautifully equipped to deal with a world that no longer exists.” - Eric Hoffer Hello Reader, Giving your team Copilot licenses will not magically create AI transformation. That mindset is treating AI as a technology problem, when it is actually an operator problem.Most leaders I meet don't have a clear idea about what AI could do for their organization, or how to embed change at this scale. So they give new...

🏆 “A good coach can change the game. A great coach can change your life!” - Anna Meares, 4 time Olympian Hello Reader, After 4 weeks of hosting AI Coaching Power Hours in my new community, the Ai Coaching Academy, we've uncovered some best practices: Provide specific feedback when responses aren’t satisfactory, guiding the AI to refine its output. Break down complex requests into smaller, more manageable steps. Use probing questions to help the AI dig deeper or explore alternative...