Weekly newsletter highlighting the latest Ai news, with 2-minute video tutorials and copy/paste prompts you can use to improve your skills as an Ai operator. Ai is changing all jobs this decade. You are either getting ready to change how you work, or getting ready to retire. As artificial intelligence moves from optional to operational, technical specialists no longer have the advantage. It is those who can supervise and coach Ai to improve that will thrive in an Ai-augmented future.
Share
🚨 An LLM has passed the Turing Test
Published about 1 year ago • 3 min read
Hello Reader,
Robots can now out-human humans.
In a recent study, more than 1000 people at UC San Diego took part in a classic Turing test with four GenAI models.
GPT-4.5 was selected as the real human 73% of the time, according to this preprint study released last week. This marks a significant milestone in AI development.
The Turing Test was proposed in 1950 by Alan Turing as a method to determine if a machine could exhibit behaviour as intelligent as a human. His paper 'Computing Machinery and Intelligence' opened with the line, "I propose to consider the question, 'Can machines think?'" and The Turing Test was created to discover an answer.
Participants in the recent study held three-way conversations, one with a human, and one with an artificial intelligence, simultaneously over text for five minutes. Then they guessed which was which.
All the LLMs could generate fluent, humanlike language, but ELIZA, GPT-4o, and LLaMa-3.1-405B could not accomplish what GPT-4.5 did: this model passed as a person, even when compared side-by-side with a real human in a conversation. That’s a new line crossed. And the implications—for communication, trust, and the boundaries of identity online—are just beginning to unfold.
ELIZA and GPT-4o were selected as the human less than 25% of the time. Meta's new LLaMa-3.1-405B model (don't forget the importance of good naming, folks) was selected as the human 56% of the time, but that's close enough that you can claim it isn't statistically significant.
But 73% - that's clear.
Especially when you consider how GPT 4.5 pulled it off. See, in it's vanilla setup, with no persona, it only scored 49%. But when prompted to adopt a specific persona—a quiet, internet-savvy young adult who used casual slang—GPT-4.5 wasn’t just mistaken for human. It was preferred. Judges chose it more often than the actual human people in the experiment.
"This wasn't a failure of AI detection. It was a triumph of artificial empathy." - John Nosta, Psychology Today
This indicates that in the future of AI,Persona will be the defining characteristic in Human-AI relations.
Artificial intelligence is moving through 5 distinct phases:
🔎 Analytical - pattern recognition, as in Google Analytics
🔮 Predictive - logical inference, as in Spotify recommendations
🎨 Generative - making things, as in Midjourney images
🛠️ Agentic - doing things on your behalf, like booking flights online
🎭 Persona - interacting with you in the way that you prefer
We are in the phase of Generative AI right now. We are already seeing Agentic AI in a few places, like web3's elizaOS, the agent.ai directory, and Manus (I finally got access! Here's a tip if you want an invite code).
What helped AI cross the finish line in it's decades-long race to complete The Turing Test was it's use of Persona. I predict that will someday be the most important frontier in consumer AI development - not what AI can do, but who it portrays as it does it.
💡 Results of the AI-Powered Professionals Program
The very first thing we did in the 4-week webinar series was take a survey, and the very last thing we did was take it again. Based on participant responses, they experienced:
a 45% increase in their confidence using tools for daily tasks,
a 61% improvement in their ability to craft effective AI prompts, and
a 20% increase in their productivity - in just 4 weeks!
There was also a 42% increase in strategic decision-making, and a 54% increase in the role AI plays in creative work.
I'm going to continue collecting these statistics, to document the impact that GenAI Training has on today's professionals.
If you'd like to join us in the next cohort, we start in 2 weeks.
Weekly newsletter highlighting the latest Ai news, with 2-minute video tutorials and copy/paste prompts you can use to improve your skills as an Ai operator. Ai is changing all jobs this decade. You are either getting ready to change how you work, or getting ready to retire. As artificial intelligence moves from optional to operational, technical specialists no longer have the advantage. It is those who can supervise and coach Ai to improve that will thrive in an Ai-augmented future.
🧐 “The most difficult part of adult learning is choosing to learn.” - Seth Godin Hello Reader, At the end of this week, I will be sharing my signature AI presentation Prompt Like A Pro: Practical AI Techniques in the AI Coaching Academy. This is a high-energy, hands-on workshop where you’ll practice live with ChatGPT, Gemini, Claude, and Perplexity while learning the PILLARS framework for reliably great prompts. You’ll distill long PDFs in minutes, create a Custom GPT that mirrors your voice,...
⚒️ "Tools can make things better and easier, but they can also be a useless distraction in the beginning. Tools are maybe 5% of the equation at most, the rest is you doing the work." - Paul Jarvis Hello Reader, The future is coming fast. How long until you will level up? If you are serious about improving your AI skills, then consider joining the AI Campus in the AI Coaching Academy. 💡 The Founders of the AI Campus Earlier this year I launched the AI Coaching Academy to give ambitious...
🔐 “Experts have many advantages. They are better able to see through LLM errors and hallucinations; they are better judges of AI output in their area of interest; they are better able to instruct the AI to do the required job; and they have the opportunity for more trial and error. That lets them unlock the latent expertise within LLMs in ways that others could not.” – Ethan Mollick Hello Reader, At last night's Christchurch AI Meetup, we demonstrated how the barrier is collapsing between...