Redefining the quest for artificial intelligence: What should replace the Turing test?

Redefining the quest for artificial intelligence: What should replace the Turing test?

Credit: CC0 Public Domain

In a paper published in Intelligent Computing, Philip Nicholas Johnson-Laird of Princeton University and Marco Ragni of Chemnitz University of Technology propose a novel alternative to the Turing test, a milestone test developed by computing pioneer Alan Turing. The paper suggests that it is time to shift the focus from whether a machine can mimic human responses to a more fundamental question: “Does a program reason in the way that humans reason?”

The Turing test, which has long been a cornerstone of AI evaluation, involves a human evaluator attempting to distinguish between human and machine responses to a series of questions. If the evaluator cannot consistently differentiate between the two, the machine is considered to have “passed” the test. While it has been a valuable benchmark in the history of AI, it has certain limitations:

  • Mimicry vs. Understanding: Passing the Turing test often involves mimicking human responses, making it more a test of mimicry and language generation than genuine human-like reasoning. Many AI systems excel at mimicking human conversations but lack deep reasoning capabilities.
  • Lack of Self-Awareness: The Turing test does not require AI to be self-aware or have an understanding of its own reasoning. It focuses solely on external interactions and responses, neglecting the introspective aspect of human cognition.
  • Failure to Address Thinking: Alan Turing himself recognized that the test might not truly address the question of whether machines can think. The test is more about imitation than cognition.

Johnson-Laird and Ragni outline a new evaluation framework to determine whether AI truly reasons like a human. This framework comprises three critical steps:

1. Testing in Psychological Experiments:

The researchers propose subjecting AI programs to a battery of psychological experiments designed to differentiate between human-like reasoning and standard logical processes. These experiments explore various facets of reasoning, including how humans infer possibilities from compound assertions and how they condense consistent possibilities into one, among other nuances that deviate from standard logical frameworks.

2. Self-Reflection:

This step aims to gauge the program’s understanding of its own way of reasoning, a critical facet of human cognition. The program must be able to introspect on its reasoning processes and provide explanations for its decisions. By posing questions that require awareness of reasoning methods, the researchers seek to determine if the AI exhibits human-like introspection.

3. Examination of Source Code:

In the final step, the researchers delve deep into the program’s source code. The key here is to identify the presence of components known to simulate human performance. These components include systems for rapid inferences, thoughtful reasoning, and the ability to interpret terms based on context and general knowledge. If the program’s source code reflects these principles, the program is considered to reason in a human-like manner.

This innovative approach, replacing the Turing test with an examination of an AI program’s reasoning abilities, marks a paradigm shift in the evaluation of artificial intelligence. By treating AI as a participant in cognitive experiments and even submitting its code to analysis akin to a brain-imaging study, the authors seek to bring us closer to understanding whether AI systems genuinely reason in a human-like fashion.

As the world continues its pursuit of advanced artificial intelligence, this alternative approach promises to redefine the standards for AI evaluation and move us closer to the goal of understanding how machines reason. The road to artificial general intelligence may have just taken a significant step forward.

More information:
Philip N. Johnson-Laird et al, What Should Replace the Turing Test?, Intelligent Computing (2023). DOI: 10.34133/icomputing.0064

Provided by
Intelligent Computing

Redefining the quest for artificial intelligence: What should replace the Turing test? (2023, November 20)
retrieved 20 November 2023

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

Disasters Expo USA, is proud to be supported by Inergency for their next upcoming edition on March 6th & 7th 2024!

The leading event mitigating the world’s most costly disasters is returning to the Miami Beach

Convention Center and we want you to join us at the industry’s central platform for emergency management professionals.
Disasters Expo USA is proud to provide a central platform for the industry to connect and
engage with the industry’s leading professionals to better prepare, protect, prevent, respond
and recover from the disasters of today.
Hosting a dedicated platform for the convergence of disaster risk reduction, the keynote line up for Disasters Expo USA 2024 will provide an insight into successful case studies and
programs to accurately prepare for disasters. Featuring sessions from the likes of The Federal Emergency Management Agency,
NASA, The National Aeronautics and Space Administration, NOAA, The National Oceanic and Atmospheric Administration, TSA and several more this event is certainly providing you with the knowledge
required to prepare, respond and recover to disasters.
With over 50 hours worth of unmissable content, exciting new features such as their Disaster
Resilience Roundtable, Emergency Response Live, an Immersive Hurricane Simulation and
much more over just two days, you are guaranteed to gain an all-encompassing insight into
the industry to tackle the challenges of disasters.
By uniting global disaster risk management experts, well experienced emergency
responders and the leading innovators from the world, the event is the hub of the solutions
that provide attendees with tools that they can use to protect the communities and mitigate
the damage from disasters.
Tickets for the event are $119, but we have been given the promo code: HUGI100 that will
enable you to attend the event for FREE!

So don’t miss out and register today:

And in case you missed it, here is our ultimate road trip playlist is the perfect mix of podcasts, and hidden gems that will keep you energized for the entire journey


This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish. Accept Read More