Marcus Weldon

By Marcus Weldon

Newsweek Contributing Editor for AI and President Emeritus of Bell Labs

0

Share

Newsweek is a Trust Project member

See more of our trusted coverage when you search.Prefer Newsweek on Googleto see more of our trusted coverage when you search.


With the publication of the first three interviews in the Newsweek AI Impact series, it is a good time to reflect and distill the essence of what we have learned to date. The remarkable thing for me is the level of coherence and alignment among the views of the first three interviewees, despite their different backgrounds and focus areas: roboticist Rodney Brooks; neuroscientist David Eagleman; and AI innovator Yann LeCun.

But, on further reflection, this is perhaps not surprising given the intelligence of the three individuals and their innate curiosity, the combination of which leads to positions that are both broad in scope and deep in conception. As a result, I think we can already see a common thesis that has emerged and can be summarized as follows.

1. Magical Thinking

Humans are repeatedly seduced into thinking that any sign of intelligence is equivalent to our own intelligence; we engage in "magical anthropomorphism" of everything that appears to exhibit any human capability, and we delude ourselves about the real capabilities.

Read More on Newsweek.AI

2. Beyond the IQ Test

Human intelligence cannot be quantified by a single test or score as it is a complex interplay of cognitive, creative, social, moral and physical capabilities and developed expertise. Any evaluation of machine intelligence against human intelligence can only be valid for a specific domain for which the full array of human capabilities is evaluated and compared.

Newsweek.AI Carousel TheStorySoFar

...

3. Think Fast But Also Slow

Nobel Prize-winning psychologist Daniel Kahneman's framework for understanding how the human brain operates comprises a System 1 mode that is fast, automatic and intuitive and a System 2 mode that is slower, more deliberate and analytical.

Current LLMs exhibit only System 1 capabilities without a complementary System 2, as they lack reliable, accurate models of the world. The future of AI requires new models with a hierarchy of abstract representations of the real world in all its richness and with System 2 reasoning capabilities.

4. Limits of Language

Written language is an insufficient basis for reliably representing the physical world and the human experience of it, as it is too highly compressed and insufficiently complete to describe this complex multidimensional, continuous reality. Therefore, the future of AI will not be about scaling, adapting or enhancing LLMs alone.

5. A Society of Machines

The future of AI will be different systems, each with their own domains or various levels of representation of the world interacting with each other. These machines will collaborate and compete to amplify human capabilities as machines have always done, as described by Moravec's Paradox: "It is comparatively easy to make computers exhibit adult level performance on intelligence tests or playing checkers, and difficult or impossible to give them the skills of a 1-year-old when it comes to perception and mobility."

6. A New Societal Hierarchy

The future human society will be a hierarchy of humans and intelligent machines, with machines constrained to be below humans in the hierarchy as they will not have human-like "free will" and will be bound by embedded guardrails.

7. The Overestimated Power of Intelligence

The power of intelligence alone is overestimated, and we should be much more wary of the tendency of humans to cede to physical or psychological dominance or be victims of physical world power such as natural disasters and disease.

8. An Open and Predictable Future

AI systems need to be predictable and consistent, not just with our understanding of the physical world but also with our different social, moral and cultural landscapes so that they amplify our subjective personal worlds on our own chosen terms.

I think these are probably as close to a defining set of principles for the evolution of AI, as Asimov's Laws of Robotics were for physical robot systems—already a notable accomplishment for the series. But before concluding, I want to return to the question of how to evaluate intelligence that has cropped up throughout these conversations so far, as highlighted in principle No. 2 above.

From these interviews, two ways of evaluating the intelligence of AI systems emerged. First, there was the framework proposed by Eagleman that tries to establish the level of intelligence demonstrated in any given domain by identifying whether a system is just curating information, creating knowledge or generating new conceptual or creative frameworks in different domains of expertise. Second, the Kahneman framework looks at the type of intelligence process that the AI uses to "think" about a problem. The two are complementary—one focusing on the "what" (was demonstrated) and the other focused more on the "how" (it was produced). But there is clearly more thinking to be done to create a general-purpose methodology for accurately judging the intelligence of any system in any domain, and to eliminate hyperbolic or "magical" conjecture.

Framework for evaluating the intelligence

...

So that's where things stand at this point in the series; it will be fascinating to see how this evolves as we extend the scope of inquiry to include different disciplines and domains, looking across specific industries at the forefront of AI focus such as healthcare and medicine, as well as in the creative arts and industries.

View 0 Comments

Request Reprint & Licensing

Submit Correction

View Editorial & AI Guidelines