Premium

How does it feel to win a Nobel Prize? Ask the ‘Godfather of AI.’

In 2019, Hinton was part of a three-person group that received the Turing Award, often called “the Nobel Prize of computing,” for its work on neural networks.

Geoffrey Hinton, a professor of computer science at the University of Toronto, at his home in Toronto, Ontario, Canada on April 24, 2023. Hinton and John Hopfield were awarded the Nobel Prize in Physics on Tuesday, Oct. 8, 2024, for discoveries that helped computers learn more in the way the human brain does, providing the building blocks for developments in artificial intelligence. (Chloe Ellingson/The New York Times)Geoffrey Hinton, a professor of computer science at the University of Toronto, at his home in Toronto, Ontario, Canada on April 24, 2023. Hinton and John Hopfield were awarded the Nobel Prize in Physics on Tuesday, Oct. 8, 2024, for discoveries that helped computers learn more in the way the human brain does, providing the building blocks for developments in artificial intelligence. (Chloe Ellingson/The New York Times)

Written by Cade Metz

On Tuesday, scientists John J. Hopfield and Geoffrey E. Hinton received the Nobel Prize in physics for discoveries that helped drive the development of artificial neural networks — a technology that is now essential to the operation of search engines like Google and online chatbots like ChatGPT from OpenAI.

The prize was given for a technology that Hopfield developed in the early 1980s called a Hopfield network and a related technique that Hinton helped create in the years that followed called a Boltzmann machine. The news surprised many physicists and artificial intelligence experts, including Hopfield and Hinton.

Story continues below this ad

In 2019, Hinton was part of a three-person group that received the Turing Award, often called “the Nobel Prize of computing,” for its work on neural networks. Last year, he made headlines across the world when he left his job as a researcher at Google and warned that the AI technologies he helped create could one day destroy humanity.

But he is not a physicist.

He was once introduced at an academic conference as someone who had “failed at physics, dropped out of psychology and then joined a field with no standards at all: artificial intelligence.” Hinton, a British native known for his dry, self-deprecating humor, enjoyed repeating this story. But he always added a caveat.

“I didn’t fail at physics and drop out of psychology,” he would say. “I failed at psychology and dropped out of physics — which is far more reputable.”

The New York Times reached Hinton by phone shortly after he learned that he had won the Nobel Prize in physics.

This interview has been edited and condensed for clarity.

Q: Many congratulations.

Story continues below this ad

A: Sorry, I can’t talk. I am about to go on with the BBC. Bye.

Q: Hello, again. How was the BBC?

A: We didn’t connect. I am in a cheap hotel room with no internet.

Q: What was your reaction when you heard this morning’s news?

A: I was shocked and amazed and flabbergasted. I never expected it.

Story continues below this ad

Q: Neural networks are computer technologies. How does this relate to physics?

A: Hopfield networks and a further development of them called Boltzmann machines were based on physics. Hopfield nets used an energy function, and the Boltzmann machine used ideas from statistical physics. So that stage in the development of neural networks did depend — a lot — on ideas from physics.

But it was really a different technique — called backpropagation — that was used to build the AI models that are used today. That has less to do with physics.

Q: What is the relationship between the Boltzmann machine and backpropagation?

Story continues below this ad

A: Right now, there isn’t much connection. They were two alternative theories for how we would get neural networks to run.

In the early days, I managed to combine them by using Boltzmann machines to “pretrain” backpropagation networks. But people aren’t doing that anymore.

Q: What you mean by pretrain?

A: How long do you have?

Q: Can you explain in language that the readers of The New York Times would understand?

A: I am reminded of what physicist Richard Feynman said when he received the Nobel Prize.

Story continues below this ad

A journalist asked him, “Professor Feynman, can you explain — in just a couple of minutes — what you won the Nobel Prize for?” Feynman apparently replied, “Listen, buddy, if I could explain it in a couple of minutes, it wouldn’t be worth the Nobel Prize.”

Sorry. The BBC is calling again. Bye.

Q: Hello, again. It is safe to say the Boltzmann machine was a dead end for AI — that the research went elsewhere?

A: I think of that idea as something like an enzyme. An enzyme gets you over a barrier — even if it isn’t part of the final solution.

Boltzmann machines were like an enzyme. It got us over the barrier of “How do you train deep neural networks?” It made it easier to train them. And once we had learned how to do that, we didn’t need the Boltzmann machine anymore.

Story continues below this ad

Q: Did you work directly with John Hopfield on any of these ideas?

A: No. I read his papers. But one of my main collaborators, Terry Sejnowski, worked with Hopfield and did his Ph.D. with Hopfield.

Q: Is it odd that you have received this award for physics?

A: If there was a Nobel Prize for computer science, our work would clearly be more appropriate for that. But there isn’t one.

Q: That is a great way of putting it.

A: It is also a hint.

Story continues below this ad

Q: Yes, perhaps we need a Nobel for computer science. In any case, you have won a Nobel for helping to create a technology that you now worry will cause serious danger for humanity. How do you feel about that?

A: Having the Nobel Prize could mean that people will take me more seriously.

Q: Take you more seriously when you warn of future dangers?

A: Yes.

This article originally appeared in The New York Times.

Latest Comment
Post Comment
Read Comments
Advertisement
Loading Taboola...
Advertisement