AI's Latest and Greatest

When A.I. Matures, It May Call Jürgen Schmidhuber ‘Dad’


But mention the name Jürgen Schmidhuber in an automated quinoa lunch spot frequented by coders in San Francisco, and you are likely to get blank stares.

On a recent train ride to Zurich, Dr. Schmidhuber, an athletic 53-year-old who is co-director of the Dalle Molle Institute for Artificial Intelligence Research here, reflected on how he believed his early research was often overlooked or ignored. “It’s like much of the rest of society,” he said. “Sometimes it’s postfactual.”

Dr. Schmidhuber’s complaints are well known within the fraternity of researchers who have turned what until a half-decade ago was an academic backwater into a multibillion-dollar industry. He has been accused of taking credit for other people’s research and even using multiple aliases on Wikipedia to make it look as if people are agreeing with his posts.

“Jürgen is manically obsessed with recognition and keeps claiming credit he doesn’t deserve for many, many things,” Dr. LeCun said in an email. “It causes him to systematically stand up at the end of every talk and claim credit for what was just presented, generally not in a justified manner.”

Dr. Schmidhuber counters that criticism with a bigger point: He is not the only one who is not getting due credit among A.I. researchers. In fact, he says work going all the way back to the 1960s is regularly ignored by today’s research luminaries.

Although he insists he doesn’t harbor ill will toward those better-known researchers, it grates on him that history hasn’t been kinder. “Certain researchers in my field have acted as if they invented something, although it was invented by other people whom they did not even mention,” Dr. Schmidhuber said.

But understanding the disconnect between his early work and his lack of celebrity isn’t easy — and cannot be entirely explained by the fact that he lives thousands of miles from the tech industry’s center of gravity.

The dispute is about the roots of neural networks, which allow machines to learn by recognizing patterns that can then be applied generally. Applications include recognizing speech and language, visually identifying objects, navigating in self-driving cars and making robot hands grasp more deftly. As a scientific field, it dates to the 1940s. But only in recent years have researchers in this area made striking progress.

Neural networks are actually software. For a visual analogy, think of them as a giant Tinkertoy set — vast arrays of interconnected nodes that can be trained to do everything from language translation to recognizing visual objects or human speech.

For decades, neural networks were laboratory curiosities, often met with skepticism. But in the 1990s, with faster and cheaper computers as well as new ideas about how to design neural nets, there was finally progress.

In 1997, Dr. Schmidhuber and Sepp Hochreiter published a paper on a technique that has proved crucial in laying groundwork for the rapid progress that has been made recently in vision and speech. The idea, known as Long Short-Term Memory, or LSTM, was not widely understood when it was introduced. It essentially offered a form of memory or context to neural networks.

Just as humans do not restart learning from scratch every second, a certain type of neural network adds loops or memory that interpret each new word or observation in light of what has been previously observed. LSTM strikingly improved these networks, leading to huge jumps in accuracy.

It may be that Dr. Schmidhuber’s misfortune is that he was simply too early — a few years ahead of the powerful and more affordable computers we have today. It was not until recently that his concepts started to pan out.

Last year, for example, Google researchers reported that they had used LSTM to cut transcription errors in their speech recognition service by up to 49 percent. It was a huge increase after years of incremental progress.

But between Dr. Schmidhuber’s and Dr. Hochreiter’s research and today’s progress there was a big gap — and that’s the rub. Other researchers say it took many contributors to get from Point A to Point B, where we are today.

“He’s done a lot of seminal stuff,” said Gary Bradski, an A.I. scientist who created a popular computer vision system known as OpenCV. “But he wasn’t the one who made it popular. It’s kind of like the Vikings discovering America; Columbus made it real.”

Dr. Schmidhuber also has a grand vision for A.I. — that self-aware or “conscious machines” are just around the corner — that causes eyes to roll among some of his peers. To put a fine point on the debate: Is artificial intelligence an engineering discipline, or a godlike field on the cusp of creating a new superintelligent species?

Dr. Schmidhuber is firmly in the god camp. He maintains that the basic concepts for such technologies already exist, and that there is nothing magical about human consciousness. “Generally speaking, consciousness and self-awareness are overrated,” he said, arguing that machine consciousness will emerge from more powerful computers and software algorithms much like those he has already designed.

It’s been an obsession since he was a teenager in Germany reading science fiction.

“As I grew up I kept asking myself, ‘What’s the maximum impact I could have?’” Dr. Schmidhuber recalled. “And it became clear to me that it’s to build something smarter than myself, which will build something even smarter, et cetera, et cetera, and eventually colonize and transform the universe, and make it intelligent.”

Today, he will not be pinned down on when such thinking machines might arrive, saying only that given the vast improvements in computing power it will be soon.

In 2014, he and others founded a company to commercialize some of the technology that he helped create and to work on “general purpose” artificial intelligence.

The company, Nnaisense, is based just a few steps from the University of Lugano campus. It is being advised by Dr. Hochreiter, who now heads the Institute of Bioinformatics at the Johannes Kepler University in Linz, Austria, and Jaan Tallinn, a co-founder of Skype. The company has partnerships in finance, autonomous vehicles and heavy industry.

Nnaisense’s chief executive is an American computer scientist, Faustino Gomez, who has been Dr. Schmidhuber’s research collaborator for many years. He defends both his partner’s claims of having done pioneering work and his optimism about the field that has begun shaking up industries and economies around the world.

“We are at the beginning of the end of the beginning in A.I.,” he said.

Continue reading the main story

By JOHN MARKOFF