In 2020 Ujwal Chaudhary, a biomedical engineer then at the University of Tübingen and the Wyss Center for Bio and Neuroengineering in Geneva, watched his computer with amazement as an experiment that he had spent years on revealed itself. A 34-year-old paralyzed man lay on his back in the laboratory, his head connected by a cable to a computer. A synthetic voice pronounced letters in German: “E, A, D…”
The patient had been diagnosed a few years earlier with amyotrophic lateral sclerosis, which leads to the progressive degeneration of brain cells involved in motion. The man had lost the ability to move even his eyeballs and was entirely unable to communicate; in medical terms, he was in a completely locked-in state.
Or so it seemed. Through Dr. Chaudhary’s experiment, the man had learned to select — not directly with his eyes but by imagining his eyes moving — individual letters from the steady stream that the computer spoke aloud. Letter by painstaking letter, one every minute or so, he formulated words and sentences.
“Wegen essen da wird ich erst mal des curry mit kartoffeln haben und dann bologna und dann gefuellte und dann kartoffeln suppe,” he wrote at one point: “For food I want to have curry with potato then Bolognese and potato soup.”
Dr. Chaudhary and his colleagues were dumbstruck. “I myself could not believe that this is possible,” recalled Dr. Chaudhary, who is now managing director at ALS Voice gGmbH, a neurobiotechnology company based in Germany, and who no longer works with the patient.
The study, published on Tuesday in Nature Communications, provides the first example of a patient in a fully locked-in state communicating at length with the outside world, said Niels Birbaumer, the leader of the study and a former neuroscientist at the University of Tübingen who is now retired.
Dr. Chaudhary and Dr. Birbaumer conducted two similar experiments in 2017 and 2019 on patients who were completely locked-in and reported that they were able to communicate. Both studies were retracted after an investigation by the German Research Foundation concluded that the researchers had only partially recorded the examinations of their patients on video, had not appropriately shown details of their analyses and had made false statements. The German Research Foundation, finding that Dr. Birbaumer committed scientific misconduct, imposed some of its most severe sanctions, including a five-year ban on submitting proposals and serving as a reviewer for the foundation.
The agency found that Dr. Chaudhary had also committed scientific misconduct and imposed the same sanctions for a three-year period. Both he and Dr. Birbaumer were asked to retract their two papers, and they declined.
The investigation came after a whistle-blower, Martin Spüler, a researcher, raised concerns about the two scientists in 2018.
Dr. Birbaumer stood by the conclusions and has taken legal action against the German Research Foundation. The results of the lawsuit are expected to be published in the next two weeks, said Marco Finetti, a spokesman for the German Research Foundation. Dr. Chaudhary says his lawyers expect to win the case.
The German Research Foundation has no knowledge of the publication of the current study and will investigate it in the coming months, Mr. Finetti said. In an email, a representative for Nature Communications who asked not to be named declined to comment on the details of how the study was vetted but expressed confidence with the process. “We have rigorous policies to safeguard the integrity of the research we publish, including to ensure that research has been conducted to a high ethical standard and is reported transparently,” the representative said.
“I would say it is a solid study,” said Natalie Mrachacz-Kersting, a brain-computer interface researcher at the University of Freiburg in Germany. She was not involved in the study and was aware of the previously retracted papers.
But Brendan Allison, researcher at the University of California San Diego, expressed reservations. “This work, like other work by Birbaumer, should be taken with a massive mountain of salt given his history,” Dr. Allison said. He noted that in a paper published in 2017, his own team had described being able to communicate with completely locked-in patients with basic “yes” or “no” answers.
The results hold potential promise for patients in similarly unresponsive situations, including minimally conscious and comatose states, as well as the rising number of people diagnosed with ALS worldwide every year. That number is projected to reach 300,000 by 2040.
“It’s a game-changer,” said Steven Laureys, a neurologist and researcher who leads the Coma Science Group at the University of Liège in Belgium and was not involved in the study. The technology could have ethical ramifications in discussions surrounding euthanasia for patients in locked-in or vegetative states, he added: “It’s really great to see this moving forward, giving patients a voice” in their own decisions.
Myriad methods have been used to communicate with unresponsive patients. Some involve basic pen-and-paper methods devised by family relatives. In others, a caregiver points to or speaks the names of items and looks for microresponses — blinks, finger twitches from the patient.
In recent years a new method has taken center stage: brain-computer interface technologies, which aim to translate a person’s brain signals into commands. Research institutes, private companies and entrepreneurial billionaires like Elon Musk have invested heavily in the technology.
The results have been mixed but compelling: patients moving prosthetic limbs using only their thoughts, and those with strokes, multiple sclerosis and other conditions communicating once again with loved ones.
What scientists have been unable to do until now, however, is communicate extensively with people like the man in the new study who displayed no movements whatsoever.
In 2017, before becoming totally locked-in, the patient had used eye movements to communicate with his family. Anticipating that he would soon lose even this ability, the family asked for an alternative communication system and approached Dr. Chaudhary and Dr. Birbaumer, a pioneer in the field of brain-computer interface technology, both of whom worked nearby.
With the man’s approval, Dr. Jens Lehmberg, a neurosurgeon and an author on the study, implanted two tiny electrodes in regions of the man’s brain that are involved in controlling movement. Then, for two months, the man was asked to imagine moving his hands, arms and tongue to see if these would generate a clear brain signal. But the effort yielded nothing reliable.
Dr. Birbaumer then suggested using auditory neurofeedback, an unusual technique by which patients are trained to actively manipulate their own brain activity. The man was first presented with a note — high or low, corresponding to yes or no. This was his “target tone” — the note he had to match.
He was then played a second note, which mapped onto brain activity that the implanted electrodes had detected. By concentrating — and imagining moving his eyes, to effectively dial his brain activity up or down — he was able to change the pitch of the second tone to match the first. As he did so, he gained real-time feedback of how the note changed, allowing him to heighten the pitch when he wanted to say yes or lower it for no.
This approach saw immediate results. On the man’s first day trying, he was able to alter the second tone. Twelve days later, he succeeded in matching the second to the first.
“That was when everything became consistent, and he could reproduce those patterns,” said Jonas Zimmermann, a neuroscientist at the Wyss Center and an author on the study. When the patient was asked what he was imagining to alter his own brain activity, he replied: “Eye movement.”
Over the next year, the man applied this skill to generate words and sentences. The scientists borrowed a communication strategy that the patient had used with his family when he could still move his eyes.
They grouped letters into sets of five colors. A computerized voice first listed the colors, and the man replied “yes” or “no,” depending on whether the letter he wanted to select was in that set. The voice then listed out each letter, which he selected in similar fashion. He repeated these steps set by set, letter by letter, to articulate full sentences.
On the second day of his spelling endeavor he wrote: “First I would like to thank Niels and his birbaumer.”
Some of his sentences involved instructions: “Mom head massage” and “everyone must use gel on my eyes more often.” Others described cravings: “Goulash soup and sweet pea soup.”
Of the 107 days that the man spent spelling, 44 resulted in intelligible sentences. And while there was great variability in speed, he wrote at about one character per minute.
“Wow, it blew my mind,” said Dr. Mrachacz-Kersting. She speculated that locked-in patients who can keep their minds stimulated could experience longer, healthier lives.
Dr. Mrachacz-Kersting emphasized, however, that the study was based on one patient and would need to be tested on many others.
Other researchers also expressed caution in embracing the findings.
Neil Thakur, chief mission officer of the ALS Association, said, “This approach is experimental, so there’s still a lot we need to learn.”
At this stage the technology is also far too complex for patients and families to operate. Making it more user-friendly and speeding up communication speed will be crucial, Dr. Chaudhary said. Until then, he said, a patient’s relatives will probably be satisfied.
“You have two options: no communication or communication at one character per minute,” he said. “What do you choose?”
Perhaps the biggest concern is time. Three years have passed since the implants were first inserted in the patient’s brain. Since then, his answers have become significantly slower, less reliable and often impossible to discern, said Dr. Zimmermann, who is now caring for the patient at the Wyss Center.
The cause of this decline is unclear, but Dr. Zimmermann thought it probably stemmed from technical issues. For instance, the electrodes are nearing the end of their life expectancy. Replacing them now, however, would be unwise. “It’s a risky procedure,” he said. “All of a sudden you’re exposed to new kinds of bacteria in the hospital.”
Dr. Zimmermann and others at the Wyss Center are developing wireless microelectrodes that are safer to use. The team is also exploring other noninvasive techniques that have proved fruitful in previous studies on patients who are not locked-in. “As much as we want to help people, I think it’s also very dangerous to create false hope,” Dr. Zimmermann said.
At the same time, Dr. Laureys of the Coma Science Group said there would be no value in fostering a sense of “false despair” when viable innovations were appearing on the horizon.
“I’m extremely excited as a caregiver, as a clinician,” he said. “I think it is wonderful that we offer these new scientific insights and technology to very vulnerable and dramatic conditions.”
