By Ron Benvenisti.
The Vocalis Health app uses voice recordings to predict coronary artery disease and related events.
An artificial intelligence (AI)-based computer algorithm accurately predicted a person’s likelihood of suffering heart problems related to clogged arteries based on voice recordings alone, in a study presented at the American College of Cardiology’s 71st Annual Scientific Session.
The study was simultaneously published in the Mayo Clinic Proceedings at the time of presentation.
Researchers recruited 108 patients who were referred for a coronary angiogram, an X-ray imaging procedure used to assess the condition of the heart’s arteries. Participants were asked to record three 30-second voice samples using the Vocalis Health smartphone application. For the first sample, participants read from a prepared text. For the second sample, they were asked to speak freely about a positive experience, and for the third, they spoke freely about a negative experience.
Study participants were tracked for two years. Of those with a high voice biomarker score, 58.3% visited the hospital for chest pain or suffered acute coronary syndrome (a type of major heart problem that includes heart attacks) compared with 30.6% of those with a low voice biomarker score. Participants with a high voice biomarker score were also more likely to have a positive stress test or be diagnosed with CAD during a subsequent angiogram.
The Vocalis Health app then analyzed participants’ voice samples. The AI-based system had been trained to analyze more than 80 features of voice recordings, such as frequency, amplitude, pitch and cadence, based on a training set of over 10,000 voice samples collected in Israel. In previous studies, researchers identified six features that were highly correlated with CAD. For the new study, researchers combined these features into a single score, expressed as a number between -1 and 1 for each individual.
One-third of patients were categorized as having a high score and two-thirds had a low score.
“We can’t hear these particular features ourselves,” Sara said. “This technology is using machine learning to quantify something that isn’t easily quantifiable for us using our human brains and our human ears.”
Scientists have not concluded why certain voice features seem to be indicative of CAD, but Sara said the autonomic nervous system may play a role. This part of the nervous system regulates bodily functions that are not under conscious control, which includes both the voice box and many aspects of the cardiovascular system, such as heart rate and blood pressure. Therefore, it is possible that the voice could provide clues about how the autonomic nervous system is functioning, and by extension, provide insights into cardiovascular health, Sara said.
The study was conducted with English speakers in the Midwestern U.S. using software trained on voice samples collected in Israel. Sara said more tests are needed to determine whether the approach is generalizable and scalable across languages, countries, cultures and health care settings. He added that it will also be important to address security and privacy issues before incorporating such technology into telemedicine or on-site health assessments.
“It’s definitely an exciting field, but there’s still a lot of work to be done,” Sara said. “We have to know the limitations of the data we have, and we need to conduct more studies in more diverse populations, larger trials and more prospective studies like this one.”
“Telemedicine is non-invasive, cost-effective and efficient and has become increasingly important during the pandemic,” said Jaskanwal Deep Singh Sara, MD, a cardiology fellow at Mayo Clinic and the study’s lead author. “We’re not suggesting that voice analysis technology would replace doctors or replace existing methods of health care delivery, but we think there’s a huge opportunity for voice technology to act as an adjunct to existing strategies. Providing a voice sample is very intuitive and even enjoyable for patients, and it could become a scalable means for us to enhance patient management.”
While the technology is not yet ready for use in the clinic, the demonstration suggests voice analysis could be a powerful screening tool in identifying patients who may benefit from closer monitoring for CAD-related events. Researchers said this approach could be particularly useful in remote health care delivery and telehealth.
The study represents the first-time voice analysis has been used to predict CAD outcomes in patients who were tracked prospectively after an initial screening. Previous studies retrospectively examined voice markers associated with CAD and heart failure. Other research groups have explored the use of similar technology for a range of disorders, including Parkinson’s disease, Alzheimer’s disease, and COVID-19.
The American College of Cardiology: The ACC bestows credentials upon cardiovascular professionals who meet stringent qualifications and leads in the formation of health policy, standards and guidelines. The College provides professional medical education, disseminates cardiovascular research through its world-renowned JACC Journals, operates national registries to measure and improve care, and offers cardiovascular accreditation to hospitals and institutions.