People with autism are typically diagnosed by clinical observation and assessment. To deconstruct the clinical decision process, which is often subjective and difficult to describe, researchers used a large language model (LLM) to synthesise the behaviors and observations that are most indicative of an autism diagnosis.
Their results show that repetitive behaviours, special interests, and perception-based behaviours are most associated with an autism diagnosis. These findings have the potential to improve diagnostic guidelines for autism by decreasing the focus on social factors- which the established guidelines in the DSM-5 focus on, but the model did not classify among the most relevant in diagnosing autism.
Our goal was not to suggest that we could replace clinicians with AI tools for diagnosis,” says senior author Danilo Bzdok of the Mila Quebec Artificial Intelligence Institute and McGill University in Montreal.
“Rather, we sought to quantitatively define exactly what aspects of observed behavior or patient history a clinician uses to reach a final diagnostic determination. In doing so, we hope to empower clinicians to work with diagnostic instruments that are more in line with their empirical realities.”
The scientists leveraged a transformer language model, which was pre-trained on about 489 million unique sentences. They then fine-tuned the LLM to predict the diagnostic outcome from a collection of more than 4,000 reports written by clinicians working with patients considered for autism diagnosis.
The reports, which were often used by multiple clinicians, included accounts of observed behavior and relevant patient history but did not include a suggested diagnostic outcome.
The team developed a bespoke LLM module that pinpointed specific sentences in the reports that were most relevant to a correct diagnosis prediction. They then extracted the numerical representation of these highly autism-relevant sentences and compared them directly with the established diagnostic criteria enumerated in the DSM-5.
The researchers were surprised by how clearly the LLM was able to distinguish between the most diagnostically relevant criteria. For example, their framework flagged that repetitive behaviours, special interests, and perception-based behaviour were the criteria most relevant to autism. While these criteria are used in clinical settings, current criteria focus more on deficits in social interplay and lack of communication skills.
The team expects their framework will be helpful to researchers and medical professionals working with a range of psychiatric, mental health, and neurodevelopmental disorders in which clinical judgment forms the bulk of the diagnostic decision-making process.
(With inputs from ANI)
