As always, you first search for a MeSH term corresponding broadly with autism spectrum disorder by simply entering ‘autism’ in the PubMed MeSH database (http://www.ncbi.nlm.nih.gov/mesh). It reveals that is does have a MeSH term ‘Autism Spectrum Disorder’, but looking at its tree you realise that ‘Child Development Disorders, Pervasive’, is a higher (broader) term that encompasses ‘Asperger Syndrome’, ‘Autism Spectrum Disorder’ and ‘Autistic Disorder’. (ASD in DSM-5 is a broader concept that roughly corresponds with pervasive developmental disorder in DSM-IV or International Classification of Diseases 10th Edition (ICD-10), and subsumes autistic disorder and Asperger's syndrome in DSM-IV.) So you choose ‘Child Development Disorders, Pervasive’ [Mesh], and use it in PubMed Clinical Queries (http://www.ncbi.nlm.nih.gov/pubmed/clinical) while specifying Category: diagnosis and Scope: narrow. This retrieves 387 references but this list could be further narrowed down to 97 when you apply the age limit to Adult: 19+ years. Browsing down the list, you immediately notice one study focusing on adults and using DSM-5: Grodberg D, Weinger PM, Halpern D, et al. The autism mental status exam: sensitivity and specificity using DSM-5 criteria for autism spectrum disorder in verbally fluent adults. J Autism Dev Disord 2014;44 :609–14.
The study examined the Autism Mental Status Exam (AMSE) against DSM-5 diagnoses among high-risk verbally fluent adults. AMSE aims to provide a standardised diagnostic screening approach that is feasible in all clinical settings. It has eight items assessing eye contact, interest in others, pointing skills, language, pragmatics of language, repetitive behaviours and stereotypy, unusual or encompassing preoccupations and unusual sensitivities. Each item is rated as 0 or 1 or 2, based on the clinical observation and/or self-reports and observer-reports. The developers of AMSE have prepared a web site where they provide four vignette cases with videos and scores, and two post-tests, for training purposes.
Critical appraisal of the literature on diagnostic test
ARE THE RESULTS AT RISK OF BIAS?
Did participating patients present a diagnostic dilemma?
YES. This study enrolled consecutive self-referred verbally fluent adult patients between the ages of 18 and 45 years who visited an autism research centre and consented to a comprehensive assessment protocol.
Did investigators compare the test to an appropriate, independent reference standard?
YES. The reference diagnosis was the best estimate clinical diagnosis according to DSM-5, based on the full Autism Diagnostic Observation Schedule (ADOS)1 (plus the Autism Diagnostic Interview-Revised (ADI-R)2 in one-third of the sample) and the psychiatric history. ADOS and ADI-R are considered to be the gold standard assessment tools for autism spectrum disorder.
Were those interpreting the test and reference standard blind to the other results?
YES. The AMSE was scored by a psychiatrist who first saw the patient. Then the ADOS and ADI-R were administered by an independent, blinded psychologist, and, finally, the best estimate clinical diagnosis was made by an independent psychiatrist based on all the information except for the AMSE score.
Did investigators perform the same reference standard to all patients regardless of the results of the test under investigation?
YES. Two-thirds of the patients did not receive ADI-R; however, ADOS is usually considered to provide enough information.
WHAT ARE THE RESULTS?
What likelihood ratios (LR) were associated with the range of possible test results?
Of the 50 enrolled patients, 23 were judged to have ASD according to DSM-5. The study reports sensitivity and specificity for each of the scores ranging from 1 through 9. When this table is converted into actual numbers according to the proposed cut-off,⇓
The positive likelihood ratio can then be calculated as 12.3 (95% CI 3.8 to 40.5), and the negative likelihood ratio as 0.09 (0.03 to 0.30), using the spreadsheet available on our web site (http://ebmh.med.kyoto-u.ac.jp/toolbox.html).
Since, in general, a likelihood ratio greater than 10 substantively increases the post-test probability of the diagnosis when the test is positive (ie, rules in the diagnosis), and that smaller than 0.1 substantively decreases the post-test probability when it is negative (ie, rules out the diagnosis), the performance of the AMSE appears to be very good.3
HOW CAN I APPLY THE RESULTS TO PATIENT CARE?
Will the reproducibility of the test result and its interpretation be satisfactory in my clinical setting?
This is probably the biggest issue for any clinician-rating scales. Although the tool has been developed to be feasible in all clinical settings, the developers of the AMSE explicitly warn that the scale be used only by clinicians with diagnostic expertise in ASD. They are currently examining the effectiveness of a training curriculum across different mental health professionals.
However, to the great advantage of the broader range of clinicians, the developers provide a web site explaining AMSE with case vignettes and videos (http://autismmentalstatusexam.com/). When I went through the materials, it took me two hours to train myself and to reach perfect agreement for the two post-tests.
Are the study results applicable to the patients in my practice?
As you are a general adult psychiatrist, your pre-test probability for ASD may be lower than that in specialised clinics such as the one in this study (46%).
Assuming the pre-test probability of 33% for Adam, then, because he would score 6 on AMSE (eye contact—0, interest in others—0, pointing skills—0, language—0, pragmatics of language—2, repetitive behaviours and stereotypy—1, unusual or encompassing preoccupations—2 and unusual sensitivities—1), his post-test probability is now elevated to 86%.
Will the test results change my management strategy?
YES.
Will patients be better off as a result of the test?
YES, VERY HOPEFULLY. The definitive diagnosis by a child psychiatrist, be it positive or negative, should decrease the mother's anxiety and, if positive, should lead to more specialised care fit for the patient.