Yearb Med Inform 2017; 26(01): 228-234
DOI: 10.15265/IY-2017-027
Section 10: Natural Language Processing
Synopsis
Georg Thieme Verlag KG Stuttgart

Making Sense of Big Textual Data for Health Care: Findings from the Section on Clinical Natural Language Processing

A. Névéol
1   LIMSI, CNRS, Université Paris Saclay, Orsay, France
,
P. Zweigenbaum
1   LIMSI, CNRS, Université Paris Saclay, Orsay, France
,
Section Editors for the IMIA Yearbook Section on Clinical Natural Language Processing › Author Affiliations
Further Information

Publication History

18 August 2017

Publication Date:
11 September 2017 (online)

Summary

Objectives: To summarize recent research and present a selection of the best papers published in 2016 in the field of clinical Natural Language Processing (NLP).

Method: A survey of the literature was performed by the two section editors of the IMIA Yearbook NLP section. Bibliographic databases were searched for papers with a focus on NLP efforts applied to clinical texts or aimed at a clinical outcome. Papers were automatically ranked and then manually reviewed based on titles and abstracts. A shortlist of candidate best papers was first selected by the section editors before being peer-reviewed by independent external reviewers.

Results: The five clinical NLP best papers provide a contribution that ranges from emerging original foundational methods to transitioning solid established research results to a practical clinical setting. They offer a framework for abbreviation disambiguation and coreference resolution, a classification method to identify clinically useful sentences, an analysis of counseling conversations to improve support to patients with mental disorder and grounding of gradable adjectives.

Conclusions: Clinical NLP continued to thrive in 2016, with an increasing number of contributions towards applications compared to fundamental methods. Fundamental work addresses increasingly complex problems such as lexical semantics, coreference resolution, and discourse analysis. Research results translate into freely available tools, mainly for English.

 
  • References


  • In the reference list below, papers that were shortlisted as best paper candidates are marked with a *.
  • 1 Gonzalez-Hernandez G, Sarker A, O’Connor K, Savova G. Capturing the Patient’s Perspective: a Review of Advances in Natural Language Processing of Health-Related Text. Yearb Med Inform 2017; 214-27.
  • 2* Morid MA, Fiszman M, Raja K, Jonnalagadda SR, Del Fiol G. Classification of clinically useful sentences in clinical evidence resources. J Biomed Inform 2016; Apr; 60: 14-22.
  • 3* Shivade C, de Marneffe MC, Fosler-Lussier E, Lai AM. Identification, characterization, and grounding of gradable terms in clinical text. Proceedings of the 15th Workshop on Biomedical Natural Language Processing 2016; 17-26.
  • 4* Kilicoglu H, Demner-Fushman D. Bio-SCoRes: A Smorgasbord Architecture for Coreference Resolution in Biomedical Text. PLoS One 2016; Mar 2; 11 (03) e0148538.
  • 5* Althoff T, Clark K, Leskovec J. Large-scale Analysis of Counseling Conversations: An Application of Natural Language Processing to Mental Health. Trans Assoc Comput Linguist 2016; 04: 463-76.
  • 6* Wu Y, Denny JC, Rosenbloom ST, Miller RA, Giuse DA, Wang L. et al. A long journey to short abbreviations: developing an open-source framework for clinical abbreviation recognition and disambiguation (CARD). J Am Med Inform Assoc 2017; 24 (e1): e79-e86.
  • 7 Norman C, Leeflang ML, Zweigenbaum P, Névéol A. Tri Automatique de la Littérature pour les Revues Systématiques. Traitement Automatique de la Langue Naturelle - TALN 2017; 234-41.
  • 8 Friedman C. Towards a comprehensive medical language processing system: methods and issues. Proc AMIA Annu Fall Symp 1997; 595-9.
  • 9 Cai T, Giannopoulos AA, Yu S, Kelil T, Ripley B, Kumamaru KK. et al. Natural Language Processing Technologies in Radiology Research and Clinical Applications. Radiographics 2016; Jan-Feb; 36 (01) 176-91.
  • 10 Pons E, Braun LM, Hunink MG, Kors JA. Natural Language Processing in Radiology: A Systematic Review. Radiology 2016; May; 279 (02) 329-43.
  • 11 Smith AD, de Vos MS, Smink DS, Nguyen LL, Ashley SW. Text paging of surgery residents: Efficacy, work intensity, and quality improvement. Surgery 2016; Mar; 159 (03) 930-7.
  • 12 Torii M, Tilak SS, Doan S, Zisook DS, Fan JW. Mining Health-Related Issues in Consumer Product Reviews by Using Scalable Text Analytics. Biomed Inform Insights 2016; Jun 20; 08 (Suppl. 01) 1-11.
  • 13 Sarker A, O’Connor K, Ginn R, Scotch M, Smith K, Malone D. et al. Social Media Mining for Toxicovigilance: Automatic Monitoring of Prescription Medication Abuse from Twitter. Drug Saf 2016; Mar; 39 (03) 231-40.
  • 14 Ranney ML, Chang B, Freeman JR, Norris B, Silverberg M, Choo EK. Tweet Now, See You In the ED Later? Examining the Association Between Alcohol-related Tweets and Emergency Care Visits. Acad Emerg Med 2016; Jul; 23 (07) 831-4.
  • 15 Liu J, Zhao S, Zhang X. An ensemble method for extracting adverse drug events from social media. Artif Intell Med 2016; Jun; 70: 62-76.
  • 16 Rastegar-Mojarad M, Liu H, Nambisan P. Using Social Media Data to Identify Potential Candidates for Drug Repurposing: A Feasibility Study. JMIR Res Protoc 2016; Jun 16; 05 (02) e121.
  • 17 Calix RA, Gupta M, Jiang K. Construction of a Personal Experience Tweet Corpus for Health Surveillance. Proceedings of the 15th Workshop on Biomedical Natural Language Processing 2016; 128-35.
  • 18 Wu DT, Hanauer DA, Mei Q, Clark PM, An LC, Proulx J. et al. Assessing the readability of ClinicalTrials.gov. J Am Med Inform Assoc 2016; Mar; 23 (02) 269-75.
  • 19 Kauchak D, Leroy G. Moving Beyond Readability Metrics for Health-Related Text Simplification. IT Prof 2016; May-Jun; 18 (03) 45-51.
  • 20 Roberts K, Demner-Fushman D. Interactive use of online health resources: a comparison of consumer and professional questions. J Am Med Inform Assoc 2016; Jul; 23 (04) 802-11.
  • 21 Wongchaisuwat P, Klabjan D, Jonnalagadda SR. A Semi-Supervised Learning Approach to Enhance Health Care Community-Based Question Answering: A Case Study in Alcoholism. JMIR Med Inform 2016; Aug 2; 04 (03) e24.
  • 22 Hawkins JB, Brownstein JS, Tuli G, Runels T, Broecker K, Nsoesie EO. et al. Measuring patient-perceived quality of care in US hospitals using Twitter. BMJ Qual Saf 2016; Jun; 25 (06) 404-13.
  • 23 Ranard BL, Werner RM, Antanavicius T, Schwartz HA, Smith RJ, Meisel ZF. et al. Yelp Reviews Of Hospital Care Can Supplement And Inform Traditional Surveys Of The Patient Experience Of Care. Health Aff (Millwood) 2016; Apr; 35 (04) 697-705.
  • 24 Bahk CY, Cumming M, Paushter L, Madoff LC, Thomson A, Brownstein JS. Publicly Available Online Tool Facilitates Real-Time Monitoring Of Vaccine Conversations And Sentiments. Health Aff (Millwood) 2016; Feb; 35 (02) 341-7.
  • 25 Strekalova YA, James VS. Language of Uncertainty: the Expression of Decisional Conflict Related to Skin Cancer Prevention Recommendations. J Cancer Educ. 2016 Jan 19.
  • 26 Scholte M, van Dulmen SA, Neeleman-Van der Steen CW, van der Wees PJ, Nijhuis-van der Sanden MW, Braspenning J. Data extraction from electronic health records (EHRs) for quality measurement of the physical therapy process: comparison between EHR data and survey data. BMC Med Inform Decis Mak 2016; Nov 8; 16 (01) 141.
  • 27 Ford E, Carroll J, Smith H, Davies K, Koeling R, Petersen I. et al. What evidence is there for a delay in diagnostic coding of RA in UK general practice records? An observational study of free text. BMJ Open 2016; Jun 28; 06 (06) e010393.
  • 28* Kaufman DR, Sheehan B, Stetson P, Bhatt AR, Field AI, Patel C. et al. Natural Language Processing-Enabled and Conventional Data Capture Methods for Input to Electronic Health Records: A Comparative Usability Study. JMIR Med Inform 2016; Oct 28; 04 (04) e35.
  • 29 Figueroa RL, Flores CA. Extracting Information from Electronic Medical Records to Identify the Obesity Status of a Patient Based on Comorbidities and Bodyweight Measures. J Med Syst 2016; Aug; 40 (08) 191.
  • 30 Walsh JA, Shao Y, Leng J, He T, Teng CC, Redd D. et al. Identifying axial spondyloarthritis in electronic medical records of United States Veterans. Arthritis Care Res (Hoboken). 2016 Nov 3.
  • 31 Lingren T, Thaker V, Brady C, Namjou B, Kennebeck S, Bickel J. et al. Developing an Algorithm to Detect Early Childhood Obesity in Two Tertiary Pediatric Medical Centers. Appl Clin Inform 2016; Jul 20; 07 (03) 693-706.
  • 32 Mowery DL, Chapman BE, Conway M, South BR, Madden E, Keyhani S. et al. Extracting a stroke phenotype risk factor from Veteran Health Administration clinical reports: an information content analysis. J Biomed Semantics 2016; May 10; 07: 26.
  • 33 Nelson RE, Butler J, LaFleur J, Knippenberg K, Kamauu CAW, DuVall SL. Determining Multiple Sclerosis Phenotype from Electronic Medical Records. J Manag Care Spec Pharm 2016; Dec; 22 (12) 1377-82.
  • 34 Teixeira PL, Wei WQ, Cronin RM, Mo H, Van-Houten JP, Carroll RJ. et al. Evaluating electronic health record data sources and algorithmic approaches to identify hypertensive individuals. J Am Med Inform Assoc 2017; Jan; 24 (01) 162-71.
  • 35* Zheng L, Wang Y, Hao S, Shin AY, Jin B, Ngo AD. et al. Web-based Real-Time Case Finding for the Population Health Management of Patients With Diabetes Mellitus: A Prospective Validation of the Natural Language Processing-Based Algorithm With Statewide Electronic Medical Records. JMIR Med Inform 2016; Nov 11; 04 (04) e37.
  • 36* Yala A, Barzilay R, Salama L, Griffin M, Sollender G, Bardia A. et al. Using machine learning to parse breast pathology reports. Breast Cancer Res Treat 2017; Jan; 161 (02) 203-11.
  • 37 Yu S, Chakrabortty A, Liao KP, Cai T, Ananthakrishnan AN, Gainer VS. et al. Surrogate-assisted feature extraction for high-throughput phenotyping. J Am Med Inform Assoc 2017; Apr 1; 24 (e1): e143-e149.
  • 38 Brown AD, Marotta TR. A Natural Language Processing-based Model to Automate MRI Brain Protocol Selection and Prioritization. Acad Radiol 2017; Feb; 24 (02) 160-166.
  • 39 Topaz M, Radhakrishnan K, Blackley S, Lei V, Lai K, Zhou L. Studying Associations Between Heart Failure Self-Management and Rehospitalizations Using Natural Language Processing. West J Nurs Res. 2016 Sep 14.
  • 40 Cook BL, Progovac AM, Chen P, Mullin B, Hou S, Baca-Garcia E. Novel Use of Natural Language Processing (NLP) to Predict Suicidal Ideation and Psychiatric Symptoms in a Text-Based Mental Health Intervention in Madrid. Comput Math Methods Med 2016; 2016: 8708434.
  • 41 Grundmeier RW, Masino AJ, Casper TC, Dean JM, Bell J, Enriquez R. et al. Pediatric Emergency Care Applied Research Network. Identification of Long Bone Fractures in Radiology Reports Using Natural Language Processing to support Healthcare Quality Improvement. Appl Clin Inform 2016; Nov 9; 07 (04) 1051-68.
  • 42 Morioka C, Meng F, Taira R, Sayre J, Zimmerman P, Ishimitsu D. et al. Automatic Classification of Ultrasound Screening Examinations of the Abdominal Aorta. J Digit Imaging 2016; Dec; 29 (06) 742-8.
  • 43 Chang EK, Yu CY, Clarke R, Hackbarth A, Sanders T, Esrailian E. et al. Defining a Patient Population With Cirrhosis: An Automated Algorithm With Natural Language Processing. J Clin Gastroenterol 2016; Nov/Dec; 50 (10) 889-94.
  • 44 Masino AJ, Grundmeier RW, Pennington JW, Germiller JA, Crenshaw 3rd EB. Temporal bone radiology report classification using open source machine learning and natural langue processing libraries. BMC Med Inform Decis Mak 2016; Jun 6; 16: 65.
  • 45 Bozkurt S, Gimenez F, Burnside ES, Gulkesen KH, Rubin DL. Using automatically extracted information from mammography reports for decision-support. J Biomed Inform 2016; Aug; 62: 224-31.
  • 46 Yadav K, Sarioglu E, Choi HA, Cartwright 4th WB, Hinds PS, Chamberlain JM. Automated Outcome Classification of Computed Tomography Imaging Reports for Pediatric Traumatic Brain Injury. Acad Emerg Med 2016; Feb; 23 (02) 171-8.
  • 47 Sada Y, Hou J, Richardson P, El-Serag H, Davila J. Validation of Case Finding Algorithms for Hepatocellular Cancer From Administrative Data and Electronic Health Records Using Natural Language Processing. Med Care 2016; Feb; 54 (02) e9-14.
  • 48 Castro VM, Dligach D, Finan S, Yu S, Can A, Abd-El-Barr M. et al. Large-scale identification of patients with cerebral aneurysms using natural language processing. Neurology 2017; Jan 10; 88 (02) 164-8.
  • 49 Gorrell G, Oduola S, Roberts A, Crai T, Morgan C, Stewart R. Identifying First Episodes of Psychosis in Psychiatric Patient Records using Machine Learning. Proceedings of the 15th Workshop on Biomedical Natural Language Processing 2016; 196-205.
  • 50 Corey KE, Kartoun U, Zheng H, Shaw SY. Development and Validation of an Algorithm to Identify Nonalcoholic Fatty Liver Disease in the Electronic Medical Record. Dig Dis Sci 2016; Mar; 61 (03) 913-9.
  • 51 Chen W, Huang Y, Boyle B, Lin S. The utility of including pathology reports in improving the computational identification of patients. J Pathol Inform 2016; Nov 29; 07: 46.
  • 52 VanWormer JJ, Holsman RH, Petchenik JB, Dhuey BJ, Keifer MC. Epidemiologic trends in medically-attended tree stand fall injuries among Wisconsin deer hunters. Injury 2016; Jan; 47 (01) 220-5.
  • 53 Hu D, Huang Z, Chan TM, Dong W, Lu X, Duan H. Utilizing Chinese Admission Records for MACE Prediction of Acute Coronary Syndrome. Int J Environ Res Public Health. 2016 Sep 13; 13. (9):
  • 54 Temple MW, Lehmann CU, Fabbri D. Natural Language Processing for Cohort Discovery in a Discharge Prediction Model for the Neonatal ICU. Appl Clin Inform 2016; Feb 24; 07 (01) 101-15.
  • 55 McCoy Jr TH, Castro VM, Roberson AM, Snapper LA, Perlis RH. Improving Prediction of Suicide and Accidental Death After Discharge From General Hospitals With Natural Language Processing. JAMA Psychiatry 2016; Oct 1; 73 (10) 1064-71.
  • 56* Pestian JP, Sorter M, Connolly B, Bretonnel KCohen, McCullumsmith C. et al. STM Research Group. A Machine Learning Approach to Identifying the Thought Markers of Suicidal Subjects: A Prospective Multicenter Trial. Suicide Life Threat Behav 2017; Feb; 47 (01) 112-21.
  • 57* Toerper MF, Flanagan E, Siddiqui S, Appelbaum J, Kasper EK, Levin S. Cardiac catheterization laboratory inpatient forecast tool: a prospective evaluation. J Am Med Inform Assoc 2016; Apr; 23 (e1): e49-57.
  • 58 Hassanpour S, Langlotz CP. Predicting High Imaging Utilization Based on Initial Radiology Reports: A Feasibility Study of Machine Learning. Acad Radiol 2016; Jan; 23 (01) 84-9.
  • 59 Rumshisky A, Ghassemi M, Naumann T, Szolovits P, Castro VM, McCoy TH. et al. Predicting early psychiatric readmission with natural language processing of narrative discharge summaries. Transl Psychiatry 2016; Oct 18; 06 (10) e921.
  • 60 Haller IV, Renier CM, Juusola M, Hitz P, Steffen W, Asmus MJ. et al. Enhancing Risk Assessment in Patients Receiving Chronic Opioid Analgesic Therapy Using Natural Language Processing. Pain Med. 2016 Dec 29.
  • 61* Evans RS, Benuzillo J, Horne BD, Lloyd JF, Bradshaw A, Budge D. et al. Automated identification and predictive tools to help identify high-risk heart failure patients: pilot evaluation. J Am Med Inform Assoc 2016; Sep; 23 (05) 872-8.
  • 62 Warner JL, Levy MA, Neuss MN, Warner JL, Levy MA, Neuss MN. ReCAP: Feasibility and Accuracy of Extracting Cancer Stage Information From Narrative Electronic Health Record Data. J Oncol Pract 2016; Feb; 12 (02) 157-8 e169-7.
  • 63 Lu CC, Leng J, Cannon GW, Zhou X, Egger M, South B. et al. The use of natural language processing on narrative medication schedules to compute average weekly dose. Pharmacoepidemiol Drug Saf 2016; Dec; 25 (12) 1414-24.
  • 64 Alemzadeh H, Raman J, Leveson N, Kalbarczyk Z, Iyer RK. Adverse Events in Robotic Surgery: A Retrospective Study of 14 Years of FDA Data. PLoS One 2016; Apr 20; 11 (04) e0151470.
  • 65 Gundlapalli AV, Divita G, Redd A, Carter ME, Ko D, Rubin M. et al. Detecting the presence of an indwelling urinary catheter and urinary symptoms in hospitalized patients using natural language processing. J Biomed Inform. 2016 Jul 9.
  • 66 Yim WW, Kwan SW, Yetisgen M. Tumor reference resolution and characteristic extraction in radiology reports for liver cancer stage prediction. J Biomed Inform 2016; Dec; 64: 179-91.
  • 67 Xie F, Zheng C, Yuh-Jer AShen, Chen W. Extracting and analyzing ejection fraction values from electronic echocardiography reports in a large health maintenance organization. Health Informatics J. 2016 Jun 7.
  • 68 Meystre SM, Kim Y, Gobbel GT, Matheny ME, Redd A, Bray BE. et al. Congestive heart failure information extraction framework for automated treatment performance measures assessment. J Am Med Inform Assoc 2017; Apr 1; 24 (e1): e40-e46.
  • 69 Chang M, Chang M, Reed JZ, Milward D, Xu JJ, Cornell WD. Developing timely insights into comparative effectiveness research with a text-mining pipeline. Drug Discov Today 2016; Mar; 21 (03) 473-80.
  • 70 Atal I, Zeitoun JD, Névéol A, Ravaud P, Porcher R, Trinquart L. Automatic Classification of registered clinical trials towards the Global Burden of Diseases taxonomy of diseases and injuries. BMC Bioinformatics 2016; Sep 22; 17 (01) 392.
  • 71 Luo J, Eldredge C, Cho CC, Cisler RA. Population Analysis of Adverse Events in Different Age Groups Using Big Clinical Trials Data. JMIR Med Inform 2016; Oct 17; 04 (04) e30.
  • 72 Luo J, Cisler RA. Discovering Outliers of Potential Drug Toxicities Using a Large-scale Data-driven Approach. Cancer Inform 2016; Oct 26; 15: 211-7.
  • 73 Botsis T, Jankosky C, Arya D, Kreimeyer K, Foster M, Pandey A. et al. Decision support environment for medical product safety surveillance. J Biomed Inform 2016; Dec; 64: 354-62.
  • 74 Mahmood AS, Wu TJ, Mazumder R, Vijay-Shanker K. DiMeX: A Text Mining System for Mutation-Disease Association Extraction. PLoS One 2016; Apr 13; 11 (04) e0152725.
  • 75 Kuhn M, Letunic I, Jensen LJ, Bork P. The SIDER database of drugs and side effects. Nucleic Acids Res 2016; Jan 4; 44 (D1): D1075-9.
  • 76 Xu J, Lee HJ, Zeng J, Wu Y, Zhang Y, Huang LC. et al. Extracting genetic alteration information for personalized cancer therapy from ClinicalTrials.gov. J Am Med Inform Assoc 2016; Jul; 23 (04) 750-7.
  • 77 Velupillai S, Mowery DL, Conway M, Hurdle J, Kious B. Vocabulary Development To Support Information Extraction of Substance Abuse from Psychiatry Notes. Proceedings of the 15th Workshop on Biomedical Natural Language Processing 2016; 92-101.
  • 78* Pakhomov SV, Finley G, McEwan R, Wang Y, Melton GB. Corpus domain effects on distributional semantic modeling of medical terms. Bioinformatics 2016; Dec 1; 32 (23) 3635-44.
  • 79* Limsopatham N, Collier N. Normalising Medical Concepts in Social Media Texts by Learning Semantic Representation. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers 2016; 1014-23.
  • 80* Zhang S, Kang T, Zhang X, Wen D, Elhadad N, Lei J. Speculation detection for Chinese clinical notes: Impacts of word segmentation and embedding models. J Biomed Inform 2016; Apr; 60: 334-41.
  • 81 Li M, Carrell D, Aberdeen J, Hirschman L, Kirby J, Li B. et al. Optimizing annotation resources for natural language de-identification via a game theoretic framework. J Biomed Inform 2016; Jun; 61: 97-109.
  • 82* Scaiano M, Middleton G, Arbuckle L, Kolhatkar V, Peyton L, Dowling M. et al K. A unified framework for evaluating the risk of re-identification of text de-identification tools. J Biomed Inform 2016; Oct; 63: 174-83.
  • 83 Carrell DS, Cronkite DJ, Malin BA, Aberdeen JS, Hirschman L. Is the Juice Worth the Squeeze? Costs and Benefits of Multiple Human Annotators for Clinical Text De-identification. Methods Inf Med 2016; Aug 5; 55 (04) 356-64.
  • 84 Kilicoglu H, Rosemblat G, Fiszman M, Rindflesch TC. Sortal anaphora resolution to enhance relation extraction from biomedical literature. BMC Bioinformatics 2016; Apr 14; 17: 163.
  • 85 Liu S, Liu H, Chaudhary V, Li D. An Infinite Mixture Model for Coreference Resolution in Clinical Notes. AMIA Jt Summits Transl Sci Proc 2016; Jul 22; 2016: 428-37.
  • 86 Tseytlin E, Mitchell K, Legowski E, Corrigan J, Chavan G, Jacobson RS. NOBLE - Flexible concept recognition for large-scale biomedical natural language processing. BMC Bioinformatics 2016; Jan 14; 17: 32.
  • 87 Lin C, Dligach D, Miller TA, Bethard S, Savova GK. Multilayered temporal modeling for the clinical domain. J Am Med Inform Assoc 2016; Mar; 23 (02) 387-95.
  • 88 Kaggal VC, Elayavilli RK, Mehrabi S, Pankratz JJ, Sohn S, Wang Y. et al. Toward a Learning Healthcare System - Knowledge Delivery at the Point of Care Empowered by Big Data and NLP. Biomed Inform Insights 2016; Jun 23; 08 (Suppl. 01) 13-22.
  • 89 Wallace BC, Kuiper J, Sharma A, Zhu MB, Marshall IJ. Extracting PICO Sentences from Clinical Trial Reports using Supervised Distant Supervision. J Mach Learn Res 2016; 17.
  • 90 Clark DG, McLaughlin PM, Woo E, Hwang K, Hurtz S, Ramirez L. et al. Novel verbal fluency scores and structural brain imaging for prediction of cognitive outcome in mild cognitive impairment. Alzheimers Dement (Amst) 2016; Feb 15; 02: 113-22.
  • 91 Takano K, Ueno M, Moriya J, Mori M, Nishiguchi Y, Raes F. Unraveling the linguistic nature of specific autobiographical memories using a computerized Classification algorithm. Behav Res Methods 2017; Jun; 49 (03) 835-52.
  • 92 Luo SX, Shinall JA, Peterson BS, Gerber AJ. Semantic mapping reveals distinct patterns in descriptions of social relations in adults with autism spectrum disorder. Autism Res 2016; Aug; 09 (08) 846-53.