The State-of-the-Art of Patient Portals: Adapting to External Factors, Addressing Barriers, and Innovating

Abstract

Background and Objective Recent external factors—the 21st Century Cures Act and the coronavirus disease 2019 (COVID-19) pandemic—have stimulated major changes in the patient portal landscape. The objective of this state-of-the-art review is to describe recent developments in the patient portal literature and to identify recommendations and future directions for the design, implementation, and evaluation of portals.

Methods To focus this review on salient contemporary issues, we elected to center it on four topics: (1) 21st Century Cures Act's impact on patient portals (e.g., Open Notes); (2) COVID-19's pandemic impact on portals; (3) proxy access to portals; and (4) disparities in portal adoption and use. We conducted targeted PubMed searches to identify recent empirical studies addressing these topics, used a two-part screening process to determine relevance, and conducted thematic analyses.

Results Our search identified 174 unique papers, 74 were relevant empirical studies and included in this review. Among these papers, we identified 10 themes within our four a priori topics, including preparing for and understanding the consequences of increased patient access to their electronic health information (Cures Act); developing, deploying, and evaluating new virtual care processes (COVID-19); understanding current barriers to formal proxy use (proxy access); and addressing disparities in portal adoption and use (disparities).

Conclusion Our results suggest that the recent trends toward understanding the implications of immediate access to most test results, exploring ways to close gaps in portal adoption and use among different sub-populations, and finding ways to leverage portals to improve health and health care are the next steps in the maturation of patient portals and are key areas that require more research. It is important that health care organizations share their innovative portal efforts, so that successful measures can be tested in other contexts, and progress can continue.

Keywords

patient portals - 21st Century Cures Act - COVID-19 - proxy portal access - digital health disparities

Authors' Contributions

S.T.R. and J.S.A. conceived and designed this state-of-the-art review. T.L.R., B.D.S., J.S.A., and S.T.R. developed the search strategy and participated in the first round of screening. T.L.R. conducted the second round of screening with input as needed from the other co-authors. T.L.R. led the thematic analysis with input from the other co-authors. T.L.R. drafted the manuscript. All co-authors contributed to the final manuscript.

Protection of Human and Animal Subjects

No human or animal subjects were involved in the project.

Publikationsverlauf

Eingereicht: 20. Februar 2023

Angenommen: 26. Mai 2023

Artikel online veröffentlicht:
23. August 2023

• References

• 1 Robert Wood Johnson Foundation. Lessons learned. The value of personal health records and web portals to engage consumers and improve quality. 2012 . Accessed June 13, 2023 at: https://www.rwjf.org/en/insights/our-research/2012/07/the-value-of-personal-health-records-and-web-portals-to-engage-c.html
• 2 HealthIT.gov. What is a patient portal? | FAQs | Providers & Professionals. Accessed November 22, 2017 at: https://www.healthit.gov/providers-professionals/faqs/what-patient-portal
• 3 National Institutes of Health (NIH).. Trends and disparities in patient portal use. Published April 2021. Accessed June 13, 2023 at: https://hints.cancer.gov/docs/Briefs/HINTS_Brief_45.pdf
• 4 Otte-Trojel T, de Bont A, Rundall TG, van de Klundert J. What do we know about developing patient portals? a systematic literature review. J Am Med Inform Assoc 2016; 23 (e1): e162-e168
• 5 Ko H, Turner T, Jones C, Hill C. Patient-held medical records for patients with chronic disease: a systematic review. Qual Saf Health Care 2010; 19 (05) e41
• 6 Goldzweig CL, Orshansky G, Paige NM. et al. Electronic patient portals: evidence on health outcomes, satisfaction, efficiency, and attitudes: a systematic review. Ann Intern Med 2013; 159 (10) 677-687
• 7 Ammenwerth E, Schnell-Inderst P, Hoerbst A. The impact of electronic patient portals on patient care: a systematic review of controlled trials. J Med Internet Res 2012; 14 (06) e162
• 8 Saparova D. Motivating, influencing, and persuading patients through personal health records: a scoping review. Perspect Health Inf Manag 2012; 9 (Summer): 1f
• 9 Ross SE, Lin CT. The effects of promoting patient access to medical records: a review. J Am Med Inform Assoc 2003; 10 (02) 129-138
• 10 Gysels M, Richardson A, Higginson IJ. Does the patient-held record improve continuity and related outcomes in cancer care: a systematic review. Health Expect 2007; 10 (01) 75-91
• 11 Emont S. Measuring the impact of patient portals: What the Literature Tells Us. California HealthCare Foundation; 2011. Accessed June 20, 2023 at: http://resource.nlm.nih.gov/101567346
• 12 Ammenwerth E, Schnell-Inderst P, Hoerbst A. Patient empowerment by electronic health records: first results of a systematic review on the benefit of patient portals. Stud Health Technol Inform 2011; 165: 63-67
• 13 Otte-Trojel T, de Bont A, Rundall TG, van de Klundert J. How outcomes are achieved through patient portals: a realist review. J Am Med Inform Assoc 2014; 21 (04) 751-757
• 14 Tapuria A, Porat T, Kalra D, Dsouza G, Xiaohui S, Curcin V. Impact of patient access to their electronic health record: systematic review. Inform Health Soc Care 2021; 46 (02) 192-204
• 15 Ammenwerth E, Neyer S, Hörbst A, Mueller G, Siebert U, Schnell-Inderst P. Adult patient access to electronic health records. Cochrane Database Syst Rev 2021; 2 (02) CD012707
• 16 Abd-Alrazaq AA, Bewick BM, Farragher T, Gardner P. Factors that affect the use of electronic personal health records among patients: a systematic review. Int J Med Inform 2019; 126: 164-175
• 17 Or CKL, Karsh BT. A systematic review of patient acceptance of consumer health information technology. J Am Med Inform Assoc 2009; 16 (04) 550-560
• 18 Jabour A, Jones JF. Facilitators and barriers to patients' engagements with personal health records: systematic review. UAHCI2013, Part III. LNCS, Vol 8011. Heidelberg: Springer; 2013: 472-481
• 19 Kim K, Nahm E. Benefits of and barriers to the use of personal health records (PHR) for health management among adults. Online J Nurs Inform 2012; 16 (03) 1-9
• 20 Niazkhani Z, Toni E, Cheshmekaboodi M, Georgiou A, Pirnejad H. Barriers to patient, provider, and caregiver adoption and use of electronic personal health records in chronic care: a systematic review. BMC Med Inform Decis Mak 2020; 20 (01) 153
• 21 Schwarz J, Bärkås A, Blease C. et al. Sharing clinical notes and electronic health records with people affected by mental health conditions: scoping review. JMIR Ment Health 2021; 8 (12) e34170
• 22 Irizarry T, DeVito Dabbs A, Curran CR. Patient portals and patient engagement: a state of the science review. J Med Internet Res 2015; 17 (06) e148
• 23 Lyles CR, Nelson EC, Frampton S, Dykes PC, Cemballi AG, Sarkar U. Using electronic health record portals to improve patient engagement: Research priorities and best practices. Ann Intern Med 2020; 172 (11, Suppl): S123-S129
• 24 Grossman LV, Masterson Creber RM, Benda NC, Wright D, Vawdrey DK, Ancker JS. Interventions to increase patient portal use in vulnerable populations: a systematic review. J Am Med Inform Assoc 2019; 26 (8–9): 855-870
• 25 Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J 2009; 26 (02) 91-108
• 26 Boyatzis RE. Transforming Qualitative Information: Thematic Analysis and Code Development. Thousand Oaks, CA: Sage Publications; 1998
• 27 Do the information blocking regulations (45 CFR Part 171) require actors to proactively make electronic health information (EHI) available through “patient portals,” application programming interfaces (API), or other health information technology? Accessed February 16, 2023 at: https://www.healthit.gov/faq/do-information-blocking-regulations-45-cfr-part-171-require-actors-proactively-make-electronic
• 28 Steitz BD, Sulieman L, Wright A, Rosenbloom ST. Association of immediate release of test results to patients with implications for clinical workflow. JAMA Netw Open 2021; 4 (10) e2129553
• 29 Janssen SL, Venema-Taat N, Medlock S. Anticipated benefits and concerns of sharing hospital outpatient visit notes with patients (Open Notes) in Dutch hospitals: mixed methods study. J Med Internet Res 2021; 23 (08) e27764
• 30 Bruno B, Steele S, Carbone J, Schneider K, Posk L, Rose SL. Informed or anxious: patient preferences for release of test results of increasing sensitivity on electronic patient portals. Health Technol (Berl) 2022; 12 (01) 59-67
• 31 van Rijt AM, Hulter P, Weggelaar-Jansen AM, Ahaus K, Pluut B. Mental health care professionals' appraisal of patients' use of web-based access to their electronic health record: qualitative study. J Med Internet Res 2021; 23 (08) e28045
• 32 Murugan A, Gooding H, Greenbaum J. et al. Lessons learned from OpenNotes learning mode and subsequent implementation across a pediatric health system. Appl Clin Inform 2022; 13 (01) 113-122
• 33 Sangal RB, Powers E, Rothenberg C. et al. Disparities in accessing and reading Open Notes in the emergency department upon implementation of the 21st Century CURES Act. Ann Emerg Med 2021; 78 (05) 593-598
• 34 Parsons CR, Hron JD, Bourgeois FC. Preserving privacy for pediatric patients and families: use of confidential note types in pediatric ambulatory care. J Am Med Inform Assoc 2020; 27 (11) 1705-1710
• 35 Blok AC, Amante DJ, Hogan TP. et al. Impact of patient access to online VA notes on healthcare utilization and clinician documentation: a retrospective cohort study. J Gen Intern Med 2021; 36 (03) 592-599
• 36 Jackson SL, Shucard H, Liao JM. et al. Care partners reading patients' visit notes via patient portals: characteristics and perceptions. Patient Educ Couns 2022; 105 (02) 290-296
• 37 DesRoches CM, Salmi L, Dong Z, Blease C. How do older patients with chronic conditions view reading open visit notes?. J Am Geriatr Soc 2021; 69 (12) 3497-3506
• 38 Sarabu C, Lee T, Hogan A, Pageler N. The value of OpenNotes for pediatric patients, their families and impact on the patient-physician relationship. Appl Clin Inform 2021; 12 (01) 76-81
• 39 Steitz BD, Turer RW, Lin CT. et al. Perspectives of patients about immediate access to test results through an online patient portal. JAMA Netw Open 2023; 6 (03) e233572
• 40 Bell SK, Folcarelli P, Fossa A. et al. Tackling ambulatory safety risks through patient engagement: what 10,000 patients and families say about safety-related knowledge, behaviors, and attitudes after reading visit notes. J Patient Saf 2021; 17 (08) e791-e799
• 41 Lam BD, Bourgeois F, Dong ZJ, Bell SK. Speaking up about patient-perceived serious visit note errors: patient and family experiences and recommendations. J Am Med Inform Assoc 2021; 28 (04) 685-694
• 42 Turer RW, DesRoches CM, Salmi L, Helmer T, Rosenbloom ST. Patient perceptions of receiving COVID-19 test results via an online patient portal: an open results survey. Appl Clin Inform 2021; 12 (04) 954-959
• 43 Chimowitz H, Gerard M, Fossa A, Bourgeois F, Bell SK. Empowering informal caregivers with health information: OpenNotes as a safety strategy. Jt Comm J Qual Patient Saf 2018; 44 (03) 130-136
• 44 Kemp J, Short R, Bryant S, Sample L, Befera N. Patient-friendly radiology reporting-implementation and outcomes. J Am Coll Radiol 2022; 19 (2, Pt B): 377-383
• 45 van Mens HJT, van Eysden MM, Nienhuis R, van Delden JJM, de Keizer NF, Cornet R. Evaluation of lexical clarification by patients reading their clinical notes: a quasi-experimental interview study. BMC Med Inform Decis Mak 2020; 20 (Suppl. 10) 278
• 46 Walker J, Leveille S, Kriegel G. et al. Patients contributing to visit notes: mixed methods evaluation of OurNotes. J Med Internet Res 2021; 23 (11) e29951
• 47 Hoffman PE, London YR, Weerakoon TS, DeLucia NL. Rapidly scaling video visits during COVID-19: The ethos of virtual care at Yale Medicine. Healthc (Amst) 2020; 8 (04) 100482
• 48 Kummer BR, Sweetnam C, Vickrey BG. et al. Teleneurology expansion in response to the COVID-19 outbreak at a tertiary health system in New York City. Neurol Clin Pract 2021; 11 (02) e102-e111
• 49 Tan-McGrory A, Schwamm LH, Kirwan C, Betancourt JR, Barreto EA. Addressing virtual care disparities for patients with limited English proficiency. Am J Manag Care 2022; 28 (01) 36-40
• 50 Touson JC, Azad N, Beirne J. et al. Application of the consolidated framework for implementation research model to design and implement an optimization methodology within an ambulatory setting. Appl Clin Inform 2022; 13 (01) 123-131
• 51 Simon GE, Stewart CC, Gary MC, Richards JE. Detecting and assessing suicide ideation during the COVID-19 pandemic. Jt Comm J Qual Patient Saf 2021; 47 (07) 452-457
• 52 Touson JC, Azad N, Depue C, Crimmins T, Long R. An application of Harrison's system theory model to spark a rapid telehealth expansion in the time of COVID-19. Learn Health Syst 2020; 5 (01) e10239
• 53 Patel PD, Cobb J, Wright D. et al. Rapid development of telehealth capabilities within pediatric patient portal infrastructure for COVID-19 care: barriers, solutions, results. J Am Med Inform Assoc 2020; 27 (07) 1116-1120
• 54 Lamba AH, Muralidhar K, Jain A. et al. Characteristics of women enrolled in a patient portal intervention for menopause. Womens Health Rep (New Rochelle) 2020; 1 (01) 500-510
• 55 Gmunder KN, Ruiz JW, Franceschi D, Suarez MM. Factors to effective telemedicine visits during the COVID-19 pandemic: cohort study. JMIR Med Inform 2021; 9 (08) e27977
• 56 Francke JA, Groden P, Ferrer C. et al. Remote enrollment into a telehealth-delivering patient portal: barriers faced in an urban population during the COVID-19 pandemic. Health Technol (Berl) 2022; 12 (01) 227-238
• 57 Leader AE, Capparella LM, Waldman LB. et al. Digital literacy at an urban cancer center: implications for technology use and vulnerable patients. JCO Clin Cancer Inform 2021; 5: 872-880
• 58 Zachrison KS, Yan Z, Sequist T. et al. Patient characteristics associated with the successful transition to virtual care: lessons learned from the first million patients. J Telemed Telecare 2021; (e-pub ahead of print). DOI: 10.1177/1357633X211015547.
• 59 Davis K, Wilbur K, Metzger S. et al. Symptom and needs assessment screening in oncology patients: alternate outreach methods during COVID-19. J Psychosoc Oncol 2021; 39 (03) 452-460
• 60 Tashkandi E, BaAbdullah M, Zeeneldin A. et al. Optimizing the communication with cancer patients during the COVID-19 pandemic: patient perspectives. Patient Prefer Adherence 2020; 14: 1205-1212
• 61 Eberly LA, Sanghavi M, Julien HM, Burger L, Chokshi N, Lewey J. Evaluation of online patient portal vs text-based blood pressure monitoring among black patients with medicaid and medicare insurance who have hypertension and cardiovascular disease. JAMA Netw Open 2022; 5 (02) e2144255
• 62 Yue H, Mail V, DiSalvo M, Borba C, Piechniczek-Buczek J, Yule A. Patient preferences for patient portal-based telepsychiatry in a safety-net hospital setting during COVID-19: a cross-sectional study. JMIR Form Res 2022; 6 (01) e33697
• 63 Cher BAY, Wilson EA, Pinsky AM. et al. Utility of a telephone triage hotline in response to the covid-19 pandemic: longitudinal observational study. J Med Internet Res 2021; 23 (11) e28105
• 64 Judson TJ, Odisho AY, Neinstein AB. et al. Rapid design and implementation of an integrated patient self-triage and self-scheduling tool for COVID-19. J Am Med Inform Assoc 2020; 27 (06) 860-866
• 65 Fritz BA, Ramsey B, Taylor D. et al. Association of race and neighborhood disadvantage with patient engagement in a home-based COVID-19 remote monitoring program. J Gen Intern Med 2022; 37 (04) 838-846
• 66 Chang G, Doshi A, Chandarana H, Recht M. Impact of COVID-19 workflow changes on patient throughput at outpatient imaging centers. Acad Radiol 2021; 28 (03) 297-306
• 67 Pairawan SS, Olmedo Temich L, de Armas S. et al. Recovery of screening mammogram cancellations during COVID-19. Am Surg 2021; 87 (10) 1651-1655
• 68 Thorakkattil SA, Parakkal SA, Abushoumi F. et al. Online patient portal-based management of medication renewal and refill pickup in ambulatory care settings: a retrospective utilization study at tertiary care hospital in Saudi Arabia. Saudi Pharm J 2022; 30 (01) 45-52
• 69 Huang M, Khurana A, Mastorakos G. et al. Patient asynchronous response to coronavirus disease 2019 (COVID-19): a retrospective analysis of patient portal messages. JMIR Human Factors 2022; 9 (02) e35187
• 70 Portz JD, Brungardt A, Shanbhag P. et al. Advance care planning among users of a patient portal during the COVID-19 pandemic: retrospective observational study. J Med Internet Res 2020; 22 (08) e21385
• 71 Blundell AR, Kroshinsky D, Hawryluk EB, Das S. Disparities in telemedicine access for Spanish-speaking patients during the COVID-19 crisis. Pediatr Dermatol 2021; 38 (04) 947-949
• 72 Frydman JL, Berkalieva A, Liu B, Scarborough BM, Mazumdar M, Smith CB. Telemedicine utilization in the ambulatory palliative care setting: are there disparities?. J Pain Symptom Manage 2022; 63 (03) 423-429
• 73 Hsiao V, Chandereng T, Lankton RL. et al. Disparities in telemedicine access: a cross-sectional study of a newly established infrastructure during the COVID-19 pandemic. Appl Clin Inform 2021; 12 (03) 445-458
• 74 Wolff JL, Kim VS, Mintz S, Stametz R, Griffin JM. An environmental scan of shared access to patient portals. J Am Med Inform Assoc 2018; 25 (04) 408-412
• 75 Szilagyi PG, Valderrama R, Vangala S. et al. Pediatric patient portal use in one health system. J Am Med Inform Assoc 2020; 27 (03) 444-448
• 76 Steitz BD, Wong JIS, Cobb JG, Carlson B, Smith G, Rosenbloom ST. Policies and procedures governing patient portal use at an academic medical center. JAMIA Open 2019; 2 (04) 479-488
• 77 Dickman Portz J, Powers JD, Casillas A. et al. Characteristics of patients and proxy caregivers using patient portals in the setting of serious illness and end of life. J Palliat Med 2021; 24 (11) 1697-1704
• 78 Ramirez-Zohfeld V, Seltzer A, Xiong L, Morse L, Lindquist LA. Use of electronic health records by older adults, 85 years and older, and their caregivers. J Am Geriatr Soc 2020; 68 (05) 1078-1082
• 79 Semere W, Crossley S, Karter AJ. et al. Secure messaging with physicians by proxies for patients with diabetes: findings from the ECLIPPSE study. J Gen Intern Med 2019; 34 (11) 2490-2496
• 80 Price-Haywood EG, Harden-Barrios J, Ulep R, Luo Q. eHealth literacy: patient engagement in identifying strategies to encourage use of patient portals among older adults. Popul Health Manag 2017; 20 (06) 486-494
• 81 Latulipe C, Quandt SA, Melius KA. et al. Insights into older adult patient concerns around the caregiver proxy portal use: qualitative interview study. J Med Internet Res 2018; 20 (11) e10524
• 82 Pecina J, Duvall MJ, North F. Frequency of and factors associated with care partner proxy interaction with health care teams using patient portal accounts. Telemed J E Health 2020; 26 (11) 1368-1372
• 83 Hodgson J, Welch M, Tucker E, Forbes T, Pye J. Utilization of EHR to improve support person engagement in health care for patients with chronic conditions. J Patient Exp 2022; 9: 23 743735221077528
• 84 Ordaz OH, Croff RL, Robinson LD, Shea SA, Bowles NP. Optimization of primary care among black Americans using patient portals: qualitative study. J Med Internet Res 2021; 23 (06) e27820
• 85 Latulipe C, Mazumder SF, Wilson RKW. et al. Security and privacy risks associated with adult patient portal accounts in US hospitals. JAMA Intern Med 2020; 180 (06) 845-849
• 86 Ali SB, Romero J, Morrison K, Hafeez B, Ancker JS. Focus section health IT usability: applying a task-technology fit model to adapt an electronic patient portal for patient work. Appl Clin Inform 2018; 9 (01) 174-184
• 87 Foster B, Krasowski MD. The use of an electronic health record patient portal to access diagnostic test results by emergency patients at an academic medical center: retrospective study. J Med Internet Res 2019; 21 (06) e13791
• 88 Krasowski MD, Grieme CV, Cassady B. et al. Variation in results release and patient portal access to diagnostic test results at an academic medical center. J Pathol Inform 2017; 8 (01) 45
• 89 Richwine C, Johnson C, Patel V. Disparities in patient portal access and the role of providers in encouraging access and use. J Am Med Inform Assoc 2023; 30 (02) 308-317
• 90 El-Toukhy S, Méndez A, Collins S, Pérez-Stable EJ. Barriers to patient portal access and use: evidence from the health information national trends survey. J Am Board Fam Med 2020; 33 (06) 953-968
• 91 Clarke MA, Lyden ER, Ma J. et al. Sociodemographic differences and factors affecting patient portal utilization. J Racial Ethn Health Disparities 2021; 8 (04) 879-891
• 92 Varady NH, d'Amonville S, Chen AF. Electronic patient portal use in orthopaedic surgery is associated with disparities, improved satisfaction, and lower no-show rates. J Bone Joint Surg Am 2020; 102 (15) 1336-1343
• 93 Wood KE, Greene HR, Krasowski MD. Patient portal activation and use in hospitalized children at an academic medical center. Hosp Pediatr 2021; 11 (06) 587-594
• 94 Matthews EB, Savoy M, Paranjape A. et al. Acceptability of health information exchange and patient portal use in depression care among underrepresented patients. J Gen Intern Med 2022; 37 (15) 3947-3955
• 95 Jackman KP, Hightow-Weidman L, Poteat T, Wirtz AL, Kane JC, Baral SD. Evaluating psychometric determinants of willingness to adopt sexual health patient portal services among black college students: a mixed-methods approach. J Am Coll Health 2021; 69 (02) 190-197
• 96 Griffin AC, Troszak LK, Van Campen J, Midboe AM, Zulman DM. Tablet distribution to veterans: an opportunity to increase patient portal adoption and use. J Am Med Inform Assoc 2022; 30 (01) 73-82
• 97 Casillas A, Abhat A, Mahajan A. et al. Portals of change: how patient portals will ultimately work for safety net populations. J Med Internet Res 2020; 22 (10) e16835
• 98 Shimada SL, Zocchi MS, Hogan TP. et al. Impact of patient-clinical team secure messaging on communication patterns and patient experience: Randomized encouragement design trial. J Med Internet Res 2020; 22 (11) e22307
• 99 Cakiroglu B, Kaya C, Kilic HH, Aksoy SH, Gözüküçük R. Did COVID-19 area change our urology practice: a retrospective analysis. Urologia 2022; 89 (02) 149-152
• 100 Peeler A, Miller H, Ogungbe O. et al. Centralized registry for COVID-19 research recruitment: design, development, implementation, and preliminary results. J Clin Transl Sci 2021; 5 (01) e152
• 101 Speaker SL, Doherty CM, Pfoh E. et al. Social behaviors associated with a positive COVID-19 test result. Cureus 2021; 13 (02) e13064
• 102 Bachtiger P, Adamson A, Chow JJ, Sisodia R, Quint JK, Peters NS. The impact of the COVID-19 pandemic on the uptake of influenza vaccine: UK-wide observational study. JMIR Public Health Surveill 2021; 7 (04) e26734
• 103 Bachtiger P, Adamson A, Maclean WA, Kelshiker MA, Quint JK, Peters NS. Determinants of shielding behavior during the covid-19 pandemic and associations with well-being among national health service patients: longitudinal observational study. JMIR Public Health Surveill 2021; 7 (09) e30460
• 104 Herman HS, Rosenthaler MP, Elhassan N, Weinberg JM, Satyam VR, Wasan SK. COVID-19 vaccine hesitancy among patients with inflammatory bowel diseases at a diverse safety net hospital. Dig Dis Sci 2022; 67 (11) 5029-5033
• 105 Shermohammed M, Goren A, Lanyado A. et al. Informing patients that they are at high risk for serious complications of viral infection increases vaccination rates. medRxiv 2021
• 106 McDonald S, Basit MA, Toomay S. et al. Rolling up the sleeve: equitable, efficient, and safe COVID-19 mass immunization for academic medical center employees. Appl Clin Inform 2021; 12 (05) 1074-1081
• 107 Casacchia NJ, Rosenthal GE, O'Connell NS. et al. Characteristics of adult primary care patients who use the patient portal: a cross-sectional analysis. Appl Clin Inform 2022; 13 (05) 1053-1062
• 108 Sarkar U, Karter AJ, Liu JY. et al. Social disparities in internet patient portal use in diabetes: evidence that the digital divide extends beyond access. J Am Med Inform Assoc 2011; 18 (03) 318-321
• 109 Swoboda CM, DePuccio MJ, Fareed N, McAlearney AS, Walker DM. Patient portals: useful for whom and for what? A cross-sectional analysis of national survey data. Appl Clin Inform 2021; 12 (03) 573-581
• 110 Tsai R, Bell III EJ, Woo H, Baldwin K, Pfeffer MA. How patients use a patient portal: an institutional case study of demographics and usage patterns. Appl Clin Inform 2019; 10 (01) 96-102
• 111 Bush RA, Vemulakonda VM, Richardson AC, Deakyne Davies SJ, Chiang GJ. Providing access: differences in pediatric portal activation begin at patient check-in. Appl Clin Inform 2019; 10 (04) 670-678
• 112 Tieu L, Schillinger D, Sarkar U. et al. Online patient websites for electronic health record access among vulnerable populations: portals to nowhere?. J Am Med Inform Assoc 2017; 24 (e1): e47-e54
• 113 Ancker JS, Nosal S, Hauser D, Way C, Calman N. Access policy and the digital divide in patient access to medical records. Health Policy Technol 2017; 6 (01) 3-11
• 114 Turer RW, Martin KR, Courtney DM. et al. Real-time patient portal use among emergency department patients: an open results study. Appl Clin Inform 2022; 13 (05) 1123-1130
• 115 van Mens HJT, Hannen GEG, Nienhuis R, Bolt RJ, de Keizer NF, Cornet R. Evaluation of patient-friendly diagnosis clarifications in a hospital patient portal. Appl Clin Inform 2023; 14 (03) 455-464
• 116 Armstrong M, Benda NC, Seier K. et al. Improving cancer care communication: identifying sociodemographic differences in patient portal secure messages not authored by the patient. Appl Clin Inform 2023; 14 (02) 296-299
• 117 Di Tosto G, Walker DM, Sieck CJ. et al. Examining the relationship between health literacy, health numeracy, and patient portal use. Appl Clin Inform 2022; 13 (03) 692-699
• 118 Brewster RCL, Zhang J, Stewart M, Kaur R, Arellano M, Bourgeois F. A prescription for internet: feasibility of a tablet loaner program to address digital health inequities. Appl Clin Inform 2023; 14 (02) 273-278
• 119 Chang JE, Lindenfeld Z, Albert SL. et al. Telephone vs. video visits during COVID-19: safety-net provider perspectives. J Am Board Fam Med 2021; 34 (06) 1103-1114
• 120 DesRoches C, Walker J, Delbanco T. US experience with transparent medical records should reassure doctors. BMJ 2022; 379: o2969
• 121 Reynolds TL, Zhang J, Zheng K, Chen Y. Unpacking the use of laboratory test results in an online health community throughout the medical care trajectory. In: Proceedings of the ACM on Human-Computer Interaction. 2021 ;6(CSCW2): 1-32
• 122 Martinez W, Hackstadt AJ, Hickson GB. et al. The my diabetes care patient portal intervention: usability and pre-post assessment. Appl Clin Inform 2021; 12 (03) 539-550
• 123 Sarkar U, Karter AJ, Liu JY. et al. The literacy divide: health literacy and the use of an internet-based patient portal in an integrated health system-results from the diabetes study of northern California (DISTANCE). J Health Commun 2010; 15 (Suppl [phone]
• 124 Tulu B, Strong D, Johnson S, Bar-On I, Trudel J, Garber L. Personal health records: identifying utilization patterns from system use logs and patient interviews. 45th Hawaii International Conference on System Sciences. 2012: 2716-2725 ; Maui, HI 2012
• 125 Nielsen AS, Halamka JD, Kinkel RP. Internet portal use in an academic multiple sclerosis center. J Am Med Inform Assoc 2012; 19 (01) 128-133
• 126 Gerber DE, Laccetti AL, Chen B. et al. Predictors and intensity of online access to electronic medical records among patients with cancer. J Oncol Pract 2014; 10 (05) e307-e312
• 127 Weingart SN, Rind D, Tofias Z, Sands DZ. Who uses the patient internet portal? The PatientSite experience. J Am Med Inform Assoc 2006; 13 (01) 91-95
• 128 Sue VM, Griffin MT, Allen JY. Individual characteristics associated with PHR use in an integrated care organization. In: Proceedings of the Annual Hawaii International Conference on System Sciences. IEEE; 2011: 1-9
• 129 Wiljer D, Leonard KJ, Urowitz S. et al. The anxious wait: assessing the impact of patient accessible EHRs for breast cancer patients. BMC Med Inform Decis Mak 2010; 10 (01) 46
• 130 Ralston JD, Carrell D, Reid R, Anderson M, Moran M, Hereford J. Patient web services integrated with a shared medical record: patient use and satisfaction. J Am Med Inform Assoc 2007; 14 (06) 798-806
• 131 Dalal AK, Dykes PC, Collins S. et al. A web-based, patient-centered toolkit to engage patients and caregivers in the acute care setting: a preliminary evaluation. J Am Med Inform Assoc 2016; 23 (01) 80-87
• 132 Alpert JM, Krist AH, Aycock RA, Kreps GL. Applying multiple methods to comprehensively evaluate a patient portal's effectiveness to convey information to patients. J Med Internet Res 2016; 18 (05) e112
• 133 Jhamb M, Cavanaugh KL, Bian A. et al. Disparities in electronic health record patient portal use in nephrology clinics. Clin J Am Soc Nephrol 2015; 10 (11) 2013-2022
• 134 Kelly MM, Hoonakker PLT, Dean SM. Using an inpatient portal to engage families in pediatric hospital care. J Am Med Inform Assoc 2017; 24 (01) 153-161
• 135 Griffin A, Skinner A, Thornhill J, Weinberger M. Patient portals: who uses them? What features do they use? And do they reduce hospital readmissions?. Appl Clin Inform 2016; 7 (02) 489-501
• 136 Neuner J, Fedders M, Caravella M, Bradford L, Schapira M. Meaningful use and the patient portal: patient enrollment, use, and satisfaction with patient portals at a later-adopting center. Am J Med Qual 2015; 30 (02) 105-113
• 137 Kahn JS, Hilton JF, Van Nunnery T. et al. Personal health records in a public hospital: experience at the HIV/AIDS clinic at San Francisco General Hospital. J Am Med Inform Assoc 2010; 17 (02) 224-228
• 138 Tenforde M, Nowacki A, Jain A, Hickner J. The association between personal health record use and diabetes quality measures. J Gen Intern Med 2012; 27 (04) 420-424
• 139 Tom JO, Chen C, Zhou YY. Personal health record use and association with immunizations and well-child care visits recommendations. J Pediatr 2014; 164 (01) 112-117
• 140 Osborn CY, Rosenbloom ST, Stenner SP. et al. MyHealthAtVanderbilt: policies and procedures governing patient portal functionality. J Am Med Inform Assoc 2011; 18 (Suppl. 01) i18-i23
• 141 Ketterer T, West DW, Sanders VP, Hossain J, Kondo MC, Sharif I. Correlates of patient portal enrollment and activation in primary care pediatrics. Acad Pediatr 2013; 13 (03) 264-271
• 142 Perzynski AT, Roach MJ, Shick S. et al. Patient portals and broadband internet inequality. J Am Med Inform Assoc 2017; 24 (05) 927-932
• 143 Steitz B, Cronin RM, Davis SE, Yan E, Jackson GP. Long-term patterns of patient portal use for pediatric patients at an academic medical center. Appl Clin Inform 2017; 8 (03) 779-793
• 144 Reynolds TL, Ali N, McGregor E. et al. Understanding patient questions about their medical records in an online health forum: opportunity for patient portal design. AMIA Annu Symp Proc 2017; 2017: 1468-1477
• 145 Sun S, Zhou X, Denny JC, Rosenbloom T, Xu H. Understanding patient-provider communication entered via a patient portal system. Proc Am Soc Inf Sci Technol 2012; 49 (01) 1-4
• 146 Zhang Z, Lu Y, Kou Y, Wu DTY, Huh-Yoo J, He Z. Understanding patient information needs about their clinical laboratory results: a study of social Q&A site. Stud Health Technol Inform 2019; 264: 1403-1407
• 147 Mishra VK, Hoyt RE, Wolver SE, Yoshihashi A, Banas C. Qualitative and quantitative analysis of patients' perceptions of the patient portal experience with OpenNotes. Appl Clin Inform 2019; 10 (01) 10-18
• 148 Gleason KT, Peereboom D, Wec A, Wolff JL. Patient portals to support care partner engagement in adolescent and adult populations: a scoping review. JAMA Netw Open 2022; 5 (12) e2248696
• 149 Xie J, Hogan A, McPherson T, Pageler N, Lee T, Carlson J. Creating a guardrail system to ensure appropriate activation of adolescent portal accounts. Appl Clin Inform 2023; 14 (02) 258-262
• 150 Adler-Milstein J, Longhurst C. Assessment of patient use of a new approach to access health record data among 12 US health systems. JAMA Netw Open 2019; 2 (08) e199544
• 151 Reynolds TL, Kaligotla M, Zheng K. Investigating the interoperable health app ecosystem at the start of the 21st Century Cures Act. AMIA Annu Symp Proc 2023; 2022: 942-951
• 152 Tom JO, Mangione-Smith R, Solomon C, Grossman DC. Integrated personal health record use: association with parent-reported care experiences. Pediatrics 2012; 130 (01) e183-e190
• 153 Emani S, Healey M, Ting DY. et al. Awareness and use of the after-Visit summary through a patient portal: evaluation of patient characteristics and an application of the theory of planned behavior. J Med Internet Res 2016; 18 (04) e77
• 154 O'Leary KJ, Sharma RK, Killarney A. et al. Patients' and healthcare providers' perceptions of a mobile portal application for hospitalized patients. BMC Med Inform Decis Mak 2016; 16 (01) 123
• 155 Bush RA, Stahmer AC, Connelly CD. Exploring perceptions and use of the electronic health record by parents of children with autism spectrum disorder: a qualitative study. Health Informatics J 2016; 22 (03) 702-711
• 156 Bose-Brill S, Kretovics M, Ballenger T. et al. Development of a tethered personal health record framework for early end-of-life discussions. Am J Manag Care 2016; 22 (06) 412-418
• 157 Hess R, Bryce CL, Paone S. et al. Exploring challenges and potentials of personal health records in diabetes self-management: implementation and initial assessment. Telemed J E Health 2007; 13 (05) 509-517
• 158 Nazi KM, Turvey CL, Klein DM, Hogan TP, Woods SS. VA OpenNotes: exploring the experiences of early patient adopters with access to clinical notes. J Am Med Inform Assoc 2015; 22 (02) 380-389
• 159 Haun JN, Lind JD, Shimada SL. et al. Evaluating user experiences of the secure messaging tool on the Veterans Affairs' patient portal system. J Med Internet Res 2014; 16 (03) e75
• 160 Wilcox L, Woollen J, Prey J. et al. Interactive tools for inpatient medication tracking: a multi-phase study with cardiothoracic surgery patients. J Am Med Inform Assoc 2016; 23 (01) 144-158
• 161 Byczkowski TL, Munafo JK, Britto MT. Family perceptions of the usability and value of chronic disease web-based patient portals. Health Informatics J 2014; 20 (02) 151-162
• 162 Makai P, Perry M, Robben SH. et al. Which frail older patients use online health communities and why? A mixed methods process evaluation of use of the Health and Welfare portal. J Med Internet Res 2014; 16 (12) e278
• 163 Turner A, Osterhage K, Joe J, Hartzler A, Lin L, Demiris G. Use of Patient Portals: Personal Health Information Management in Older Adults. In: Vol 216. Studies in Health Technology and Informatics.; 2015:978. DOI: 10.3233/978-1-61499-564-7-978
• 164 Balogun ZA, Reynolds TL. Patient Portal Adoption, Use, and Satisfaction among U.S. Adults in Late-stage COVID-19 Pandemic. Paper presented at: 2022 IEEE 10th International Conference on Healthcare Informatics (ICHI), Rochester, MN, USA. 2022:384–392