Patients' Adoption of and Feature Access Within Electronic Patient Portals

ABSTRACT

Objectives: We describe online portal account adoption and feature access among subgroups of patients who traditionally have been disadvantaged or represent those with high healthcare needs.

Study Design: Retrospective cohort study of insured primary care patients 18 years and older (N = 20,282) receiving care from an integrated health system.

Methods: Using data from an electronic health record repository, portal adoption was defined by 1 or more online sessions. Feature access (ie, messaging, appointment management, visit/admission summaries, and medical record access and management) was defined by user-initiated “clicks.” Multivariable regression methods were used to identify patient factors associated with portal adoption and feature access among adopters.

Results: One-third of patients were portal adopters, with African Americans (odds ratio [OR], 0.50; 95% CI, 0.46-0.56), Hispanics (OR, 0.63; 95% CI, 0.47-0.84), those 70 years and older (OR, 0.48; 95% CI, 0.44-0.52), and those preferring a language other than English (OR, 0.43; 95% CI, 0.31-0.59) less likely to be adopters. On the other hand, the likelihood of portal adoption increased with a higher number of comorbidities (OR, 1.04; 95% CI, 1.02-1.07). Among adopters, record access and management features (95.9%) were accessed most commonly. The majority of adopters also accessed appointment management (76.6%) and messaging (59.1%) features. Similar race and age disparities were found in feature access among adopters.

Conclusions: The diversity of portal features accessed may bode well for the ability of portals to engage some patients, but without purposeful intervention, reliance on portals alone for patient engagement may exacerbate known social disparities—even among those with an activated portal account.

Am J Manag Care. 2018;24(11):e352-e357Takeaway Points

Healthcare organizations are increasingly using online portals to engage patients and enhance access to health information. Our findings illustrate that focusing on improving the diversity of the population that has an activated portal account alone may not be enough to prevent disparities. We found disparities not only in who adopted portal technology but also in which features were accessed by those with an activated portal account.

• African Americans, Hispanics, those 70 years and older, and those preferring a non-English language were significantly less likely to be portal adopters.
• Compared with white portal adopters, African American portal adopters were less likely to access each of the portal features evaluated.
• Portal adopters who were 70 years and older were less likely to access most portal features, including those that were more interactive.

Since 2011, CMS has provided financial incentives to healthcare providers who implement and “meaningfully use” certified health information technology. Incentives to date have focused on providing patients the ability to view, download, and transfer data electronically. Although the incentives do not specify how organizations are to meet these criteria, most primary care practices and other healthcare delivery organizations have chosen to purchase electronic health records (EHRs) and accompanying patient portal software to meet these requirements.^1,2 Neither how these online portals are being adopted nor their potential influence on known health disparities has been fully explored.

In most primary care practices, patient portals enable users to view personal health information, such as laboratory test results, discharge summaries, and notes from recent visits, thus fulfilling the CMS requirement to view, download, and transfer data electronically.^3,4 In some practices, portal users can also schedule appointments and refill prescriptions or send other secure, unstructured messages to providers. Other practices enable users to record personal health information, such as allergies or preventive service use. Despite the array of functionalities that currently exist within commercially available patient portals, we know of just 2 studies that have examined which features adopters access once they have an activated portal account.^5,6 Thus, although studies repeatedly have found traditionally vulnerable populations less likely to be portal adopters as defined by account activation,^7-24 to our knowledge, just 1 prior study has reported findings specific to whether disparities exist in how those adopting portal technology engage with available health-related portal features once they have an activated account.⁸ It is important to understand whether disparities in health-related portal feature access exist among those who have an account, because portal technology is increasingly being used to target care delivery to those with specific chronic diseases.^21,25,26

We describe how a patient portal was initially used among an insured, sociodemographically diverse population receiving primary care within an integrated health system. This system was selected for its relatively early adoption of patient portal technology and for the comprehensiveness of portal features initially made available to patients. We report the extent to which members of traditionally disadvantaged subgroups of the population (ie, those from minority races, those for whom English is not a first language, and those of Hispanic ethnicity) and those known to have disproportionate health needs (ie, older patients and those with more comorbidities) had activated portal accounts (ie, were portal adopters). Among adopters, we further evaluate which health-related portal features were accessed. Of particular interest was the extent to which adopters accessed features that enable viewing test results and health history information versus accessing the more interactive features that allow adopters to manage and exchange health-related information. In doing so, we provide important information regarding the patient portal foundation upon which subsequent patient engagement capabilities are being built, and we identify subgroups at risk of being left behind as healthcare organizations increasingly rely on portal technology to enable patients to electronically view, download, and transmit their health information to a third party.

METHODS

Setting

The study was conducted in an integrated health system serving metropolitan Detroit, Michigan. The health system’s institutional review board approved all aspects of the study protocol. In 2012, the health system purchased an enterprise license for EpicCare EMR, a commercial medical record software program, and its accompanying patient portal, MyChart.²⁷ As originally implemented, patients seen in any of the health system’s 26 primary care clinics were able to use MyChart via a desktop computer, tablet, or mobile device to securely schedule appointments, receive appointment reminders, view test results, request prescription refills, view and manage information about their health, and send secure messages to care teams.

Portal implementation was a systemwide initiative, with patient- and clinician-targeted campaigns. Screen savers introducing MyChart were launched on examination room computers and other work­stations. Posters were placed in clinic elevators, clinician work areas, examination rooms, and waiting rooms. Informational brochures were available in all clinics. Each component of the campaign instructed patients on how to request a MyChart activation code via the health system’s website or call center. Activation codes were also included on patient discharge summaries. All clinical staff received MyChart training, and front desk staff were instructed to inquire about patients’ account activation status. Work processes were adjusted to prioritize answering patient portal messages over telephone messages.

Study Population

We identified patients 18 years or older enrolled in the health system’s affiliated health plan with at least 1 visit to their primary care physician between April 1, 2013, and March 31, 2014. Patients younger than 18 years, those without a primary care visit, and those with indeterminate portal activation status (eg, those with account information but no evidence of a session) were excluded.

Data Sources

Patient sociodemographic information, comorbidities, primary care visits, and portal activation information were obtained from the health system’s EHR data repository. These patient-level data were joined with clinic-level information available from health system administrative files.

Analytical Variables

“Portal adopters” activated their portal account and initiated at least 1 online session between December 1, 2012, and March 31, 2014. Among portal adopters, we examined which health-related portal features were accessed (ie, “clicked on”) between April 1, 2013, and March 31, 2014, in 4 categories: (1) messaging, (2) appointment management, (3) visit/admission summaries, and (4) medical record access and management. Adopters were considered to be users of the messaging feature if they (1) viewed electronic test result letters or other personal communications from their physician, (2) sent a message or viewed a response related to prescription refills, or (3) sent a message or viewed a response related to general medical advice. Those who reviewed their upcoming appointment information or accessed the appointment scheduling feature were considered to be users of the appointment management feature. Adopters who viewed outpatient visit summaries and/or inpatient admission summaries were deemed users of the visit/admission summaries feature. Finally, adopters who accessed the following features were considered to be users of the medical record access and management feature: test results, health summary, current health issues, medications, allergies, preventive care, medical history, immunizations, and/or home monitoring reports. We also constructed a binary variable (“interactive feature use”) that indicated whether the adopter had ever (vs never) clicked on a feature that enabled them to input information (eg, update health issues, update medications, update allergies, send a secure message to their doctor, or request a prescription renewal).

Of particular interest was whether portal adoption and feature access differed by patient race (African American vs white or other), ethnicity (Hispanic ethnicity vs not of Hispanic origin), or language preference (English vs other), or by health needs as defined by patient age or comorbidities. The latter was measured via the Deyo adaption of the Charlson Comorbidity Index (CCI), a diagnosis-based measure of a patient’s case mix that has been shown to be associated with subsequent mortality and resource use.²⁸

We also obtained information on patient gender (female/male), marital status (currently married vs other), and patients’ realized access to office-based primary care. The last was measured by whether the patient had a health maintenance exam visit (ie, “checkup”) and by the total number of primary care office visits within the 12-month study period. In addition to the patient-level variables, we controlled for 3 clinic-level factors that may affect portal adoption and feature use: the number of primary care physicians practicing at the clinic (a proxy for clinic size), whether medical students and/or residents saw patients at the clinic (ie, designated teaching facility), and whether the clinic was located within the city of Detroit (urban) or a surrounding area (suburb).

Statistical Analyses

A multivariable logistic regression model with random effects was fit using the PROC GLIMMIX procedure (SAS software, version 9.4 [SAS Institute Inc; Cary, North Carolina]) to test the role of the patient-level factors of interest in portal adoption status, controlling for other patient- and clinic-level factors. Patients were blocked by physician and nested within clinic, and the Laplace method was used for likelihood approximation. Among portal adopters, we report the percentage of patients accessing each of the 4 categories of portal features (messaging, appointment management, visit/admission summaries, and medical record access and management) as well as by whether or not an interactive feature was accessed. We used multivariable logistic regression to test the role of the same patient-level factors of interest in feature access, again controlling for other patient- and clinic-level factors. Because adopters’ feature access was not influenced by the clinic from which or physician from whom care was received (ie, interclass correlation coefficients <0.01), models were fit using PROC LOGISTIC (SAS version 9.4).

RESULTS

Portal Adoption

Table 1 describes the sociodemographic and other characteristics of the study population (N = 20,282). About one-third of study-eligible patients (32.6%) were portal adopters (n = 6621). The majority (92%) of adopters had at least 2 online sessions, and 86% had 3 or more sessions. Reflecting the relative newness of the portal’s availability, patients who were adopters had been using the portal for a mean (SD) of 8.9 (4.5) months, with 95% using their account for at least 1 month. Across the health system, patients’ portal adoption rates ranged from 6.8% to 64.9% among primary care clinics (interclass correlation, 0.067) with a mean (SD) of 32.7% (12.4%), and from 0% to 100% among primary care physicians (interclass correlation, 0.060) with a mean (SD) of 31.1% (20.2%). Prior to controlling for other factors, African Americans, those of Hispanic ethnicity, those preferring to use a non-English language, and those 70 years and older were substantially less likely to have an activated portal account (Table 1). It should be noted, however, that portal adoption among these vulnerable and relatively high—health-need populations varied substantially across physician panels and primary care clinics. For example, on some physician panels, as few as none (0.0%) of the African American patients had an activated portal account, whereas on others, all (100.0%) African American patients had a portal account. Similarly, at some clinics, as few as 4.5% of the African American patients receiving primary care from the clinic had an activated portal account, whereas at others, the percentage was as high as 52.9%. Similar variability at the physician panel and primary care clinic levels was seen for the other subgroups of interest.

Multivariable logistic regression model results comparing portal adopters with nonadopters are also presented in Table 1. After controlling for other factors, African American patients were half as likely as patients of other races to be portal adopters. Similarly, compared with patients aged 50 to 69 years, those 70 years and older were approximately half as likely to be portal adopters. Those of Hispanic ethnicity and with a preference for a non-English language were also significantly less likely to be portal adopters, whereas portal adoption was more likely among patients with higher CCI scores.

Portal Feature Access

Most adopters accessed portal features related to medical record access and management (95.9%) (Table 2), most often to obtain laboratory test results (91.7%). As depicted in Table 2, adopters also frequently accessed information on their current health issues (87.8%), medications (87.5%), immunizations (86.1%), allergies (86.0%), and health summaries (84.7%). The majority of adopters also accessed the appointment management features (76.6%), more frequently to review information on upcoming appointments (73.1%) than to schedule appointments (58.5%). Relatively fewer patients accessed the messaging features (59.1%), and within this category, access was evenly distributed across letters (35.5%), medical advice requests (31.7%), and medication renewal requests (31.3%). Fewer patients had accessed the visit/admission summary component (41.0%). Overall, 97.0% of portal adopters accessed at least 1 of the health-related features available within the portal, with 68.8% accessing at least 1 interactive feature.

Table 3 presents results from the 5 multivariable logistic regression models testing the association of the patient-level factors of interest with feature access. With the exception of accessing visit/admission summaries, patients of African American race were significantly and substantively less likely to have accessed each of the portal features. Similarly, with the exception of record access and management (which virtually all [95.9%] patients accessed), patients 70 years and older were also significantly and substantively less likely to have accessed each of the portal features. On the other hand, as a patient’s CCI score or number of primary care visits increased, so too did their likelihood of accessing the different portal features.

DISCUSSION

We found that approximately one-third of patients with a primary care visit were portal adopters, as defined by their having an activated portal account. Furthermore, the majority of portal adopters logged into their account multiple times and accessed a variety of features related to both viewing and inputting information. Together, these results illustrate the ability of patient portals to reach a large number of patients, particularly those who are already actively connected with a primary care provider.

Importantly, however, our results also underscore why efforts to enhance and ensure portal adoption as defined by account activation are likely to be insufficient: Our analyses point to disparities not only between those who activate and do not activate a portal account but also in how those with an active account access the features available within portals. Particularly concerning was the finding that African American and older patients were consistently least likely to have an activated portal account, and when they did, they were also least likely to access most portal features. The latter included being least likely to access the appointment management and messaging features—2 functionalities that are arguably critical to care access. The disparities in portal account activation that we observed are consistent with those now repeatedly found by others.^7-24 The findings of disparities in portal adoption, combined with the additional disparities in feature access among portal adopters that we and another study have shown,⁸ highlight the importance of providing alternative channels for vulnerable and traditionally less engaged patient populations to view and share their health information. Such a need is echoed by findings from a recent qualitative study that highlight the basic computer-related and other barriers that vulnerable populations experience once logged into a portal²⁹ and by a recent systematic review that highlights the role of health literacy in patients’ ability to accurately input and interpret information contained within portals.¹⁹

We identified wide variability in portal account activation by primary care physician panel and clinic—both overall and among traditionally high-need and vulnerable populations. Understanding the factors that underlie such variability was beyond the scope of the present study, but evidence from elsewhere would point to a diverse array of multilevel factors that may include everything from patients’ health and technological literacy and internet access to the characteristics and supportiveness of physicians and other care team members to the programs and support offered within the broader community.^19,30 Future studies should specifically explore the provider-, clinic-, system-, and community-level factors underlying this variability in portal use, as such studies may hold clues to innovative solutions for engaging and enabling the viewing and sharing of health information among hard-to-reach populations.³¹ What is clear is that there is likely not a universal patient portal solution for electronically capturing and sharing health information if the goal is the inclusion and engagement of all members of diverse primary care populations. Moving beyond this one-size-fits-all mentality is important in light of mounting evidence that patient adoption of and engagement with EHR-integrated portals can lead to improved outcomes among some patients, including treatment adherence and clinical outcomes among patients with diabetes and HIV.^{21,25,26,32-34}

Limitations

Our results should be interpreted with a number of study limitations in mind. First, to determine the types of portal features used by patients, we measured user clicks on the links to access specific portal features. Thus, our results are based on the links that patients activated and not time spent per se. Capturing use in this way is consistent with other studies⁹ but may nonetheless result in overestimates of patient feature use because some clicks may have been due to curious exploration and not actual engaged use. Second, although we were able to control for some clinic-level factors, because of the nature of our study methods and data, we were unable to control for some potentially important patient-level factors, such as education and income. We were also unable to determine the reasons behind patients’ adoption or nonadoption of the portal and specific portal features accessed. Understanding the multilevel and modifiable factors that contribute to observed patterns of portal adoption and feature access is a fruitful avenue for future research. In addition, the context for this research was 1 integrated health system that serves an urban/suburban Midwestern locale. As such, findings may not reflect patterns of portal adoption and feature access that are faced over the long term or by health systems serving other types of populations or based in other locations.

CONCLUSIONS

Our results underscore the opportunities and challenges that patient portals present. On the one hand, when integrated within EHRs, portals represent an exciting new frontier for information exchange between healthcare organizations and patients. As such, portal technology may be able to support patients’ health-related decision making and adherence to evidence-based care (and thereby health outcomes) beyond what traditional office visits alone can accomplish. On the other hand, our findings caution that without purposeful planning and integration, reliance on patient portals alone for engaging patients outside of office visits could inadvertently serve to exacerbate existing racial and other social disparities. Our findings therefore highlight not only the need to continually assess the reach and impact of patient portals on diverse populations but also a need to consider alternative channels and mechanisms for sharing health information and engaging patients beyond the walls of traditional office visits.

Acknowledgments

The views expressed herein are solely those of the authors and do not necessarily represent the views of the Department of Veterans Affairs or the US Government.Author Affiliations: UNC Eshelman School of Pharmacy (JEL) and Lineberger Comprehensive Cancer Center (JEL), University of North Carolina, Chapel Hill, NC; Henry Ford Health System (JEL, DAS, MS), Detroit, MI; Department of Health Behavior and Policy, School of Medicine, Virginia Commonwealth University (CAM), Richmond, VA; School of Social Work, Michigan State University (DAS), East Lansing, MI; Center for the Study of Healthcare Innovation, Implementation & Policy, VA Greater Los Angeles Healthcare System (KD), Los Angeles, CA; Department of Epidemiology and Population Health, UM School of Public Health, University of Michigan (SMR), Ann Arbor, MI.

Source of Funding: R01CA197205.

Prior Presentation: An early version of this manuscript was presented as an oral paper at the 14th International Conference on Communication in Healthcare, Heidelberg, Germany, September 2016.

Author Disclosures: The authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.

Authorship Information: Concept and design (JEL, KD, MS); acquisition of data (JEL, DAS, MS); analysis and interpretation of data (JEL, CAM, DAS, SMR); drafting of the manuscript (JEL, CAM, DAS, KD); critical revision of the manuscript for important intellectual content (JEL, DAS, KD, SMR, MS); statistical analysis (CAM, SMR); obtaining funding (JEL); administrative, technical, or logistic support (JEL); and supervision (JEL, MS).

Address Correspondence to: Jennifer Elston Lafata, PhD, UNC Eshelman School of Pharmacy, University of North Carolina, 301 Pharmacy Ln, 2214 Kerr Hall, CB #7573, Chapel Hill, NC 27599. Email: jel@mail.unc.edu.REFERENCES

1. Shay R. EHR adoption rates: 20 must-see stats. Practice Fusion website. practicefusion.com/blog/ehr-adoption-rates. Published March 1, 2017. Accessed November 16, 2016.

2. Monegain B. More than 80 percent of docs use EHRs. Healthcare IT News website. healthcareitnews.com/news/more-80-percent-docs-use-ehrs. Published September 18, 2015. Accessed November 16, 2016.

3. What is a patient portal? HealthIT.gov website. healthit.gov/providers-professionals/faqs/what-patient-portal. Updated September 29, 2017. Accessed April 4, 2017.

4. Goldzweig CL, Orshansky G, Paige NM, et al. Electronic patient portals: evidence on health outcomes, satisfaction, efficiency, and attitudes: a systematic review. Ann Intern Med. 2013;159(10):677-687. doi: 10.7326/0003-4819-159-10-201311190-00006.

5. Ralston JD, Carrell D, Reid R, Anderson M, Moran M, Hereford J. Patient web services integrated with a shared medical record: patient use and satisfaction [erratum in J Am Med Inform Assoc. 2008;15(2):265. doi: 10.1197/jamia.M2695]. J Am Med Inform Assoc. 2007;14(6):798-806. doi: 10.1197/jamia.M2302.

6. Neuner J, Fedders M, Caravella M, Bradford L, Schapira M. Meaningful use and the patient portal: patient enrollment, use, and satisfaction with patient portals at a later-adopting center. Am J Med Qual. 2015;30(2):105-113. doi: 10.1177/1062860614523488.

7. Krist AH, Aycock RA, Etz RS, et al. MyPreventiveCare: implementation and dissemination of an interactive preventive health record in three practice-based research networks serving disadvantaged patients—a randomized cluster trial. Implement Sci. 2014;9:181. doi: 10.1186/s13012-014-0181-1.

8. Prince-Haywood EG, Luo Q, Monlezun D. Dose effect of patient-care team communication via secure portal messaging on glucose and blood pressure control. J Am Med Inform Assoc. 2018;25(6):702-708. doi: 10.1093/jamia/ocx161.

9. Griffin A, Skinner A, Thornhill J, Weinberger M. Patient portals: who uses them? what features do they use? and do they reduce hospital readmissions? Appl Clin Inform. 2016;7(2):489-501. doi: 10.4338/ACI-2016-01-RA-0003.

10. Gerber DE, Laccetti AL, Chen B, et al. Predictors and intensity of online access to electronic medical records among patients with cancer. J Oncol Pract. 2014;10(5):e307-e312. doi: 10.1200/JOP.2013.001347.

11. Kruse CS, Bolton K, Freriks G. The effect of patient portals on quality outcomes and its implications to meaningful use: a systematic review. J Med Internet Res. 2015;17(2):e44. doi: 10.2196/jmir.3171.

12. Yamin CK, Emani S, Williams DH, et al. The digital divide in adoption and use of a personal health record. Arch Intern Med. 2011;171(6):568-574. doi: 10.1001/archinternmed.2011.34.

13. Goel MS, Brown TL, Williams A, Hasnain-Wynia R, Thompson JA, Baker DW. Disparities in enrollment and use of an electronic patient portal. J Gen Intern Med. 2011;26(10):1112-1116. doi: 10.1007/s11606-011-1728-3.

14. Smith SG, O’Conor R, Aitken W, Curtis LM, Wolf MS, Goel MS. Disparities in registration and use of an online patient portal among older adults: findings from the LitCog cohort. J Am Med Inform Assoc. 2015;22(4):888-895. doi: 10.1093/jamia/ocv025.

15. Ancker JS, Barrón Y, Rockoff ML, et al. Use of an electronic patient portal among disadvantaged populations. J Gen Intern Med. 2011;26(10):1117-1123. doi: 10.1007/s11606-011-1749-y.

16. Roblin DW, Houston TK 2nd, Allison JJ, Joski PJ, Becker ER. Disparities in use of a personal health record in a managed care organization. J Am Med Inform Assoc. 2009;16(5):683-689. doi: 10.1197/jamia.M3169.

17. Tenforde M, Nowacki A, Jain A, Hickner J. The association between personal health record use and diabetes quality measures. J Gen Intern Med. 2012;27(4):420-424. doi: 10.1007/s11606-011-1889-0.

18. Crotty BH, Tamrat Y, Mostaghimi A, Safran C, Landon BE. Patient-to-physician messaging: volume nearly tripled as more patients joined system, but per capita rate plateaued. Health Aff (Millwood). 2014;33(10):1817-1822. doi: 10.1377/hlthaff.2013.1145.

19. Irizarry T, DeVito Dabbs A, Curran CR. Patient portals and patient engagement: a state of the science review. J Med Internet Res. 2015;17(6):e148. doi: 10.2196/jmir.4255.

20. Peacock S, Reddy A, Leveille SG, et al. Patient portals and personal health information online: perception, access, and use by US adults. J Am Med Inform Assoc. 2017;24(e1):e173-e177. doi: 10.1093/jamia/ocw095.

21. McClellan SR, Panattoni L, Chan AS, Tai-Seale M. Patient-initiated electronic messages and quality of care for patients with diabetes and hypertension in a large fee-for-service medical group: results from a natural experiment. Med Care. 2016;54(3):287-295. doi: 10.1097/MLR.0000000000000483.

22. Sarkar U, Karter AJ, Liu JY, et al. Social disparities in internet patient portal use in diabetes: evidence that the digital divide extends beyond access. J Am Med Inform Assoc. 2011;18(3):318-321. doi: 10.1136/jamia.2010.006015.

23. Lyles CR, Harris LT, Jordan L, et al. Patient race/ethnicity and shared medical record use among diabetes patients. Med Care. 2012;50(5):434-440. doi: 10.1097/MLR.0b013e318249d81b.

24. Chen C, Garrido T, Chock D, Okawa G, Liang L. The Kaiser Permanente electronic health record: transforming and streamlining modalities of care. Health Aff (Millwood). 2009;28(2):323-333. doi: 10.1377/hlthaff.28.2.323.

25. Kahn JS, Hilton JF, Van Nunnery T, et al. Personal health records in a public hospital: experience at the HIV/AIDS clinic at San Francisco General Hospital. J Am Med Inform Assoc. 2010;17(2):224-228. doi: 10.1136/jamia.2009.000315.

26. Lyles CR, Sarkar U, Schillinger D, et al. Refilling medications through an online patient portal: consistent improvements in adherence across racial/ethnic groups. J Am Med Inform Assoc. 2016;23(e1):e28-e33. doi: 10.1093/jamia/ocv126.

27. Epic website. epic.com. Accessed May 3, 2016.

28. Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45(6):613-619. doi: 10.1016/0895-4356(92)90133-8.

29. Tieu L, Schillinger D, Sarkar U, et al. Online patient websites for electronic health record access among vulnerable populations: portals to nowhere? J Am Med Inform Assoc. 2017;24(e1):e47-e54. doi: 10.1093/jamia/ocw098.

30. Wolcott V, Agarwal R, Nelson DA. Is provider secure messaging associated with patient messaging behavior? evidence from the US Army. J Med Internet Res. 2017;19(4):e103. doi: 10.2196/jmir.6804.

31. Taplin SH, Yabroff KR, Zapka J. A multilevel research perspective on cancer care delivery: the example of follow-up to an abnormal mammogram. Cancer Epidemiol Biomarkers Prev. 2012;21(10):1709-1715. doi: 10.1158/1055-9965.EPI-12-0265.

32. Kuo A, Dang S. Secure messaging in electronic health records and its impact on diabetes clinical outcomes: a systematic review. Telemed J E Health. 2016;22(9):769-777. doi: 10.1089/tmj.2015.0207.

33. McInnes DK, Shimada SL, Midboe AM, et al. Patient use of electronic prescription refill and secure messaging and its association with undetectable HIV viral load: a retrospective cohort study. J Med Internet Res. 2017;19(2):e34. doi: 10.2196/jmir.6932.

34. Chung S, Panattoni L, Chi J, Palaniappan L. Can secure patient-provider messaging improve diabetes care? Diabetes Care. 2017;40(10):1342-1348. doi: 10.2337/dc17-0140.

Download PDF: Patients' Adoption of and Feature Access Within Electronic Patient Portals