Abstract
Background: Technology-based patient engagement strategies (such as patient portals) are increasingly available, yet little is known about current use and barriers within practice-based research networks (PBRNs). PBRN directors have unique opportunities to inform the implementation of patient-facing technology and to translate these findings into practice.
Methods: PBRN directors were queried regarding technology-based patient engagement strategies as part of the 2015 CAFM Educational Research Alliance (CERA) survey of PBRN directors. A total of 102 PBRN directors were identified via the Agency for Healthcare Research and Quality's registry; 54 of 96 eligible PBRN directors completed the survey, for a response rate of 56%.
Results: Use of technology-based patient engagement strategies within PBRNs was limited, with less than half of respondents reporting experience with the most frequently named tools (risk assessments/decision aids). Information technology (IT) support was the top barrier, followed by low rates of portal enrollment. For engaging participant practices, workload and practice leadership were cited as most important, with fewer respondents noting concerns about patient privacy.
Discussion: Given limited use of patient-facing technologies, PBRNs have an opportunity to clarify the optimal use of these strategies. Providing IT support and addressing clinician concerns regarding workload may facilitate the inclusion of innovative technologies in PBRNs.
- Decision Support Techniques
- Electronic Health Records
- Health Services Research
- Patient Participation
- Practice-based Research
- Privacy
- Registries
- Risk Assessment
- Surveys & Questionnaires
- United States Agency for Healthcare Research and Quality
- Workload
Practice-based research network (PBRN) directors are uniquely poised to answer questions regarding the pragmatic implementation of evolving patient engagement technologies within PBRNs. Given the increasing availability of technology to communicate with patients, it was anticipated that PBRN directors may have valuable experience to share in using patient engagement technologies within practice-based research. PBRNs offer a rich research laboratory across multiple settings, ownership models, and organizational models, and even more diverse populations within ambulatory primary care practices.1 Primary care researchers within PBRNs have unique opportunities to inform the implementation of patient-facing technology, thereby translating research findings into practice.2,3
Patient engagement strategies encompass information exchange and shared decision making to promote patient activation and self-management.4 Using technology—including videoconferencing, web-based tools, texting, and patient portals—for patient engagement may be instrumental in facilitating patient-centered care and improving both health-related outcomes and workflow.5⇓⇓–8 Technology-based patient engagement strategies include activities such as the transmission of clinical questions, biometric data, patient surveys (eg, decision aids and patient-reported outcomes), and risk calculators. Real-world examples include the use of videoconferencing to facilitate patient visits in rural areas, the use of portals to collect patient-reported outcomes, and Internet-connected scales to communicate daily body weight.
With the combination of an aging population and a primary care workforce shortage, there is a greater-than-ever need to explore innovative technology strategies that empower patients to be active participants in their health and health care.9,10 Primary care research is needed to inform the optimal use of these technologies to meet the tenets of the triple aim of better care, better quality, and lower cost.11,12 However, little is known about current research efforts related to the use of technology to engage patients and, more important, which barriers need to be overcome to optimize the use of such innovations. Technology has the potential to improve systems of care and health outcomes; therefore, further research is needed to inform the optimal implementation and evaluation of outcomes moving forward.8,13,14
Clinician acceptance has been shown to be a major factor in the uptake of new technologies in practice.15 In a prior survey of clinicians, while most felt positive about technology use for patient engagement, concerns about workload and patient safety also surfaced.16 While the issue of clinician attitudes toward technology use has been examined previously, to our knowledge, no studies have queried technology use and acceptance among those leading PBRNs. To address this gap in the literature, the purpose of this study was to assess the current use of and perceived barriers to patient engagement technologies within practice-based research among a sample of PRBN directors throughout the United States and Canada.
Methods
Data for this study were collected via the Council of Academic Family Medicine Educational Research Alliance's (CERA) 2015 survey of PBRN directors. CERA is a joint initiative of all 4 major US academic family medicine organizations (Society of Teachers of Family Medicine, North American Primary Care Research Group, Association of Departments of Family Medicine, and Association of Family Medicine Residency Directors). Detailed information about CERA has been published elsewhere.17 All procedures used in this study were approved by the American Academy of Family Physicians Institutional Review Board.
Data Collection Procedures
Between September and October 2015, PRBN directors (n = 102) identified within the Agency for Healthcare Research and Quality's PBRN registry received an electronic invitation to complete a 10-minute survey. The survey was introduced as part of an electronic message that included a personalized greeting, a letter signed by each CERA organization president, and a link to the survey. Nonrespondents were sent 3 follow-up E-mails encouraging participation. Five E-mail invitations were returned (“bounced back”) and 1 individual indicated that the PBRN was no longer active; therefore, the useable sample included a total of 96 PBRN directors. Overall, 54 PBRN directors completed the survey, yielding a 56% overall response rate.
A collaborative team of researchers developed original content to design the 10-question survey. The survey included a collection of close-ended items addressing (1) demographic characteristics related to the scope and functioning of each director's PBRN, (2) current use of technology-based patient engagement strategies, (3) perceived barriers to the use of patient engagement technologies, and 4) factors affecting participant practice recruitment. Sample items included: “What proportion of practices within your PBRN have access to patient portals that could be used for research purposes,?” “In your opinion, which of the following are the 3 most important factors in determining which technology-based strategy to incorporate into your practice-based research?” and “How likely are each of the following characteristics to affect physician participation in studies using technology-based patient engagement strategies?” The questions pertaining to technology-based patient engagement strategies are included in the Appendix. Survey items aimed to evaluate the impact of PBRN scope (local, state, regional, national) on the use of technology-based patient engagement strategies within PBRNs, the role of patient portals in the overall use of technology-based patient engagement strategies, and the influence of familiarity with Health Insurance Portability and Accountability Act (HIPAA) regulations for technology use. Hypotheses being tested included the following: (1) regional/national PBRNs are more likely to be using technology-based patient engagement strategies than local/state PBRNs, and (2) PBRNs with increased access to patient portals in member practices are more likely to be engaged in studies involved patient engagement technologies.
Data Analysis
Descriptive statistics (frequencies, percentages) were used to depict characteristics of PBRNs in terms of current practices, barriers and facilitators, and attitudes toward the use of technology-based patient engagement strategies. For survey items that included count data, χ2 tests were used to compare PBRNs in terms of current practices, barriers and facilitators, and attitudes toward the use of technology-based patient engagement strategies. All data analyses were conducted using the SPSS version 22.0 (SPSS, Inc./IBM, Chicago, IL). Response rates varied per survey question, as represented in the tables.
Results
Overall PBRN characteristics are presented in Table 1. Survey respondents included representation from local (n = 11), state (n = 18), regional (n = 16), and national (n = 9) PBRNs. Almost half (46%) of PBRN directors were leading PBRNs that had been in existence a decade or longer.
Practice-Based Research Network Characteristics
The proportion of studies within each PBRN using technology-based patient engagement strategies is listed in Table 2. Of the 49 PBRN directors who responded to this question, 39 (80%) indicated using technology-based patient engagement strategies in fewer than 25% of their studies in the past 5 years. When comparing the percentage of studies using technology-based patient engagement strategies in the past 5 years, no significant differences were observed based on the scope of the PBRN (local/state vs regional/national; χ2 = 3.91; P > .05).
Percentage of Studies Including Technology-Based Patient Engagement Strategies among Practice-Based Research Networks
Technology-based patient engagement strategies used in the past 5 years by PBRNs are outlined in Table 3. Risk assessments or decision aids administered by web-based tools (n = 20), waiting room kiosks/computers (n = 13), or smartphone/personal tablet applications (n = 13) were most commonly used, whereas videoconferencing for patient visits (n = 4) and texting to transmit clinical information (n = 4) were used least frequently.
Practice-Based Research Network Use of Technology-Based Patient Engagement Strategies in the Past 5 Years
In terms of importance in determining which type of technology-based patient engagement strategy to incorporate into research studies, PBRN directors most frequently identified ease of use for practices (n = 33), ease of use for patients (n = 30), and ease of use for clinicians (n = 23). Factors least likely to affect the type of technology selected included cost (n = 16) and patient population (n = 5).
Directors' rankings of the top barriers to incorporating technology into research studies are reported in Table 4. Low rates of portal enrollment was selected as a top barrier, though only 47% PBRNs (n = 22) had access to patient portals in >50% of their practices. PBRN directors reported access to patient portals (Table 5). Among PBRN directors reporting technology-based patient engagement strategies in 0%, 1% to 50%, and >50% of studies, those who reported access to portals in ≥50% of the practices were not significantly more likely to have engaged in studies involving technology-based patient engagement strategies than PBRNs with access to portals in <50% of practices (χ2 = 1.92; P > .05).
Barriers to Incorporating Technology-Based Patient Engagement Strategies into Practice
Practices with Patient Portals in Each Practice-Based Research Network
In terms of familiarity with HIPAA regulations pertaining to the transfer of electronic information, PBRN directors described practices being most familiar with E-mail, followed by patient portals, texting, and videoconferencing (Figure 1). There were no significant differences between familiarity with HIPAA regulations (not at all familiar/slightly familiar/somewhat familiar vs moderately familiar/extremely familiar) and use of E-mail (χ2 = 0.12; P > .05), portal use (χ2 = 0.037; P > .05), texting (χ2 = 1.14;P > .05), or videoconferencing (χ2 = 1.42; P > .05).
Familiarity with Health Insurance Portability and Accountability Act regulations for the transmission of electronic data.
Of the 39 PBRN directors who reported the use of technology-based patient engagement strategies, 35 responded to the survey question regarding the ease of recruitment for studies using these strategies. Of these, 54% reported ease of recruitment as good (n = 15) or very good (n = 4). A total of 34% of responding directors (n = 12) reported ease of recruitment as fair and 11% (n = 4) reported it as poor.
PBRN directors' perceptions of factors that may affect physician participation in studies are shown in Figure 2. Overall, workload was the most concerning factor identified, followed closely by practice leadership. Practice models identified as most likely to participate in PBRN studies were individual practitioner or group practice (n = 14), hospital-owned and university-affiliated (n = 11), federally qualified health center (n = 7), hospital-owned community-based practice (n = 2), and federal/national government health care agency (n = 2).
Factors that may affect physician participation in studies including technology-based patient engagement strategies.
Discussion
This study aimed to evaluate the current use of, barriers to, and clinician acceptance of patient engagement technologies within studies conducted in PBRNs. Based on the increasing availability of new technologies, it was anticipated that PBRN directors would have experience with studies encompassing many different technology-based modalities for patient engagement. Instead, some of the most common technology-based tools (risk assessments or decision aids transmitted by web-based tools, kiosks, smartphones/tablets, or portals) were used by less than half of the PBRNs in the past 5 years. Decision aids have been found to improve knowledge and decrease decisional conflict when administered through different modalities and settings, which may explain their routine use within practice-based research.18 Further study is needed to clarify the optimal use of technology-based tools (such as videoconferencing, texting, and portals) to transmit other types of clinical data, including the contexts in which they may be most beneficial.19⇓–21
It was expected that regional and national PBRNs would be more likely to have experience with technology-based patient engagement strategies because of increased access to technology within diverse practice sites, but no significant differences were noted based on scope of PBRN (local/state vs regional/national). This may be related to variability in the number of practices and resources within each PBRN, irrespective of geographic coverage, as well as increased probability of a greater number of technology platforms for regional and national PBRNs. The overall limited use of patient engagement technologies in practice-based research identified in this survey is consistent with a recent evaluation of patient engagement technologies in the inpatient setting, in which a systematic review highlighted limited use and gaps in the literature surrounding optimal implementation.22
In terms of factors influencing the inclusion of technology in practice-based research studies, PBRN directors reported ease of use (for patients, practices, and clinicians, in descending order) as the most frequently cited factor in determining which technology-based patient engagement strategy to use in research. User-friendly technology has been found to be critical to successful implementation in the practice setting.23 Cost and the availability of tools in multiple languages were cited less frequently as factors in choosing which type of technology to implement. While a prior study noted cost as a barrier,24 this may be less relevant to practice-based researchers who are seeking to optimize the use of existing technologies in practices rather than purchasing new systems.
Linked to electronic medical records, patient portals are an example of existing technology available in an ever increasing number of practices for research purposes. However, most directors in this sample reported access to portals in less than half of practices within their PBRN. Given the potential for portals to be used to transmit decision aids, risk assessments, and clinical information, and to maximize the study sample and standardize data collection methods, it was expected that PBRNs with portal access in a greater number of practices may use technology-based patient engagement strategies more frequently than PBRNs with a patient portal in fewer practices. The lack of significant differences noted between PBRNs with varying degrees of access to patient portals and studies involving technology may be the result of both low rates of enrollment and a limited understanding of optimal implementation of patient portals for both clinical and research purposes. Further efforts to facilitate patient enrollment and to evaluate who might benefit most from patient engagement via patient portals may facilitate their use within practice-based research.
In addition to establishing current use of technology-based patient engagement strategies within PBRNs, directors were queried about barriers to technology implementation. Information technology (IT) support was the most frequently cited barrier to incorporating technology in practice settings. It is unclear whether the IT barrier is limited availability, lack of IT personnel trained in implementation science, institutional regulations, or something else. Further study is needed to clarify the type of IT support needed to optimize the implementation of technology for patient engagement. Similar to other studies, practice champions were also found to be particularly critical to successful implementation.25 Technology-based tools in multiple languages were cited as a barrier less frequently than anticipated based on a prior study, though this is undoubtedly dependent on the patient populations of each PBRN.26 Access to smartphones was 1 of the least commonly cited barriers, which corresponds to a recent study indicating that 55% of primary care patients use smartphones, and 70% of those patients with smartphones use them for health-related purposes.27
An additional potential barrier to studies involving technology-based patient engagement strategies is clinician acceptance. Clinician acceptance is critical to the successful recruitment of practices and has been found to facilitate study implementation.28 We aimed to determine factors that were most critical for physician participation in studies involving technology for patient engagement. All but 1 PBRN director cited workload as a major factor in physician participation, whereas patient safety and patient privacy were cited less frequently than in prior studies.16,29 This may be in part the result of evolving experience and institutional policies regarding the management of patient privacy and patient safety within patient-facing technology-based interventions. Further study is needed to clarify whether workload is a greater concern for studies involving patient engagement technologies than for other types of practice-based research.
In light of expected concerns with patient privacy, PBRN directors reported practice familiarity with HIPAA regulations for transmission of clinical data. The directors reported variable practice familiarity with HIPAA regulations; practices were most familiar with regulations regarding E-mail and least familiar with those regarding videoconferencing. To be HIPAA compliant, E-mail, texting, portals, and other forms of patient-facing technology need to include safeguards for the transmission of protected health information, potentially including encryption and patient logins.30,31 There is more debate about adequate safeguards for videoconferencing, which is reflected in the PBRN directors' perceptions of decreased familiarity with HIPAA regulations for videoconferencing within practices. While it was thought that PBRNs reporting increased familiarity with HIPAA regulations may be more likely to use various technology-based tools to transmit clinical information, no significant differences were noted with respect to HIPAA familiarity and the reported percentage of studies using technology for patient engagement. This may be linked to other findings within this study indicating that patient privacy was not a major factor affecting physician participation. In addition, a more recent study confirmed the feasibility of protecting patient privacy while harnessing mobile technology to enhance patient and family engagement32; however, questions still remain regarding adequate protection of patient privacy within other modalities such as videoconferencing.33
Limitations
The findings generated from this study should be considered within the context of several limitations. First, generalizability of the study findings is limited by the response rate (56%) of PBRN directors polled. Second, as with all studies that rely on self-report, response bias remains a possibility. Third, the cross-sectional nature of the study limits causality. Last, reporting is second-hand; individual PBRN-member clinics and clinicians may have different perceptions of technology strategies than the PBRN director, particularly with regard to knowledge of HIPAA regulations.
Conclusion
Decision aids and risk assessments were the most commonly used types of technology-based patient engagement strategies within the PBRNs. Even in practices with access to portals and other technologies, few PBRNs are engaging in studies of technology implementation or related outcomes. IT support was the top-ranked barrier to incorporating technology into practice, though practice champions were also cited as being critical to successful implementation. For participant practices, workload and practice leadership were cited as major factors in physician participation in studies involving technology-based patient engagement strategies—more so than concerns about patient safety and patient privacy. Optimizing IT support and addressing workload concerns may facilitate increased use of technology-based patient engagement strategies within practice-based research.
Acknowledgments
The authors thank Jacqueline Grove for assistance with editing and manuscript preparation.
Appendix
Questions Regarding Technology-Based Patient Engagement Strategies
Below are some examples of technology-based patient engagement strategies. Has your PBRN conducted studies that relied on any of the following technology-based patient engagement strategies in the past 5 years? (Please select all that apply.)
Patient visits with primary care physicians remotely by audio/video
Electronic transmission of vital signs or clinical data (eg, blood pressure, weight, blood glucose)
Waiting room kiosk computers/tablets for risk assessments or decision aids
Web-based risk assessments or decision aids
Smartphones/personal tablet applications for risk assessments or decision aids
Electronic medical record portal-based risk assessments or decision aids
Texting to patients (eg, reminders, educational materials)
Texting from patients (eg, transmission of vital signs or clinical data)
E-mail
What proportion of studies within your PBRN have relied on technology-based patient engagement strategies in the past 5 years?
0%
1% to 25%
26% to 50%
51% to 75%
76% to 99%
100%
What proportion of practices within your PBRN have access to patient portals that could be incorporated for research purposes?
0%
1% to 25%
26% to 50%
51% to 75%
76% to 99%
100%
In your opinion, which of the following are the 3 most important factors in determining which technology-based patient engagement strategy to incorporate into your practice-based research?
Clinical utility
Ease of use for patients
Ease of use for clinicians
Ease of implementation for practices
Availability of a particular technology
Cost
Patient population
How familiar are your practices with HIPAA regulations surrounding the transmission of electronic data pertaining to:
Patient portals
E-mail
Texting
Videoconferencing
Responses to question 5 were rated on a Likert scale (1 to 5): not at all familiar, slightly familiar, somewhat familiar, moderately familiar, extremely familiar.
In your experience as a PBRN director, what are the 3 most critical barriers to successfully incorporating technology-based patient engagement strategies into clinical practice?
Lack of patient portals within electronic medical records
Low rates of portal enrollment among patients
Access to smartphones
Cost of health care technology
Staff comfort with use of technology
Patient willingness to use technology
Tools that interface with electronic medical records
Availability of tools in multiple languages
IT support
Lack of practice champions
In your experience as a PBRN director, what are the 3 most critical facilitators to successfully incorporating technology-based patient engagement strategies into clinical practice?
Patient portals within electronic medical records
Portal enrollment
Access to smartphones
Cost of health care technology
Staff comfort with use of technology
Patient willingness to use technology
Tools that interface with electronic medical records
Availability of tools in multiple languages
IT support
Practice champions
Across all studies incorporating technology-based patient engagement strategies in your PBRN, please describe the overall ease of recruitment of participant practices for the studies.
Poor
Fair
Good
Very good
Excellent
How likely are the following to affect physician participation in studies using technology-based patient engagement strategies?
Comfort with technology
Training
Practice leadership
Concerns about workload or time
Concerns about patient safety
Concerns about patient privacy
Sustainability of interventions
Responses to question 9 were rated on a Likert scale (1 to 5): extremely unlikely, unlikely, neutral, likely, extremely likely.
In your opinion, what practice ownership model is most likely to participate in studies using technology-based patient engagement strategies?
Individual practitioner or group practice
Hospital-owned, university-affiliated practice
Hospital-owned, community-based practice
Federally qualified health center
Federal or national government health care agency
Not sure
Notes
This article was externally peer reviewed.
Funding: none.
Conflict of interest: none declared.
- Received for publication January 28, 2016.
- Revision received April 18, 2016.
- Accepted for publication April 22, 2016.