Subscribe to RSS
DOI: 10.1055/s-0043-1772685
Patient Portal Privacy: Perspectives of Adolescents and Emerging Adults Living with HIV and the Parental/Guardian Role in Supporting Their Care
- Abstract
- Background and Significance
- Methods
- Results
- Parental and Guardian Role in HIV Management
- Parental Access to the Patient Portal
- Health Care Worker Perspectives
- Discussion
- Conclusion
- Clinical Relevance Statement
- Multiple-Choice Questions
- References
Abstract
Background Increasing the percentage of people living with human immunodeficiency virus (HIV), including youth, who are virally suppressed to 95% is an overall goal of the ending the HIV epidemic initiative. While patient portals have become ubiquitous, questions remain about how best to operationalize parental/guardian access to youth's patient portals in alignment with optimizing HIV care outcomes and patient preferences. This qualitative study focuses on understanding perspectives among youth with HIV (YHIV) about parental access to patient portals.
Methods Eligible participants were YHIV aged 13 to 25 years receiving care at an urban academic hospital. Semistructured individual/paired interviews were conducted between May 2022 and March 2023. Participants were asked to discuss thoughts on parental access to patient portals, and roles parents/guardians have in supporting their HIV care. Semistructured interviews were conducted with adolescent and emerging adult health care workers (HCWs) to gain perspectives on YHIV emergent themes. Audio-recorded interviews were transcribed verbatim, and we conducted thematic analysis using an inductive approach to identify codes and themes.
Results Sixteen YHIV and four HCWs participated in interviews. Parental roles in coordinating HIV care ranged from supporting YHIV needs for transportation, acquiring, and taking medications, to not having any role at all. Participants shared heterogeneous perspectives about their openness to share patient portal access with their parents/guardians. Perspectives were not strictly congruent along lines of participant age or parental roles in helping youth to manage HIV care. Sharing passwords emerged both as a pathway that YHIV grant access to their accounts and a source of confusion for clinicians when parents/guardians send messages using their child's account.
Conclusion Findings suggest HCWs should initiate conversations with YHIV patients to determine preferences for parental/guardian access to their patient portal, educate on proxy access, and explain the extent of medical information that is shared with proxy accounts, regardless of age and perceived parental involvement in HIV care.
#
Keywords
patient portal - electronic health records and systems - adolescent medicine - infectious disease - families of patients - patients with chronic illness or special needs - personal health recordsBackground and Significance
Adolescents and Emerging Adults
Human immunodeficiency virus (HIV) is a chronic disease impacting 28,846 adolescents and emerging adults (AEA) aged 13 to 24 in the United States.[1] The ending the HIV epidemic in the U.S. (EHE) initiative focuses on increasing viral suppression among people living with HIV to 95% by 2025.[2] However, among AEA, only 63% of these youth with HIV (YHIV) are virally suppressed.[3] Patient portals allow YHIV to perform HIV care-related functions such as messaging the health care team, reviewing clinical notes, checking laboratory results, scheduling appointments, and requesting HIV medication refills.[4] However, leveraging the patient portal to achieve EHE goals may be limited by the fact that YHIV populations are more likely to be Black/African American, have lower health literacy, and have lower socioeconomic status, all factors that have been associated with lower portal access.[5] [6] [7] Still, AEA report that reading notes in the portal is meaningful for feeling engaged in care, improving the relationship with their health care team, and that the portal can support behaviors related to medication adherence and improving HIV care.[8] [9] Additionally, parents/guardians that provide social support to YHIV may also consider using the patient portal helpful with coordinating their child's HIV care.[10]
Adolescence and emerging adulthood are characterized by growing independence, self-determination and high rates of behavioral health risks, exacerbation of chronic health conditions, and low health care utilization.[11] [12] [13] [14] [15] The social support, supervision, and care coordination provided by parents/guardians to YHIV by accessing their patient portal can mitigate gaps in health care engagement and antiretroviral therapy (ART) adherence.[10] However, when such caregivers have access to the portal it presents challenges to preserving the patient confidentiality of YHIV.[16] In the next section we define patient portal proxy access, delineate procedural differences among AEA patients, and discuss risks to patient privacy.
#
Proxy Accounts and Minor Privacy Laws
Patient portal proxies refer to individuals, such as parents, guardians, or other caregivers, allowed to access a patient's health information through the portal using a unique secure login.[17] When a child is under 13 years old, the patient portal account is typically a parent/guardian proxy-only account. Meaning, the parent/guardian proxy, and not the patient, is the primary account manager. In many states, adolescent minors between 13 and 17 years of age may consent to sexual health services and likewise are enabled to be the primary account manager of their portal.[18] Health care institutions may delegate the patient health information available within parent/guardian proxy accounts. For example, sexually transmitted infection (STI) laboratory results, medications, and previously sent messages can be disabled or reduced.[19] However, such intended privacy protections are compromised when parents/guardians do not use a proxy account, but instead use the patient's login credentials to access the patient's portal. Such improper authentications are not uncommon, a study across three institutions found that 64 to 76% of accounts with outbound messages were accessed by guardians.[20] This is concerning since about 7% of AEA would not seek sexual or reproductive health care if they believed their parents might find out about it.[21]
Unless incapacitated, patients 18 years and older may voluntarily elect to authorize patient proxy access to others, including parents/guardians.[19] Proxy access in these cases may also be revoked by the patient. Since proxy access is voluntary for adults, many studies neglect to examine privacy issues for youth who are emerging adults that are not quite independent; particularly those that have chronic conditions and whose parents may still provide care coordination, social support, and health insurance coverage. Furthermore, there is little qualitative research providing insight into the perceptions and preferred parameters of parental/guardian access to patient portals among both AEA living with HIV.
#
Study Purpose
To address the above-mentioned research gaps, the current study uses qualitative research methods to examine perspectives about patient portal privacy in the context of AEA with HIV and the roles of parents/guardians in supporting their HIV care.
#
#
Methods
Study Overview
This study was a supplemental study to a randomized controlled trial investigating a technology-enhanced directly observed therapy and community-based nursing intervention for increasing ART adherence among YHIV aged 13 to 25 years (identifier: NCT 03600103).[22] Eligible participants for the current study were aged 13 to 25 years, living with HIV, and receiving care at the study site's AEA clinic, and had consented to be contacted for future studies.
A team of trained research assistants recruited YHIV participants using patient lists from the parent study. Semistructured individual or paired in-depth interviews were conducted among YHIV participants between May 2022 and March 2023. During the interview, we asked participants to discuss the role of their parents/guardians in supporting HIV care and how they felt about parents/guardians having access to their portal. Participants completed an online postinterview survey to collect information on age, race, and use of patient portal functions. Health care workers (HCWs) at the study-affiliated AEA clinic were purposively recruited to participate in interview sessions to add HCW perspectives to what was shared by YHIV. All interviews were conducted using Zoom, lasting between 30 and 60 minutes. Sessions were audio-recorded and transcribed verbatim. Saturation was reached when no new themes were achieved beyond two interviews. Participants received a Visa gift card; 65.00 USD for patients and 50.00 USD for HCW. This study was approved by the institutional review board (approval no.: IRB00299232) and informed consent was obtained according to its ethical standards.
#
Data Analysis
Thematic analysis methods were selected to examine YHIV perspectives and practices about parental/guardian portal access, due to its utility in seeking to understand experiences, thoughts, and behaviors.[23] Using an inductive approach, the principal investigator developed a master codebook and two researchers independently coded the transcripts in Atlas.ti. We used MS Excel to organize salient topics and themes from HCW interviews. The research team routinely met to iteratively discuss and refine emergent codes, identify themes, and highlight congruency and contradictions in the data. Differing interpretations of the data were discussed at length between researchers and agreement reached on all topics.
#
#
Results
Sample Characteristics
In total, 16 YHIV and four HWCs: one physician (HCW1), two nurse practitioners (HCW2 and HCW3), and one front desk staff (HCW4) participated in interviews. YHIV ages ranged from 13 to 25 years, 15 identified as Black/African American, and 10 acquired HIV perinatally (PHIV; [Table 1]). Most sampled participants considered parental/guardian access as acceptable (10/16); parental/guardian access was unacceptable among 4 of 16 participants. Three participants had parent/guardian proxy accounts; two had the proxy-only accounts in use, whereas the other proxy account was inactive. Participants described three modalities for parental/guardian access to their portal: (1) proxy access accounts; (2) shared viewing (i.e., viewing together in the same physical or virtual space without disclosing passwords); or (3) sharing passwords with the parent/guardian.
I.D. |
Sex |
Age (y) |
Transmission type[a] |
Most recent viral load (copies/mL) |
Date of viral load |
Ever used portal |
Parent access acceptable |
Proxy account status |
---|---|---|---|---|---|---|---|---|
P01 |
Female |
21 |
WSM |
< 20 |
October 18, 2022 |
Yes |
No |
No proxy |
P02 |
Female |
21 |
Perinatal |
45.9 |
April 8, 2022 |
Yes |
No |
No proxy |
P03 |
Female |
22 |
Unknown |
< 20 |
August 12, 2022 |
Yes |
Missing Data |
No proxy |
P04 |
Female |
20 |
Perinatal |
52.2 |
August 4, 2022 |
Yes |
Yes |
No proxy |
P05 |
Male |
25 |
MSM |
< 20 |
August 15, 2022 |
Yes |
Yes |
No proxy |
P06 |
Male |
22 |
Perinatal |
< 20 |
April 28, 2022 |
Yes |
Yes |
No proxy |
P07 |
Male |
20 |
MSM |
< 20 |
June 22, 2022 |
Yes |
No |
No proxy |
P08 |
Male |
25 |
MSM |
< 20 |
September 5, 2022 |
Yes |
No |
No proxy |
P09 |
Female |
20 |
Perinatal |
< 20 |
August 5, 2022 |
Yes |
Yes |
No proxy |
P10 |
Female |
23 |
WSM |
< 20 |
August 23, 2022 |
Yes |
Yes |
No proxy |
P11 |
Female |
21 |
Perinatal |
5,820 |
September 29, 2022 |
Yes |
Yes |
No proxy |
P12 |
Female |
16 |
Perinatal |
< 20 |
November 4, 2022 |
Yes |
Inapplicable |
No proxy |
P13 |
Female |
22 |
Perinatal |
< 20 |
November 7, 2022 |
Yes |
Yes |
No proxy |
P14 |
Female |
13 |
Perinatal |
< 20 |
August 11, 2023 |
No |
Yes |
Yes (proxy only) |
P15 |
Female |
16 |
Perinatal |
< 20 |
August 22, 2022 |
No |
Yes |
Yes (inactive) |
P16 |
Female |
13 |
Perinatal |
< 20 |
February 8, 2023 |
No |
Yes |
Yes (proxy only) |
a MSM and WSM refer to men who have sex with men and women who have sex with men, respectively.
b Participants of the two paired interviews included (P07 and P08) and (P12 and P13)
#
Portal Functions Used
Participants reported the use of multiple portal functions (13/16). Among users, the most common uses were to check STI laboratory test results, to check other laboratory test results, and to check medical history (10/13). Other uses included sending messages to HCWs (9/13), scheduling appointments (9/13), reviewing clinical notes (7/13), and requesting medication refills (7/13).
#
Thematic Analysis
Several themes emerged from the two primary focus areas of the study: (1) parental role in HIV management and (2) parental access to the patient's portal. The role of parents in helping participants manage living with HIV ranged from strong reliance to parents/guardians not having any role at all. Similarly, there were various degrees to which our study participants were willing to provide access to the portal. Some preferred that parents/guardians maintain full access; some were okay with partial access, whereas others did not want to give any access.
#
#
Parental and Guardian Role in HIV Management
Dynamic Support
Some participants reported that their parents/guardians have dynamic roles in supporting their HIV management and overall wellness ([Table 2]). When asked about her parents, P15, a 16-year-old participant, indicated that she considers her parents to have a significant role in helping her manage living with HIV.
They have a big role. They take me to the hospital; they go get my pills; they make sure I'm okay and make sure my medicines are on track.
This comment demonstrates the multiple capacities in which some patients may rely on parents/guardians, including connecting with access to care through transportation, delivery of ART medications, following up on ART adherence, and a nurturing aspect to ensure that they are okay. Another participant, P02, described that as a younger child, her mother often encouraged her to take ART medications by saying, “No matter how you feel, take your medication.” P02 also shared that her mother did not disclose to her that she had perinatally acquired HIV until late adolescence and she had no awareness of why she was taking the medications.
#
Transitioning of Reliance
For PHIV participants, parents/guardians were described to have roles in supporting their HIV care in childhood prior to adolescence and emerging adulthood. Some PHIV participants described taking on more responsibility with their care as they grew older from adolescence into emerging adulthood. For example, P04 recalled counsel from her doctor to take more responsibility for keeping up with her medication.
But then I was going off to college and my doctor was like well, you need to start getting into the habit of, you know, taking your medicine.
This comment demonstrates an expectation for YHIV to transition from relying on parents/guardians for HIV care support to becoming more self-reliant as they get older.
#
Independence
A few participants explicitly described themselves as “on my own” and without parental support for managing their HIV care. P05 expressed a notion of solitude in supporting his own wellness since acquiring HIV.
They haven't helped me with anything. I've done everything on my own. I fought on my own, I cried on my own, all that, by myself.
Reasons for independence were contextual. For example, P01 described herself as independent and avoids asking others for help. For her, accepting help from others leaves the potential for them to “throw it up at [her] face” later. Similarly, P02 distanced herself from parental support due to conflict. Her mother's decision to delay HIV disclosure until late adolescence created tension and mistrust to what was once a supportive relationship in encouraging ART adherence.
#
#
Parental Access to the Patient Portal
Consent
Many participants reported amenability to parental/guardian access to their portals ([Table 3]). These participants were also comfortable with parents/guardians having uninhibited access. For example, in the case of P14, aged 13 years, her portal account is proxy-only, registered, and linked solely to her father's email account. Some participants described sharing their passwords with parents/guardians to allow them to gain access.
P05, aged 25 years, who expressed his independence, described his considerations for consenting to parent/guardian access to his portal as the ability for his parents to know what is going on with his medical care in case of an emergency or “if something happened” to him. These quotations highlight that YHIV who are over 18 or whose parents/guardians do not have a role in helping them manage living with HIV, may be open to their parents/guardians having full access to their portal.
#
Confidentiality
Some participants described confidentiality as a reason for not providing portal access to their parents. For example, P01 emphatically expressed the need for privacy between her and her mother, stating “I ain't in her business; she don't need to be in mine.” For participants like P01 and P02, confidentiality emphasizes the boundaries maintained with their parents/guardians in receiving support related to HIV care ([Table 3]).
P15 described her parents as having a significant role in helping her manage living with HIV and said that there is some information in her health records that she would prefer to shield from her parents/guardians ([Table 3]). The presence of P15's mother during the interview may have contributed to her reluctance to elaborate on the matter. Yet the quote highlights that an adolescent patient may desire patient–clinician confidentiality and may adjust what is disclosed to an HCW given their understanding of whether this information will be shared with a parent/guardian. Together quotations within the theme of confidentiality demonstrate the importance of YHIV having the ability to control the types of health information that are private.
#
Barriers to Parental Portal Access
Some patients described their parents as unable to navigate the patient portal. For example, P12, who has taken on much of the responsibility of managing her HIV care as she got older, is okay with her mother accessing her portal but also considers her mother as “not very good with technology” and thinks of MyChart as a “hassle.” On the other hand, P06, whose mother passed away, expresses frustrations with his father's inability to navigate MyChart for the sake of his younger special needs brother living with HIV ([Table 3]).
Like he can go through a PlayStation 4 console all day he wants, but he doesn't know how to go through the MyChart and how to communicate with doctors.
Quotations highlight the importance of patient portal ineptitude as a barrier to parental/guardian access and how methods other than the portal may be preferred by parents/guardians for connecting with information and communicating with HCWs.
#
#
Health Care Worker Perspectives
Facilitating HIV Care with Families
The benefit of parental/guardian access to portals was described as facilitating HIV care support for YHIV. HCW1 expressed that the goal of parental/guardian MyChart access is to “help organize the youth and their care,” such as being informed about upcoming appointments and ensuring medications are refilled ([Table 4]). How the parent/guardian uses the portal in relation to their child's HIV care was perceived by HCW3 as reflecting parenting style.
There are some adults that understand the need for developing autonomy and to give the kid space and kind of monitor, but not be overbearing. There are others that are totally in their stuff and it's problematic. Then the third type is the one who really doesn't care at all and the kids are basically on their own.
HCW3 expressed the portal as her preferred method for communicating with families ([Table 4]). It was also acknowledged that patients are likely to communicate with HCWs outside of the portal ([Table 4]). HCW1 considers texting with HCWs as a likely faster method of correspondence. However, HCW3 cautioned that cellphone texting may leave some HCW team members in the dark about what communication has occurred ([Table 4]). HCW1 went on to express the importance of allowing patients to utilize their preferred communication methods with HCWs.
#
Signing Up Adolescent Minors
HCW4 described that once patients are 13 years of age, she solicits the patient's cellphone number during the registration process to directly send the patient a link to sign up for the portal. Outcomes of this process can be determined by whether the parent is present, whether the patient has a phone number or email, and how involved the parent is in their care ([Table 4]).
HWC4 further described that there were adolescent minor patients who want their parents involved and to answer questions during the registration process on their behalf, whereas other patients may be more secretive.
Some children, want their parents involved. But some children are more secretive. And they don't want their parents to know about half the things that they are doing…
Sometimes parents/guardians may register a child's patient portal using their own e-mail and phone number. HCW4 talked about this, adding that this means the patient does not receive communications from their clinicians.
You're not texting the child. You're actually texting the parent […] And the child gets none of it. And the parent will know when the appointment is and the child will only know what the parent is telling them.
Some HCW participants described that during the clinical visit, they have conversations with patients about signing up for the portal ([Table 4]). These quotes highlight that while there are goals to set up adolescent minors with a unique portal account, the process may be complicated by the patient's ability to successfully provide unique contact information and the nature of parental involvement.
#
Sharing Portal Passwords with Parents/Guardians
Similar to having the patient's portal account registered under a parent's phone or email, sharing passwords with parents can be challenging to preserving patient confidentiality as well as providing HCWs with clarity about whom they are communicating with via portal messages. In the string of correspondence, the parent may not always disclaim that it is the parent; therefore, the HCW may get confused about who they are speaking to. HCW1 described cases where parents send messages using their child's account as opportunities to share information about setting up their proxy account to reduce confusion and allow patients to set parameters on what is available to the parent/guardian through proxy access ([Table 4]).
HCWs described the pressure that some AEA patients experience to share their login credentials with parents/guardians as an element of coercion or differential power dynamic. HCW2 shared the story of an emerging adult patient who felt the need to share their portal password to prevent parental mistrust ([Table 4]).
#
Navigating a Novel Landscape of Patient Portal Requirements
HCWs referenced receiving information and trainings about changes taking place related to the 21st Century Cures Act Final Rule. HCW1 shared that he now considers patient and parental/guardian access to clinical notes; therefore, he has become more cautious and parsimonious in his documentation ([Table 4]). HCW1 also cautioned that if information, such as STI laboratory test results, is accessible to the parent, it could limit a child's sense of confidentiality about their medical care, particularly if the parents have not been previously informed about this aspect of the patient's sexuality ([Table 4]).
Among HCWs, there appeared to be some issues in recalling and understanding specifics of new patient portal practice requirements. HCW1 could not remember the particulars about what information about patient proxy accounts was shared, also indicating that he receives a lot of information, and some information is filed away to “look up when I need to know it.”
With regard to information blocking, HCW2 stated that if the patient expressed that they do not want anybody to find out they are getting tested and there is concern somebody else will access the patient's account, she will block the visit.
I end up blocking a lot of things just to be safe, […] if the patient is telling me they really don't want anybody to find out they're getting tested…
However, HCW3 alluded to more nuanced requirements for documenting the justification for blocking information ([Table 4]). These comments suggest that information disseminated to HCWs within a health system about proxy accounts may be disconnected from practice.
#
#
Discussion
Principal Findings
Our study investigated YHIV's perspectives on parental support and access to patient portals. The majority of YHIV participants were comfortable with their parents/guardians having full access to their portal and report parental/guardian use of the portal as a mechanism for accessing patient health information and for coordinating their HIV care. However, some YHIV reported a lack of technology savviness as a barrier to portal use among their parents/guardians. Interventions focused on building the skills of AEA patients as well as their parents/guardians to navigate the portal may serve YHIV in helping to manage living with HIV.[24] [25] Parental/guardian accessing of YHIV patient portals either via shared passwords or by parents/guardians using their own contact information to register their child's portal was also raised as a multitiered concern.[20] Concerns included compromising the confidentiality of patients and sometimes confusing the health care team about who is authoring messages to HCWs.
#
Privacy and Indirect Perceived Coercion
Our findings also highlight concerns about patient privacy and parental/guardian coercion to share passwords as relevant to both adolescent and emerging adult patients.[26] HCWs discussed that emerging adults still dependent on parents/guardians financially or for health insurance or emotional support may feel tremendous pressures to share passwords with their parents. Within the spectrum of parent typologies, from the overbearing heavily involved to the uninvolved and indifferent, some parents are weary about youth receiving health services without their knowledge and guidance.[27] Using instances of parental/guardian communication with an HCW using the child's portal account as an opportunity to encourage discussions and education about proxy accounts with patients and their parents/guardians may be a helpful intervention. On a programmatic scale, interventions that flag and intervene on accounts with matching parent and patient email or phone information may also reduce frequency of parents/guardians registered as their children.[28] [29]
#
Confidentiality: Congruency and Contradiction
Findings demonstrate heterogeneity in YHIV perspectives about parental/guardian access to patient portals; further, these perspectives were sometimes incongruent between participants when considering age and the described role of their parents in supporting HIV care. For example, most participants connect parental access to the portal as facilitators of supporting their HIV care. However, one participant who expressed not having parental support in their HIV management, still valued parental access as being important. He felt that, if something were to ever happen to him, then he would want a parent to have access to all of his medical records. On the other hand, an adolescent participant who is both strongly reliant and prefers for her mother to manage her HIV care expressed being more comfortable with partial access. Having the ability to parse out the availability of medical information to parent/guardian proxies, such as receipt of sexual health services, will help to protect patient confidentiality. HCWs must also be agile in employing new strategies to protect patient confidentiality, such as modifying clinical documentation practices within the portal.[30] Such findings highlight the responsibility of HCWs and electronic health record portal administrators to understand the various patient preferences for sharing access with parents/guardians.
#
Health Care Transitioning from Adolescents to Young Adults
The role of parent/guardian relationships strongly supportive of HIV medication adherence and well-being was particularly salient among those with PHIV and evolved from early childhood, to adolescence, and into emerging adulthood.[31] [32] Data suggest that approximately 83% of youth with special health care needs, such as YHIV, do not meet the national performance measures for health care transitions from adolescence to adulthood.[33] Consequences of inadequate transition interventions are severe,[34] including medical complications,[35] [36] [37] [38] problems with medication and treatment adherence,[39] discontinuity of care,[40] [41] [42] [43] [44] limitations in health and well-being,[45] [46] and higher care costs.[47] [48] [49] [50] Whether or not YHIV choose to allow parental/guardian access, patient portals will have a critical role in supporting increased ownership of HIV care coordination during transitions to emerging adults.[9] [51] [52] [53] [54]
#
Limitations
The current study has several limitations, including its qualitative research approach and small sample size that offsets notions of postpositivist generalizability. Qualitative inquiries, such as the current study, are directed toward providing in-depth explanations and meanings rather than generalizing findings.[55] Likewise, the current study does not explore statistical relationships between privacy preferences and specific covariates; rather, descriptive statistics reported as proportions are intended solely to describe univariate characteristics of the study sample. Therefore, future studies that are statistically powered to measure associations of age-adjusted differences in privacy preferences with factors such as, HIV transmission type and viral load, are needed. In addition, although patient portals have been in place for several years, recent 21st Century Cures Act Final Rule requirements and the coronavirus disease 2019 pandemic have served as catalysts for increasing patient utility and championing its implementation at an institutional level. Thus, HCWs appear to be in the relatively early stages of reconciling the new requirements around releasing information and efforts to protect patient confidentiality. This novelty may also explain the low number of participants utilizing proxy accounts.
#
#
Conclusion
Together, findings indicate critical opportunities to help AEA patients, their parents/guardians, and HCWs leverage the patient portal in safe and effective ways for supporting medication adherence and viral suppression among YHIV. HCWs should initiate conversations with AEA patients to determine preferences for parental/guardian access and to explain the extent of medical information to be shared, regardless of age and perceived parental involvement in HIV care. In addition, more work is needed to implement patient portals with the capacity to give AEA some parameters in customizing what sensitive information may be available to proxy accounts and to help YHIV transitioning into adolescence to set up unique parent proxy accounts.
#
Clinical Relevance Statement
YHIV HCWs should initiate conversations with their patients to determine preferences for parental/guardian access and confidentiality and to explain the extent of medical information to be shared, regardless of age and perceived parental involvement in HIV care.
#
Multiple-Choice Questions
-
In this study, YHIV report using the patient portals for the following tasks related to HIV care, except:
-
Viewing laboratory test results
-
Viewing clinical notes
-
Scheduling appointments
-
Tracking BMI
Correct Answer: The correct answer is option d. Participants did not report on tracking BMI for HIV care in this study.
-
-
According to study findings, sharing patient portal passwords directly with parents/guardians may likely:
-
Eliminate all risks of security breach
-
Confuse HCWs about who is authoring messages
-
Limit the amount of medical information available to parents
-
Prevent patients from having to reset passwords
Correct Answer: The correct answer is option b. It was reported in this study that a HCW can become confused about who is authoring a portal-based message when parents/guardians send messages using their child's patient portal account without identifying themselves.
-
#
#
Conflict of Interest
M.T. receives funding through the National Institute of Health and Research supplies through SpeeDx, LLC through a material transfer agreement (MTA) with Johns Hopkins University. M.T. receives an honorarium as a consultant for Church and Dwight, Inc. (Trojan Sexual Health Advisory Council). A.A. is on advisory boards for Gilead and ViiV and serves as a consultant for Merck. A.A. receives support from Gilead for an investigator-initiated study as well as for her role as the site principal investigator of a multisite study. The authors have no other relevant conflicts of interest to declare.
Acknowledgment
The authors thank the eSHINE II research participants for their invaluable role in supporting this study.
Protection of Human and Animal Subjects
All study activities received human subjects research ethics review and approval from the Institutional Review Board approved at [blinded]. Study data have been deidentified to protect the privacy and confidentiality of participants.
-
References
- 1 Centers for Disease Control and Prevention. HIV surveillance report, 2020. Accessed April 26, 2023. http://www.cdc.gov/hiv/library/reports/hiv-surveillance.html
- 2 Centers for Disease Control and Prevention. Ending the HIV epidemic in the U.S. (EHE). Division of HIV Prevention,. Accessed May 01, 2023 at: https://www.cdc.gov/endhiv/index.html
- 3 Centers for Disease Control and Prevention. HIV by age: viral suppression. Division of HIV Prevention, National Center for HIV, Viral Hepatitis, STD, and TB Prevention, Centers for Disease Control and Prevention. Accessed May 01, 2023 at: https://www.cdc.gov/hiv/group/age/viral-suppression.html
- 4 ONC. What is a patient portal?. 2019 Accessed April 26, 2023 at: https://www.healthit.gov/faq/what-patient-portal
- 5 Bush RA, Vemulakonda VM, Richardson AC, Deakyne Davies SJ, Chiang GJ. Providing access: differences in pediatric portal activation begin at patient check-in. Appl Clin Inform 2019; 10 (04) 670-678
- 6 Walker DM, Hefner JL, Fareed N, Huerta TR, McAlearney AS. Exploring the digital divide: age and race disparities in use of an inpatient portal. Telemed J E Health 2020; 26 (05) 603-613
- 7 Health Information National Trends Survey. Trends and Disparities in Patient Portal Use. Vol. 45. 2021. . HINTS Briefs
- 8 Lam BD, Bourgeois F, DesRoches CM, Dong Z, Bell SK. Attitudes, experiences, and safety behaviours of adolescents and young adults who read visit notes: Opportunities to engage patients early in their care. Future Healthc J 2021; 8 (03) e585-e592
- 9 Jackman KM, Latkin CA, Maksut JL, Trent ME, Sanchez TH, Baral SD. Patient portals as highly acceptable tools to support HIV preventative behaviors among adolescent and young sexual minority men. J Adolesc Health 2020; 67 (02) 278-281
- 10 Cluver LD, Toska E, Orkin FM. et al. Achieving equity in HIV-treatment outcomes: can social protection improve adolescent ART-adherence in South Africa?. AIDS Care 2016; 28 (suppl 2): 73-82
- 11 Wood D, Crapnell T, Lau L. et al. Emerging adulthood as a critical stage in the life course. In: Halfon N, Forrest CB, Lerner RM, Faustman EM. eds. Handbook of Life Course Health Development. Springer International Publishing; 2018: 123-144
- 12 Institute of Medicine. National Research Council of the National Academies Investing in the health and well-being of young adults. Washington (DC): National Academies Press (US); 2015: 1-11
- 13 Society for Adolescent Health and Medicine. Young adult health and well-being: a position statement of the society for adolescent health and medicine. J Adolesc Health 2017; 60 (06) 758-759
- 14 Spencer DL, McManus M, Call KT. et al. Health care coverage and access among children, adolescents, and young adults, 2010-2016: implications for future health reforms. J Adolesc Health 2018; 62 (06) 667-673
- 15 LeLaurin JH, Nguyen OT, Thompson LA. et al. Disparities in pediatric patient portal activation and feature use. JAMIA Open 2021; 4 (03) ooab086
- 16 Bourgeois FC, DesRoches CM, Bell SK. Ethical challenges raised by OpenNotes for pediatric and adolescent patients. Pediatrics 2018; 141 (06) e20172745
- 17 Office of the National Coordinator for Health Information Technology. Chapter 4: Allow portal access for caregivers. Accessed November 30, 2022 at: https://www.healthit.gov/playbook/pe/chapter-4/
- 18 Sharko M, Jameson R, Ancker JS, Krams L, Webber EC, Rosenbloom ST. State-by-state variability in adolescent privacy laws. Pediatrics 2022; 149 (06) e2021053458
- 19 Johns Hopkins Medicine. MyChart for parents and caregivers: accessing another person's health records. Accessed November 30, 2022 at: https://www.hopkinsmedicine.org/patient_care/mychart/proxy-access.html
- 20 Ip W, Yang S, Parker J. et al. Assessment of prevalence of adolescent patient portal account access by guardians. JAMA Netw Open 2021; 4 (09) e2124733
- 21 Copen CE, Dittus PJ, Leichliter JS. Confidentiality concerns and sexual and reproductive health care among adolescents and young adults aged 15-25. NCHS Data Brief 2016; (266) 1-8
- 22 Agwu AL, Yusuf HE, D'Angelo L. et al. Recruitment of youth living with HIV to optimize adherence and virologic suppression: testing the design of technology-based community health nursing to improve antiretroviral therapy (ART) clinical trials. JMIR Res Protoc 2020; 9 (12) e23480
- 23 Braun V, Clarke V. Thematic analysis. Vol. 2. APA Handbook of Research Methods in Psychology. American Psychological Association; 2012
- 24 Stein JN, Klein JW, Payne TH. et al. Communicating with vulnerable patient populations: a randomized intervention to teach inpatients to use the electronic patient portal. Appl Clin Inform 2018; 9 (04) 875-883
- 25 Ramsey A, Lanzo E, Huston-Paterson H, Tomaszewski K, Trent M. Increasing patient portal usage: preliminary outcomes from the MyChart genius project. J Adolesc Health 2018; 62 (01) 29-35
- 26 Thompson LA, Martinko T, Budd P, Mercado R, Schentrup AM. Meaningful use of a confidential adolescent patient portal. J Adolesc Health 2016; 58 (02) 134-140
- 27 Thompson LA, Black EW, Saliba H, Schentrup AM. Parents' knowledge of and opinions about healthcare laws and technology in primary care. Inform Prim Care 2012; 20 (01) 69-74
- 28 Xie J, Hogan A, McPherson T, Pageler N, Lee T, Carlson J. Creating a guardrail system to ensure appropriate activation of adolescent portal accounts. Appl Clin Inform 2023; 14 (02) 258-262
- 29 Xie J, McPherson T, Powell A. et al. Ensuring adolescent patient portal confidentiality in the age of the cures act final rule. J Adolesc Health 2021; 69 (06) 933-939
- 30 Kanungo S, Barr J, Crutchfield P, Fealko C, Soares N. Ethical considerations on pediatric genetic testing results in electronic health records. Appl Clin Inform 2020; 11 (05) 755-763
- 31 Mellins CA, Malee KM. Understanding the mental health of youth living with perinatal HIV infection: lessons learned and current challenges. J Int AIDS Soc 2013; 16 (01) 18593
- 32 Nichols SL, Montepiedra G, Farley JJ. et al; PACTG P1042S Team. Cognitive, academic, and behavioral correlates of medication adherence in children and adolescents with perinatally acquired HIV infection. J Dev Behav Pediatr 2012; 33 (04) 298-308
- 33 Lebrun-Harris LA, McManus MA, Ilango SM. et al. Transition planning among US youth with and without special health care needs. Pediatrics 2018; 142 (04) e20180194
- 34 White PH, Cooley WC. TRANSITIONS CLINICAL REPORT AUTHORING GROUP, AMERICAN ACADEMY OF PEDIATRICS, AMERICAN ACADEMY OF FAMILY PHYSICIANS, AMERICAN COLLEGE OF PHYSICIANS. Supporting the health care transition from adolescence to adulthood in the medical home. Pediatrics 2018; 142 (05) e20182587
- 35 Foster BJ. Heightened graft failure risk during emerging adulthood and transition to adult care. Pediatr Nephrol 2015; 30 (04) 567-576
- 36 Majumdar S. The adolescent with sickle cell disease. Adolesc Med State Art Rev 2013; 24 (01) 295-306 , xv
- 37 Wafa S, Nakhla M. Improving the transition from pediatric to adult diabetes healthcare: a literature review. Can J Diabetes 2015; 39 (06) 520-528
- 38 Yeung E, Kay J, Roosevelt GE, Brandon M, Yetman AT. Lapse of care as a predictor for morbidity in adults with congenital heart disease. Int J Cardiol 2008; 125 (01) 62-65
- 39 Annunziato RA, Baisley MC, Arrato N. et al. Strangers headed to a strange land? A pilot study of using a transition coordinator to improve transfer from pediatric to adult services. J Pediatr 2013; 163 (06) 1628-1633
- 40 Bohun CM, Woods P, Winter C. et al. Challenges of intra-institutional transfer of care from paediatric to adult congenital cardiology: the need for retention as well as transition. Cardiol Young 2016; 26 (02) 327-333
- 41 Luque Ramos A, Hoffmann F, Albrecht K, Klotsche J, Zink A, Minden K. Transition to adult rheumatology care is necessary to maintain DMARD therapy in young people with juvenile idiopathic arthritis. Semin Arthritis Rheum 2017; 47 (02) 269-275
- 42 Montano CB, Young J. Discontinuity in the transition from pediatric to adult health care for patients with attention-deficit/hyperactivity disorder. Postgrad Med 2012; 124 (05) 23-32
- 43 Szymanski KM, Cain MP, Hardacker TJ, Misseri R. How successful is the transition to adult urology care in spina bifida? A single center 7-year experience. J Pediatr Urol 2017; 13 (01) 40.e1-40.e6
- 44 Wojciechowski EA, Hurtig A, Dorn L. A natural history study of adolescents and young adults with sickle cell disease as they transfer to adult care: a need for case management services. J Pediatr Nurs 2002; 17 (01) 18-27
- 45 Chaudhry SR, Keaton M, Nasr SZ. Evaluation of a cystic fibrosis transition program from pediatric to adult care. Pediatr Pulmonol 2013; 48 (07) 658-665
- 46 Maslow G, Adams C, Willis M. et al. An evaluation of a positive youth development program for adolescents with chronic illness. J Adolesc Health 2013; 52 (02) 179-185
- 47 Barr NG, Longo CJ, Embrett MG, Mulvale GM, Nguyen T, Randall GE. The transition from youth to adult mental health services and the economic impact on youth and their families. Healthc Manage Forum 2017; 30 (06) 283-288
- 48 Cohen E, Gandhi S, Toulany A. et al. Health care use during transfer to adult care among youth with chronic conditions. Pediatrics 2016; 137 (03) e20152734
- 49 Lochridge J, Wolff J, Oliva M, O'Sullivan-Oliveira J. Perceptions of solid organ transplant recipients regarding self-care management and transitioning. Pediatr Nurs 2013; 39 (02) 81-89
- 50 Mosquera RA, Avritscher EB, Samuels CL. et al. Effect of an enhanced medical home on serious illness and cost of care among high-risk children with chronic illness: a randomized clinical trial. JAMA 2014; 312 (24) 2640-2648
- 51 Badawy SM, Kuhns LM. Economic evaluation of text-messaging and smartphone-based interventions to improve medication adherence in adolescents with chronic health conditions: a systematic review. JMIR Mhealth Uhealth 2016; 4 (04) e121
- 52 Coyne I, Prizeman G, Sheehan A, Malone H, While AE. An e-health intervention to support the transition of young people with long-term illnesses to adult healthcare services: design and early use. Patient Educ Couns 2016; 99 (09) 1496-1504
- 53 Griffiths F, Bryce C, Cave J. et al. Timely digital patient-clinician communication in specialist clinical services for young people: a mixed-methods study (the LYNC study). J Med Internet Res 2017; 19 (04) e102
- 54 Raymond JK. Models of care for adolescents and young adults with type 1 diabetes in transition: shared medical appointments and telemedicine. Pediatr Ann 2017; 46 (05) e193-e197
- 55 Carminati L. Generalizability in qualitative research: a tale of two traditions. Qual Health Res 2018; 28 (13) 2094-2101
Address for correspondence
Publication History
Received: 15 December 2022
Accepted: 15 July 2023
Article published online:
20 September 2023
© 2023. Thieme. All rights reserved.
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Centers for Disease Control and Prevention. HIV surveillance report, 2020. Accessed April 26, 2023. http://www.cdc.gov/hiv/library/reports/hiv-surveillance.html
- 2 Centers for Disease Control and Prevention. Ending the HIV epidemic in the U.S. (EHE). Division of HIV Prevention,. Accessed May 01, 2023 at: https://www.cdc.gov/endhiv/index.html
- 3 Centers for Disease Control and Prevention. HIV by age: viral suppression. Division of HIV Prevention, National Center for HIV, Viral Hepatitis, STD, and TB Prevention, Centers for Disease Control and Prevention. Accessed May 01, 2023 at: https://www.cdc.gov/hiv/group/age/viral-suppression.html
- 4 ONC. What is a patient portal?. 2019 Accessed April 26, 2023 at: https://www.healthit.gov/faq/what-patient-portal
- 5 Bush RA, Vemulakonda VM, Richardson AC, Deakyne Davies SJ, Chiang GJ. Providing access: differences in pediatric portal activation begin at patient check-in. Appl Clin Inform 2019; 10 (04) 670-678
- 6 Walker DM, Hefner JL, Fareed N, Huerta TR, McAlearney AS. Exploring the digital divide: age and race disparities in use of an inpatient portal. Telemed J E Health 2020; 26 (05) 603-613
- 7 Health Information National Trends Survey. Trends and Disparities in Patient Portal Use. Vol. 45. 2021. . HINTS Briefs
- 8 Lam BD, Bourgeois F, DesRoches CM, Dong Z, Bell SK. Attitudes, experiences, and safety behaviours of adolescents and young adults who read visit notes: Opportunities to engage patients early in their care. Future Healthc J 2021; 8 (03) e585-e592
- 9 Jackman KM, Latkin CA, Maksut JL, Trent ME, Sanchez TH, Baral SD. Patient portals as highly acceptable tools to support HIV preventative behaviors among adolescent and young sexual minority men. J Adolesc Health 2020; 67 (02) 278-281
- 10 Cluver LD, Toska E, Orkin FM. et al. Achieving equity in HIV-treatment outcomes: can social protection improve adolescent ART-adherence in South Africa?. AIDS Care 2016; 28 (suppl 2): 73-82
- 11 Wood D, Crapnell T, Lau L. et al. Emerging adulthood as a critical stage in the life course. In: Halfon N, Forrest CB, Lerner RM, Faustman EM. eds. Handbook of Life Course Health Development. Springer International Publishing; 2018: 123-144
- 12 Institute of Medicine. National Research Council of the National Academies Investing in the health and well-being of young adults. Washington (DC): National Academies Press (US); 2015: 1-11
- 13 Society for Adolescent Health and Medicine. Young adult health and well-being: a position statement of the society for adolescent health and medicine. J Adolesc Health 2017; 60 (06) 758-759
- 14 Spencer DL, McManus M, Call KT. et al. Health care coverage and access among children, adolescents, and young adults, 2010-2016: implications for future health reforms. J Adolesc Health 2018; 62 (06) 667-673
- 15 LeLaurin JH, Nguyen OT, Thompson LA. et al. Disparities in pediatric patient portal activation and feature use. JAMIA Open 2021; 4 (03) ooab086
- 16 Bourgeois FC, DesRoches CM, Bell SK. Ethical challenges raised by OpenNotes for pediatric and adolescent patients. Pediatrics 2018; 141 (06) e20172745
- 17 Office of the National Coordinator for Health Information Technology. Chapter 4: Allow portal access for caregivers. Accessed November 30, 2022 at: https://www.healthit.gov/playbook/pe/chapter-4/
- 18 Sharko M, Jameson R, Ancker JS, Krams L, Webber EC, Rosenbloom ST. State-by-state variability in adolescent privacy laws. Pediatrics 2022; 149 (06) e2021053458
- 19 Johns Hopkins Medicine. MyChart for parents and caregivers: accessing another person's health records. Accessed November 30, 2022 at: https://www.hopkinsmedicine.org/patient_care/mychart/proxy-access.html
- 20 Ip W, Yang S, Parker J. et al. Assessment of prevalence of adolescent patient portal account access by guardians. JAMA Netw Open 2021; 4 (09) e2124733
- 21 Copen CE, Dittus PJ, Leichliter JS. Confidentiality concerns and sexual and reproductive health care among adolescents and young adults aged 15-25. NCHS Data Brief 2016; (266) 1-8
- 22 Agwu AL, Yusuf HE, D'Angelo L. et al. Recruitment of youth living with HIV to optimize adherence and virologic suppression: testing the design of technology-based community health nursing to improve antiretroviral therapy (ART) clinical trials. JMIR Res Protoc 2020; 9 (12) e23480
- 23 Braun V, Clarke V. Thematic analysis. Vol. 2. APA Handbook of Research Methods in Psychology. American Psychological Association; 2012
- 24 Stein JN, Klein JW, Payne TH. et al. Communicating with vulnerable patient populations: a randomized intervention to teach inpatients to use the electronic patient portal. Appl Clin Inform 2018; 9 (04) 875-883
- 25 Ramsey A, Lanzo E, Huston-Paterson H, Tomaszewski K, Trent M. Increasing patient portal usage: preliminary outcomes from the MyChart genius project. J Adolesc Health 2018; 62 (01) 29-35
- 26 Thompson LA, Martinko T, Budd P, Mercado R, Schentrup AM. Meaningful use of a confidential adolescent patient portal. J Adolesc Health 2016; 58 (02) 134-140
- 27 Thompson LA, Black EW, Saliba H, Schentrup AM. Parents' knowledge of and opinions about healthcare laws and technology in primary care. Inform Prim Care 2012; 20 (01) 69-74
- 28 Xie J, Hogan A, McPherson T, Pageler N, Lee T, Carlson J. Creating a guardrail system to ensure appropriate activation of adolescent portal accounts. Appl Clin Inform 2023; 14 (02) 258-262
- 29 Xie J, McPherson T, Powell A. et al. Ensuring adolescent patient portal confidentiality in the age of the cures act final rule. J Adolesc Health 2021; 69 (06) 933-939
- 30 Kanungo S, Barr J, Crutchfield P, Fealko C, Soares N. Ethical considerations on pediatric genetic testing results in electronic health records. Appl Clin Inform 2020; 11 (05) 755-763
- 31 Mellins CA, Malee KM. Understanding the mental health of youth living with perinatal HIV infection: lessons learned and current challenges. J Int AIDS Soc 2013; 16 (01) 18593
- 32 Nichols SL, Montepiedra G, Farley JJ. et al; PACTG P1042S Team. Cognitive, academic, and behavioral correlates of medication adherence in children and adolescents with perinatally acquired HIV infection. J Dev Behav Pediatr 2012; 33 (04) 298-308
- 33 Lebrun-Harris LA, McManus MA, Ilango SM. et al. Transition planning among US youth with and without special health care needs. Pediatrics 2018; 142 (04) e20180194
- 34 White PH, Cooley WC. TRANSITIONS CLINICAL REPORT AUTHORING GROUP, AMERICAN ACADEMY OF PEDIATRICS, AMERICAN ACADEMY OF FAMILY PHYSICIANS, AMERICAN COLLEGE OF PHYSICIANS. Supporting the health care transition from adolescence to adulthood in the medical home. Pediatrics 2018; 142 (05) e20182587
- 35 Foster BJ. Heightened graft failure risk during emerging adulthood and transition to adult care. Pediatr Nephrol 2015; 30 (04) 567-576
- 36 Majumdar S. The adolescent with sickle cell disease. Adolesc Med State Art Rev 2013; 24 (01) 295-306 , xv
- 37 Wafa S, Nakhla M. Improving the transition from pediatric to adult diabetes healthcare: a literature review. Can J Diabetes 2015; 39 (06) 520-528
- 38 Yeung E, Kay J, Roosevelt GE, Brandon M, Yetman AT. Lapse of care as a predictor for morbidity in adults with congenital heart disease. Int J Cardiol 2008; 125 (01) 62-65
- 39 Annunziato RA, Baisley MC, Arrato N. et al. Strangers headed to a strange land? A pilot study of using a transition coordinator to improve transfer from pediatric to adult services. J Pediatr 2013; 163 (06) 1628-1633
- 40 Bohun CM, Woods P, Winter C. et al. Challenges of intra-institutional transfer of care from paediatric to adult congenital cardiology: the need for retention as well as transition. Cardiol Young 2016; 26 (02) 327-333
- 41 Luque Ramos A, Hoffmann F, Albrecht K, Klotsche J, Zink A, Minden K. Transition to adult rheumatology care is necessary to maintain DMARD therapy in young people with juvenile idiopathic arthritis. Semin Arthritis Rheum 2017; 47 (02) 269-275
- 42 Montano CB, Young J. Discontinuity in the transition from pediatric to adult health care for patients with attention-deficit/hyperactivity disorder. Postgrad Med 2012; 124 (05) 23-32
- 43 Szymanski KM, Cain MP, Hardacker TJ, Misseri R. How successful is the transition to adult urology care in spina bifida? A single center 7-year experience. J Pediatr Urol 2017; 13 (01) 40.e1-40.e6
- 44 Wojciechowski EA, Hurtig A, Dorn L. A natural history study of adolescents and young adults with sickle cell disease as they transfer to adult care: a need for case management services. J Pediatr Nurs 2002; 17 (01) 18-27
- 45 Chaudhry SR, Keaton M, Nasr SZ. Evaluation of a cystic fibrosis transition program from pediatric to adult care. Pediatr Pulmonol 2013; 48 (07) 658-665
- 46 Maslow G, Adams C, Willis M. et al. An evaluation of a positive youth development program for adolescents with chronic illness. J Adolesc Health 2013; 52 (02) 179-185
- 47 Barr NG, Longo CJ, Embrett MG, Mulvale GM, Nguyen T, Randall GE. The transition from youth to adult mental health services and the economic impact on youth and their families. Healthc Manage Forum 2017; 30 (06) 283-288
- 48 Cohen E, Gandhi S, Toulany A. et al. Health care use during transfer to adult care among youth with chronic conditions. Pediatrics 2016; 137 (03) e20152734
- 49 Lochridge J, Wolff J, Oliva M, O'Sullivan-Oliveira J. Perceptions of solid organ transplant recipients regarding self-care management and transitioning. Pediatr Nurs 2013; 39 (02) 81-89
- 50 Mosquera RA, Avritscher EB, Samuels CL. et al. Effect of an enhanced medical home on serious illness and cost of care among high-risk children with chronic illness: a randomized clinical trial. JAMA 2014; 312 (24) 2640-2648
- 51 Badawy SM, Kuhns LM. Economic evaluation of text-messaging and smartphone-based interventions to improve medication adherence in adolescents with chronic health conditions: a systematic review. JMIR Mhealth Uhealth 2016; 4 (04) e121
- 52 Coyne I, Prizeman G, Sheehan A, Malone H, While AE. An e-health intervention to support the transition of young people with long-term illnesses to adult healthcare services: design and early use. Patient Educ Couns 2016; 99 (09) 1496-1504
- 53 Griffiths F, Bryce C, Cave J. et al. Timely digital patient-clinician communication in specialist clinical services for young people: a mixed-methods study (the LYNC study). J Med Internet Res 2017; 19 (04) e102
- 54 Raymond JK. Models of care for adolescents and young adults with type 1 diabetes in transition: shared medical appointments and telemedicine. Pediatr Ann 2017; 46 (05) e193-e197
- 55 Carminati L. Generalizability in qualitative research: a tale of two traditions. Qual Health Res 2018; 28 (13) 2094-2101