Skip to main content
  • Study Protocol
  • Open access
  • Published:

Integrating long-acting injectable treatment to improve medication adherence among persons living with HIV and opioid use disorder: study protocol

Abstract

Background

Oral antiretroviral therapy (ART) has been effective at reducing mortality rates of people with HIV. However, despite its effectiveness, people who use drugs face barriers to maintaining ART adherence. Receipt of opioid agonist treatment, in the context of HIV care, is associated with medication adherence and decreased HIV viral loads. Recent pharmacological advancements have led to the development of novel long-acting, injectable, medications for both HIV (cabotegravir co-administered with rilpivirine) and OUD (extended-release buprenorphine). These therapies have the potential to dramatically improve adherence by eliminating the need for daily pill-taking. Despite the extensive evidence base supporting long-acting injectable medications for both HIV and OUD, and clinical guidelines supporting integrated care provision, currently little is known about how these medications may be optimally delivered to this population. This paper presents the study design for the development of a clinical protocol to guide the delivery of combined treatment for HIV and OUD using long-acting injectable medications.

Methods

The study aims are to: (1) develop a clinical protocol to guide the delivery of combined LAI for HIV and OUD by conducting in-depth interviews with prospective patients, clinical content experts, and other key stakeholders; and (2) conduct This single group, open pilot trial protocol to assess feasibility, acceptability, and safety among patients diagnosed with HIV and OUD. Throughout all phases of the study, information on patient-, provider-, and organizational-level variables will be collected to inform future implementation.

Discussion

Findings from this study will inform the development of a future study to conduct a fully-powered Hybrid Type 1 Effectiveness-Implementation design.

Background

The overdose epidemic continues to be a major public health crisis in the United States, with rates of opioid-involved fatal and non-fatal overdoses steadily rising [1, 2]. Persons with HIV (PWH) who use drugs are especially vulnerable to fatal overdose [3]. Moreover, untreated opioid use disorder (OUD) is associated with higher rates of HIV infection and transmission [4, 5]. Despite a decline in new HIV infections from 2000 to 2015, regions across the United States have documented an increase in isolated HIV outbreaks among people who inject drugs [6]. The COVID-19 pandemic has further complicated this issue as rates of injection drug use, as well as fatal and non-fatal overdoses, have continued to rise [1]. Such data highlight the complex association between HIV and OUD, and the significant societal impact of these intertwined epidemics [7].

Oral antiretroviral therapy (ART) has been effective at reducing mortality rates of PWH, including PWH who use drugs. However, despite its effectiveness, people who use drugs often face barriers to maintaining ART adherence, thereby increasing their risk of HIV disease progression, a shortened lifespan, greater risk of HIV transmission, and the development of treatment resistant strains of HIV [8,9,10,11,12,13,14]. Relative to those who do not use drugs, PWH who use drugs are more than twice as likely to face social and structural inequities (e.g., housing instability, insurance barriers) impacting their adherence to ART, thereby contributing to increased morbidity, mortality, and onward HIV transmission [8,9,10, 15,16,17].

Treatment services for HIV and OUD have historically been delivered across multiple settings leading to fragmented and uncoordinated care. Along the continuum of care, people who use drugs frequently experience substantial disruptions, including delayed entry into HIV care [18, 19], suboptimal initiation of ART during advanced stages of disease [20], and discontinuation of ART [21, 22]. Models of behavior change suggest that addressing multiple chronic conditions simultaneously through integrated, evidence-based interventions can have a synergistic effect resulting in improved health-related outcomes [23,24,25]. Consistent with this perspective, numerous studies have documented that receipt of medications for OUD in the context of HIV care is associated with treatment retention, ART adherence, and HIV viral suppression [26,27,28,29]. In light of the Ending the HIV Epidemic campaign to reduce new HIV infections in the United States by 90% by 2030 [30], there have been calls to develop integrated or co-located HIV and OUD services to expand access to care [31,32,33,34]. Integrated treatment models that improve adherence to HIV and OUD care are critical to prevent the continued spread of HIV in the context of the current overdose crisis (see Fig. 1).

Fig. 1
figure 1

Conceptualization of integrated treatment for HIV and OUD

Recent advances in pharmacological treatment have led to the development of novel long-acting injectable (LAI) medications for HIV (cabotegravir co-administered with rilpivirine; CAB/RPV) and OUD (extended-release buprenorphine; XR-B). These therapies have the potential to improve adherence significantly, lead to better control of both diseases, and reduce mortality rates for PWH who use drugs. Further, LAI ART may have an advantage over daily oral ART in preventing sub-therapeutic drug levels resulting from missed oral doses that can lead to HIV drug resistance [35,36,37]. However, missed LAI ART injections or discontinuation of LAI ART without prompt initiation of oral ART also carries the risk of developing ART resistance. The goal of LAI ART is to have a multi-drug regimen that is delivered by intramuscular injection, with reliable pharmacokinetic properties to allow for infrequent dosing (currently approved for monthly or bi-monthly dosing), and to achieve comparable potency and efficacy to oral ART with similar side effect profiles [38]. Clinical trial data demonstrate non-inferiority of monthly injections of ART compared to the ‘gold standard’ oral daily ART [39]. Further, more than 90% of participants who received LAI in randomized clinical trials preferred monthly injectable therapy over daily oral therapy [40]. For patients with OUD, XR-B is a once-monthly buprenorphine injection designed to deliver therapeutic plasma concentrations for the treatment of moderate to severe OUD [41]. XR-B has demonstrated efficacy and safety in the community [42, 43]. Compared to sublingual forms of buprenorphine, XR-B offers potential feasibility benefits including reduced likelihood of diversion and improved medication adherence to avoid illicit opioid use and overdose.

Despite the potential of integrating LAI medications for HIV and OUD, there are substantial gaps in knowledge about how to best co-deliver treatment. First, in the LAI ART trials, individuals with an active substance use disorder were excluded from participation, thus, the experiences of those with an OUD were not represented. Second, past research has yet to fully evaluate: (a) perceived acceptability/feasibility of combining LAI medications for HIV and OUD into a single point of care; (b) the safety of co-administering LAI medications for HIV and OUD; (c) which populations and in what type of settings these medications may be optimally delivered; and (d) what factors may impede or facilitate future implementation of co-locating these treatments. This study protocol fills existing research gaps by conducting formative research to develop a clinical protocol combining LAI medications for the treatment of HIV and OUD, and subsequently evaluating the feasibility, acceptability, safety, and scalability of this novel, integrated delivery model in a single group, open pilot trial protocol.

Methods

Study design overview

The proposed project consists of two phases that will be conducted in an outpatient setting. Phase 1 includes in-depth individual interviews with PWH and have an OUD (n = 14–20) and in-depth interviews with key stakeholders in the fields of addiction medicine (n = 5–7), HIV care (n = 5–7), and pharmacy (n = 5–7). Research suggests that it is possible to achieve saturation with a sample size of 7–10 participants [44]. As such, we will aim to recruit a minimum of 7–10 patients in each subgroup (patients, stakeholders), however, we will continue recruitment until saturation of key themes is achieved. Phase 1 will culminate in the development of a clinical protocol to guide the delivery of combined LAI treatment for HIV and OUD and will be directly informed by the interview data. In Phase 2, the clinical protocol and implementation approach will be piloted with 40 PWH and an OUD. A sample size of 40 was selected to garner information about our study design as well as determine what modification may be needed to develop a larger, hypothesis testing, study in the future [45, 46]. Participants enrolled will first complete a baseline interview, followed by an evaluation with a physician to determine appropriateness for LAI (for HIV and OUD). Participants will then be scheduled to complete injection appointments to initiate CAP/RPV and XR-B. Follow-up interviews will occur at 1-, 3-, and 6-months post LAI injection to evaluate feasibility/acceptability and safety of the combined LAI treatment. Feedback from participants, study staff, and stakeholders will guide further refinement of the protocol and implementation approach for a future large-scale study. At the conclusion of Phase 2, we will have finalized the clinical protocol including recommendations for implementation. These data will be used to inform the development of a large-scale, fully-powered, Hybrid Type I Effectiveness-Implementation trial. At the time of this report, recruitment for Phase 1 is ongoing. This study is registered at ClinicalTrials.gov under protocol #NCT05991622. The study was registered during Phase 1, prior to the onset of the single-arm open pilot trial.

Phase 1

Qualitative in-depth, individual interviews are currently being conducted with PWH who meet the criteria for a lifetime history of OUD, and key stakeholders relevant to addiction medicine and HIV care. Following informed consent, demographic and clinical data are obtained for participant interviews. Interviews are conducted by a trained Research Assistant either in-person in a private room or via videoconferencing (per participant preference). Interview guides are informed by the Adaptome, a framework developed to advance the science of intervention adaptation that highlights multiple dimensions to consider when attempting to optimize the fit of existing intervention(s) within a specific context [47]. Because the combined LAI treatment builds upon two existing interventions, the dimensions of the Adaptome are used to guide development of an integrated intervention delivery model. There are two separate interview guides—one developed for potential patients and the other developed for key stakeholders—they contain questions across several key areas: service setting considerations (e.g., who will deliver the intervention?, which setting(s) are optimal for intervention provision?, how will the intervention fit with existing service provision?, who will finance the intervention delivery?); target audience considerations (e.g., how will patients be identified for LAI receipt?, how will eligibility and appropriateness for LAI receipt be determined?); mode of delivery considerations (e.g., how many sessions should be required prior to and following injection receipt?, how long should the injection process take?, what education, if any, should be provided along with the injections?, what additional services are needed to ensure adequate support and treatment response?); and cultural adaptations (e.g., how might this delivery be modified to meet the needs of special populations?). Each interview lasts approximately 45–60 min and participants receive $50 for their time. Interviews are transcribed by a professional transcription agency, and reviewed for accuracy by the Research Assistant.

Trained Research Assistants will review and clean all transcripts prior to uploading them into QSR NVivo [11, 48], a qualitative data management and analysis software. A preliminary coding structure will be derived deductively from the interview topic guides, with specific subtype coding applied inductively as themes and repetitions emerge from the data. Two independent coders (research assistants trained in qualitative methods) will code each transcript. The coders, in conjunction with the Principal Investigator (PI; KJL), will develop a list of thematic codes arising from the data, which include a priori codes derived from the agendas as well as codes arising from emergent data [49, 50]. The coders will double-code all transcripts. The coders and PI will meet to review and discuss the code assignments and reconcile any discrepancies. After consensus is reached, a final master code will be entered into NVivo. Data analysis will be iterative using standard analysis techniques, including open coding, axial coding, marginal remarks, and memo-writing [49, 50]. Transcripts will be reviewed by the PI and other members of the study team, who will discuss transcripts to analyze themes, conduct subcode analyses and stratified analyses where indicated, and determine the implications of the data for protocol development. An audit trail of coding decisions and other aspects of analysis will be kept.

Phase 2

Information garnered from Phase 1, including level of interest in LAI, will be used to develop a clinical protocol to guide the delivery of the combined LAI treatment. Interviews in Phase 1 will also explore barriers and facilitators to medication uptake, which will be addressed in the clinical protocol, with the goal of bolstering participation. Forty participants diagnosed with HIV and an OUD, and meeting the other study inclusion criteria (described below in “Participants” section), will be enrolled in an open pilot trial designed to examine metrics of feasibility, acceptability, and safety. Participants will complete a baseline interview, receive the combined LAI treatment (described below in “Combined LAI treatment for OUD and HIV” section), and complete follow-up assessments at 1-, 3-, and 6-months following initiation of injectable medication. Of the 40 participants, 24 will be invited to engage in qualitative interviews to assess the strengths and limitations of the clinical protocol and combined treatment as well as describe their reasons for LAI uptake or discontinuation; the 24 participants will be purposefully selected based on level of engagement. Specifically, we will conduct interviews with 12 participants with high levels of engagement in the clinical protocol and 12 participants with low engagement with the clinical protocol. We will also elicit feedback from clinic staff and other key stakeholders regarding the delivery of the clinical protocol and other implementation factors.

Participants

In both phases, inclusion criteria for patients will reflect the requirements for initiating LAI ART and/or XR-B and are as follows: (1) 18–65 years of age; (2) HIV-1 infection, documented by any licensed rapid HIV test or HIV enzyme or chemiluminescence immunoassay; (3) current diagnosis of an OUD, moderate-severe, according to DSM-5; (4) not currently pregnant, breastfeeding, planning to become pregnant or breastfeed during the study period; (5) no coinfection of hepatitis B, or plans to get treated for hepatitis C during the study period; (6) amenable to starting injectable medications; (7) able to understand and speak English; 8) able and willing to provide written and verbal informed consent. Patients who are actively engaged in other MOUD regimens will still be considered if they are interested in transitioning to XR-B. Exclusion criteria include: (1) those that are not virologically suppressed (HIV-1 RNA > 50 copies/mL) given this aligns with the current FDA approval for administering CAB/RPV; (2) resistance to cabotegravir or rilpivirine; or (3) allergies, significant drug–drug interactions, or any other contraindications to the individual components of the medications. Interviews will continue until saturation is achieved. Inclusion criteria for key stakeholders are: (1) ≥ 18 years of age; (2) have experience working with populations diagnosed with either HIV, OUD, or a co-occurrence of both conditions; (3) have knowledge of medications used to treat HIV and OUD as defined by prior receipt of training in the provision of these medications; (4) fluent in English; and (5) are willing and able to provide informed consent.

Study setting

The Miriam Hospital Immunology Center

The Miriam Hospital Immunology Center is in Providence, Rhode Island and is part of the larger Lifespan Healthcare System. The Immunology Center cares for nearly 90% of persons infected with HIV/AIDS who are in care in Rhode Island and also patients from nearby areas of Connecticut and Massachusetts. The Immunology Center currently serves over 1800 PWH, providing comprehensive HIV care including gynecological care, mental health support, substance use treatment with medication (primarily buprenorphine products), and case management [51]. Recent clinic data suggests that there are over 100 patients actively involved in treatment for OUD within the Immunology Center.

Study procedures

The study team will work with clinic staff to inform patients of the potential research opportunity. Potential participants will also be informed of the study through social media, flyers, and mailings. Research personnel will approach potential participants to carefully explain all aspects of the study, obtain informed consent, and determine initial eligibility. All assessments and interviews will occur in a private room at the Miriam Hospital Immunology Center.

Compensation and retention

To enhance likelihood of study retention, an increasing schedule of monetary compensation will be utilized. Participants will receive $40 for completion of the baseline interview, $40 for completion of assessments administered following the injection appointment, and $45, $50, and $60, respectively, for the 1-, 3-, and 6-month follow-up appointments. Additionally, the 25 participants who complete a qualitative interview at the end of the study will receive an additional $50.

Intervention condition

Combined LAI treatment for OUD and HIV

The specific timing, structure, and implementation approach for combined LAI treatment will be guided by the in-depth interviews conducted during Phase 1. However, the anticipated protocol for combined LAI treatment in the outpatient setting is described herein. Key treatment team members will include HIV Physicians, Addiction Medicine Physicians, Pharmacists, Adherence Nurses, Administering Nurses, and Pharmacy Liaisons. Additionally, given the high-risk and vulnerable nature of this population, it is expected that additional wrap-around services may be warranted such as access to a certified peer recovery specialist, social work/case management, and behavioral health counseling. These services are readily available through the Immunology Center and will be incorporated into the clinical protocol should this emerge as a recommendation based upon the qualitative data obtained in Phase 1.

Lead-in period

Participants will begin the clinical protocol with an initial evaluation with a physician to evaluate appropriateness for LAI formularies, discuss the advantages, disadvantages, safety, and efficacy of medication, provide education on the relationship between HIV and OUD and the impact on treatment, emphasize the importance of maintaining monthly injections, and answer any questions. At this appointment, patient who have not yet initiated buprenorphine will be prescribed sublingual buprenorphine for 7 days prior to initiating XR-B.

Initiating injectables

At the injection visit, an adherence nurse will administer the injections according to standard instructions and observe the participant for approximately 10 min to ensure there is no adverse reaction. The participant will be scheduled for a second injection appointment within 26–28 days, as well as a follow-up visit with the study physician. The treatment team will outreach the participant, via phone/text, in weekly intervals following the first injections to assess for tolerability, adverse effects, and desire to continue this course of treatment. The timing of each injection (XR-B and CAP/RPV) may not initially be concurrent, but the treatment team will work with patients to adjust the dosing to eventually achieve co-administration of both treatments. The XR-B is injected into the abdominal subcutaneous space, whereas the ART is injected into both gluteal muscles. The LAI medications will not be routinely provided as part of the study in an effort to reflect “real-world” conditions. An important component of the study will be to evaluate if the insurance process presents as a barrier to CAB/RPV and XR-B uptake.

Missed appointments/discontinuation

The treatment team will be in close contact with participants to encourage appropriate follow-up care and adherence to medication. If the patient is rescheduled within 35 days from last injection, no additional intervention is necessary. If, however, the ART injection is missed within the approved timeframe, oral ART will be resumed and reevaluation by a physician will be required prior to restarting the injections. A similar protocol will be followed for XR-B. That is, participants who do not return to the clinic within 6 weeks of the last injection, will be encouraged to resume sublingual buprenorphine for 7 days prior to restarting injectables. Participants wishing to discontinue LAI (ART or XR-B) will be encouraged to resume oral/sublingual therapies. To increase our ability to follow participants and encourage treatment adherence, permission will be requested from participants during the consent process to obtain additional contact information from close family members and friends to outreach in the event the participant does not present for scheduled appointments.

Assessments (described in Table 1)

Screening

The study screening will assess all inclusion and exclusion criteria. Self-reported HIV status will be confirmed with HIV test result extracted from participants’ medical record. Pregnancy tests will be performed on all people assigned female at birth, of childbearing age, without documented tubal ligation or hysterectomy. This will be completed as part of routine clinical care and verified via the medical record. Hepatitis B and C coinfection will similarly be determined through medical record review.

Table 1 Study measures

Demographics

Using the PhenX toolkit [52], a web-based catalog of recommended measurement protocols, basic demographic data and social determinants of health will be collected at baseline to characterize the sample of participants.

Feasibility/acceptability

At the conclusion of the study, information will be compiled about the percent of patients interested in the treatment, patient eligibility rate, consent rate, rate of recruitment, percent of participants who initiate injectables, follow-up completion rate (through 6 months), and reasons for refusal to evaluate the feasibility of conducting a subsequent larger scale study using this protocol. Additionally, study withdrawal rates and rates of discontinuation of injectables will be measured as indices of acceptability. Intervention acceptability and feasibility will also be assessed by asking each participant to complete the 8-item Client Satisfaction Questionnaire-Revised which has been extensively studied, has excellent internal consistency, reliability, and convergent validity, and has been shown to operate similarly across different racial and ethnic groups [53]. Self-report of engagement in treatment will be assessed with the 4-item Treatment Effectiveness Assessment [54], a measure with acceptable reliability and validity used in measuring treatment progress and recovery for substance use disorders including OUDs.

Safety

To determine safety of the proposed intervention, HIV viral loads (and viral resistance as applicable)) will be measured at all timepoints. This lab work will be completed as part of usual care, and results will be extracted from the electronic medical record. The rate at which an adverse event occurs, as documented by the clinical team in the medical record and/or self-reported by the participant, will be assessed to further evaluate safety.

Secondary measures

To inform how this treatment may impact relevant factors associated with HIV and OUD, other substance use will be measured through standard tools (National Epidemiologic Survey on Alcohol and Related Conditions; NESARC [55], NIDA-modified ASSIST [53]), as well as urine drug screens (collected via usual care and documented in the electronic medical record). HIV Risk Behavior will be assessed by the TCU HIV/AIDS Risk Assessment [56] and will serve as a measure of overall sex and drug risk behavior. The Treatment Services Review will be used to assess receipt of case management, psychiatric, peer recovery coaching, and other treatment services, including utilization of other medications for OUD (e.g., if a participant has transitioned to Methadone). At follow-up interviews, participants will be asked about services received since their previous interview. Overall quality of life will be assessed using the Quality-of-Life Enjoyment and Satisfaction Questionnaire – Short Form, a psychometrically sound shorter version of the original Quality of Life Enjoyment and Satisfaction Questionnaire. It consists of a self-reported 16-item questionnaire that has shown internal consistency, test–retest reliability, and convergent and criterion validity (80% sensitivity, 100% specificity) [57]. This data will be used to inform a subsequent larger scale study using this clinical protocol.

Implementation factors

Throughout the open pilot trial, we will assess organizational-, patient-, and provider-related factors associated with future implementation. Patient. In addition to the feasibility, acceptability, and safety measures described above, 24 purposively sampled participants will be asked to complete a qualitative interview in which they will be asked to reflect on factors that impacted their use or non-use of combined LAI treatment. Provider: The Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), & Feasibility of Intervention Measure (FIM) will be employed [58]. Each of these measures contains four items assessing implementation outcomes that are often considered “leading indicators” of implementation success [59]. Organizational—We will explore factors related to the implementation climate and organizational readiness, two measures associated with an organization’s inner setting that have been shown to influence implementation. Implementation climate will be assessed by a 6-item measure of provider perceptions regarding the extent to which the innovation being implemented (i.e., combined LAI) is expected, supported, and rewarded within their organization. Each item is scored on a 5-point Likert scale. This well-validated, brief measure was developed by Jacobs and colleagues, and following published guidelines, we calculate a scale mean for each staff member. Organizational readiness will be assessed by the Organizational Readiness for Implementing Change measure developed by Shea and colleagues. This 12-item scale will be administered to all participating staff. Each item assesses provider perceptions regarding the extent to which their organization has the level of skill, training, time, and resources necessary to implement the combined LAI protocol. Qualitative Interviews—at the conclusion of the study, we will conduct qualitative interviews with providers and other clinic staff to explore other implementation barriers and facilitators to combined LAI treatment. Consistent with the guidelines for measure administration, the term “innovation” has been adapted to reference the combined LAI intervention.

Data analysis

Analyses for this pilot study will have the primary goal of establishing feasibility, acceptability, and safety of concurrently administering LAI medications for HIV and OUD. Feasibility will be assessed via a range of indicators, including the percent of patients interested in the treatment, patient eligibility rate, consent rate, rate of recruitment, percent of participants who initiate injectables, follow-up completion rate (through 6 months), study attrition, and rates of medication discontinuation. Acceptability will be assessed by calculating mean scores for the Client Satisfaction Questionnaire and Treatment Engagement Assessment. Feasibility and acceptability will be reflected by: > 75% of eligible participants providing consent; > 75% of participants who consent initiating both injections; > 80% of participants retained at 6 months; change of > 8 points from baseline to 6-month follow-up on the Treatment Engagement Assessment; and high satisfaction indexed by > 24 on the Client Satisfaction Questionnaire. Safety will be evaluated by analyzing HIV viral loads, and the development of any virologic resistance across the study period, as well as the incidence of adverse events.

Secondary analyses for this study will examine the implementation potential of the integrated intervention. The qualitative and quantitative data obtained in Phase 2 of the study will be integrated via triangulation. That is, the two data sets will be compared to determine whether they converge, offer complimentary information, or contradict each other to offer a more nuanced understanding of the research question [60].

Discussion

The co-occurrence of HIV and OUD is associated with numerous adverse health outcomes including increased risk of morbidity, mortality, and HIV transmission [8,9,10, 16, 17]. Although evidenced-based treatments are available to address these conditions, many PWH who have OUD struggle to maintain adherence to their medications, given the burden of daily oral administration as well as social and structural factors that create barriers to care engagement (e.g., substance use-related stigma, transportation barriers [61, 62]). This is notable in that PWH who have an OUD are both particularly vulnerable for fatal overdose and are less likely to achieve HIV-viral suppression, contributing to higher mortality rates among this population and potential risk for onward HIV transmission [8,9,10, 15,16,17]. As such, there have been recent calls to develop interventions to address the unique challenges associated with the intertwined HIV and OUD epidemics [31, 32].

Recent pharmacological advancements have led to the development and approval of LAI medications for both HIV and OUD. These medications have the potential to significantly improve adherence, lead to better control of both diseases, and reduce mortality rates for PWH with OUD [35,36,37, 42, 43]. While combining these two treatments into a single point of care holds promise, currently little is known about whether offering integrated treatment of CAB/RPV and XR-B is feasible, acceptable, or safe for this vulnerable population. Further, to maximize use and impact of this integrated treatment package, formative evaluation with the target populations (e.g., patients who might engage in this treatment; providers who might offer/deliver this treatment) is critically needed to guide the delivery model. Accordingly, this study aims to fill gaps in prior research by first conducting formative research to develop a clinical protocol combining LAI medications for the treatment of HIV and OUD, and then evaluating the feasibility, acceptability, safety, and scalability of this novel integrated delivery model.

At the conclusion of this study, our goals are to (a) develop a treatment protocol with input from the target population, (b) evaluate the feasibility/acceptability/safety of the proposed protocol, and (c) assess relevant factors to optimize implementation potential. Results of this study will be used to inform the development of a large-scale, fully-powered, Hybrid Type I Effectiveness-Implementation trial. The assessment of patient-, provider-, and organizational-factors that may impact future implementation potential for combined LAI treatment will yield valuable information to inform future intervention development efforts, and will help us to accelerate the translation of the integrated intervention to clinical settings.

This work has the potential to improve the treatment and prevention of HIV infection among a population where substance use is a significant contributing factor, by integrating treatment for OUD and HIV infection. If successful, this study has high clinical and public health significance by developing and testing the preliminary efficacy of a treatment protocol which meaningfully combines the two LAI treatments to improve clinical outcomes for PWH with OUD. The knowledge gained through this study has the potential to reduce the lag time between research discovery and clinical uptake in clinical settings, and may increase our knowledge of how to promote the uptake of other long-acting medications such as long-acting PrEP.

The current study is not without limitations. First, the sample will be comprised of English-speaking participants, which limits generalizability to other racial/ethnic groups. Second, given current FDA guidelines, only participants with suppressed viral loads will be enrolled. However, there is emerging data suggesting the potential for CAP/RPV among persons without suppressed viral loads. Thus, investigating the use of CAP/RPV among persons without viral suppression is a priority for future research.

Availability of data and materials

Not applicable.

Abbreviations

PWH:

People living with HIV

OUD:

Opioid use disorder

ART:

Antiretroviral therapy

LAI:

Long-acting injectable

CAB/RPV:

Cabotegravir/rilpivirine

XR-B:

Extended-release buprenorphine

IDIs:

In-depth individual interviews

References

  1. D’Onofrio G, Venkatesh A, HawkKathryn K. The adverse impact of Covid-19 on individuals with OUD highlights the urgent need for reform to leverage emergency department-based treatment. NEJM Catal Innov Care Deliv. 2020. https://0-doi-org.brum.beds.ac.uk/10.1056/CAT.20.0190.

    Article  Google Scholar 

  2. O’Donnell J. Vital signs: characteristics of drug overdose deaths involving opioids and stimulants—24 States and the District of Columbia, January–June 2019. MMWR Morb Mortal Wkly Rep. 2020. https://0-doi-org.brum.beds.ac.uk/10.15585/mmwr.mm6935a1.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Green TC, McGowan SK, Yokell MA, Pouget ER, Rich JD. HIV infection and risk of overdose: a systematic review and meta-analysis. AIDS. 2012;26(4):403–17. https://0-doi-org.brum.beds.ac.uk/10.1097/QAD.0b013e32834f19b6.

    Article  PubMed  Google Scholar 

  4. Turner AK, Harripersaud K, Crawford ND, Rivera AV, Fuller CM. Differences in HIV risk behavior of injection drug users in New York City by health care setting. AIDS Care. 2013;25(10):1321–9. https://0-doi-org.brum.beds.ac.uk/10.1080/09540121.2013.772275.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Des Jarlais DC. Harm reduction in the USA: the research perspective and an archive to David Purchase. Harm Reduct J. 2017;14(1):51. https://0-doi-org.brum.beds.ac.uk/10.1186/s12954-017-0178-6.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Lyss SB, Buchacz K, McClung RP, Asher A, Oster AM. Responding to outbreaks of human immunodeficiency virus among persons who inject drugs-United States, 2016–2019: perspectives on recent experience and lessons learned. J Infect Dis. 2020;222(Suppl 5):S239–49. https://0-doi-org.brum.beds.ac.uk/10.1093/infdis/jiaa112.

    Article  PubMed  Google Scholar 

  7. Hodder SL, Feinberg J, Strathdee SA, et al. The opioid crisis and HIV in the USA: deadly synergies. The Lancet. 2021;397(10279):1139–50. https://0-doi-org.brum.beds.ac.uk/10.1016/S0140-6736(21)00391-3.

    Article  CAS  Google Scholar 

  8. Viswanathan S, Detels R, Mehta SH, Macatangay BJC, Kirk GD, Jacobson LP. Level of adherence and HIV RNA suppression in the current era of highly active antiretroviral therapy (HAART). AIDS Behav. 2015;19(4):601–11. https://0-doi-org.brum.beds.ac.uk/10.1007/s10461-014-0927-4.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Tanner Z, Lachowsky N, Ding E, et al. Predictors of viral suppression and rebound among HIV-positive men who have sex with men in a large multi-site Canadian cohort. BMC Infect Dis. 2016;16(1):590. https://0-doi-org.brum.beds.ac.uk/10.1186/s12879-016-1926-z.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Shuper PA, Joharchi N, Irving H, et al. Differential predictors of ART adherence among HIV-monoinfected versus HIV/HCV-coinfected individuals. AIDS Care. 2016;28(8):954–62. https://0-doi-org.brum.beds.ac.uk/10.1080/09540121.2016.1158396.

    Article  PubMed  Google Scholar 

  11. Wolfe D, Carrieri MP, Shepard D. Treatment and care for injecting drug users with HIV infection: a review of barriers and ways forward. Lancet. 2010;376(9738):355–66. https://0-doi-org.brum.beds.ac.uk/10.1016/S0140-6736(10)60832-X.

    Article  PubMed  Google Scholar 

  12. Wood E, Milloy MJ, Montaner JSG. HIV treatment as prevention among injection drug users. Curr Opin HIV AIDS. 2012;7(2):151–6. https://0-doi-org.brum.beds.ac.uk/10.1097/COH.0b013e32834f9927.

    Article  CAS  PubMed  Google Scholar 

  13. Mathers BM, Degenhardt L, Ali H, et al. HIV prevention, treatment, and care services for people who inject drugs: a systematic review of global, regional, and national coverage. Lancet. 2010;375(9719):1014–28. https://0-doi-org.brum.beds.ac.uk/10.1016/S0140-6736(10)60232-2.

    Article  PubMed  Google Scholar 

  14. Malta M, Strathdee SA, Magnanini MMF, Bastos FI. Adherence to antiretroviral therapy for human immunodeficiency virus/acquired immune deficiency syndrome among drug users: a systematic review. Addiction. 2008;103(8):1242–57. https://0-doi-org.brum.beds.ac.uk/10.1111/j.1360-0443.2008.02269.x.

    Article  PubMed  Google Scholar 

  15. Hinkin CH, Barclay TR, Castellon SA, et al. Drug use and medication adherence among HIV-1 infected individuals. AIDS Behav. 2007;11(2):185–94. https://0-doi-org.brum.beds.ac.uk/10.1007/s10461-006-9152-0.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Murray M, Hogg RS, Lima VD, et al. The effect of injecting drug use history on disease progression and death among HIV-positive individuals initiating combination antiretroviral therapy: collaborative cohort analysis. HIV Med. 2012;13(2):89–97. https://0-doi-org.brum.beds.ac.uk/10.1111/j.1468-1293.2011.00940.x.

    Article  CAS  PubMed  Google Scholar 

  17. Weber R, Huber M, Battegay M, et al. Influence of noninjecting and injecting drug use on mortality, retention in the cohort, and antiretroviral therapy, in participants in the Swiss HIV Cohort Study: drug use and course of HIV infection. HIV Med. 2015;16(3):137–51. https://0-doi-org.brum.beds.ac.uk/10.1111/hiv.12184.

    Article  CAS  PubMed  Google Scholar 

  18. Burnett JC. HIV Infection and HIV-associated behaviors among persons who inject drugs—20 cities, United States, 2015. MMWR Morb Mortal Wkly Rep. 2018. https://0-doi-org.brum.beds.ac.uk/10.15585/mmwr.mm6701a5.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Meyer JP, Althoff AL, Altice FL. Optimizing care for HIV-infected people who use drugs: evidence-based approaches to overcoming healthcare disparities. Clin Infect Dis. 2013;57(9):1309–17. https://0-doi-org.brum.beds.ac.uk/10.1093/cid/cit427.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Altice FL, Kamarulzaman A, Soriano VV, Schechter M, Friedland GH. Treatment of medical, psychiatric, and substance-use comorbidities in people infected with HIV who use drugs. Lancet. 2010;376(9738):367–87. https://0-doi-org.brum.beds.ac.uk/10.1016/S0140-6736(10)60829-X.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Lazo M, Gange SJ, Wilson TE, et al. Patterns and predictors of changes in adherence to highly active antiretroviral therapy: longitudinal study of men and women. Clin Infect Dis. 2007;45(10):1377–85. https://0-doi-org.brum.beds.ac.uk/10.1086/522762.

    Article  PubMed  Google Scholar 

  22. Milloy M-J, Marshall BDL, Montaner J, Wood E. Housing status and the health of people living with HIV/AIDS. Curr HIV/AIDS Rep. 2012;9(4):364–74. https://0-doi-org.brum.beds.ac.uk/10.1007/s11904-012-0137-5.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Kahler CW, Metrik J, LaChance HR, et al. Addressing heavy drinking in smoking cessation treatment: a randomized clinical trial. J Consult Clin Psychol. 2008;76(5):852–62. https://0-doi-org.brum.beds.ac.uk/10.1037/a0012717.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Toll BA, Martino S, O’Malley SS, et al. A randomized trial for hazardous drinking and smoking cessation for callers to a quitline. J Consult Clin Psychol. 2015;83(3):445–54. https://0-doi-org.brum.beds.ac.uk/10.1037/a0038183.

    Article  PubMed  Google Scholar 

  25. Ames SC, Pokorny SB, Schroeder DR, Tan W, Werch CE. Integrated smoking cessation and binge drinking intervention for young adults: a pilot efficacy trial. Addict Behav. 2014;39(5):848–53. https://0-doi-org.brum.beds.ac.uk/10.1016/j.addbeh.2014.02.001.

    Article  PubMed  Google Scholar 

  26. Adams JW, Marshall BDL, Mohd Salleh NA, Barrios R, Nolan S, Milloy M-J. Receipt of opioid agonist treatment halves the risk of HIV-1 RNA viral load rebound through improved ART adherence for HIV-infected women who use illicit drugs. Drug Alcohol Depend. 2020;206:107670. https://0-doi-org.brum.beds.ac.uk/10.1016/j.drugalcdep.2019.107670.

    Article  CAS  PubMed  Google Scholar 

  27. Giang V, Brar R, Sutherland C, Nolan S. HIV treatment initiation and retention among individuals initiated on injectable opioid agonist therapy for severe opioid use disorder: a case series. J Addict Med. 2020;14(5):437–40. https://0-doi-org.brum.beds.ac.uk/10.1097/ADM.0000000000000609.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Parashar S, Collins AB, Montaner JSG, Hogg RS, Milloy M-J. Reducing rates of preventable HIV/AIDS-associated mortality among people living with HIV who inject drugs. Curr Opin HIV AIDS. 2016;11(5):507–13. https://0-doi-org.brum.beds.ac.uk/10.1097/COH.0000000000000297.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Low AJ, Mburu G, Welton NJ, et al. Impact of opioid substitution therapy on antiretroviral therapy outcomes: a systematic review and meta-analysis. Clin Infect Dis. 2016;63(8):1094–104. https://0-doi-org.brum.beds.ac.uk/10.1093/cid/ciw416.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Ending the HIV Epidemic in the U.S. (EHE). U.S. Department of Health & Human Services, June 2023.

  31. Madras BK. The surge of opioid use, addiction, and overdoses: responsibility and response of the US health care system. JAMA Psychiat. 2017;74(5):441–2. https://0-doi-org.brum.beds.ac.uk/10.1001/jamapsychiatry.2017.0163.

    Article  Google Scholar 

  32. Rich KM, Bia J, Altice FL, Feinberg J. Integrated models of care for individuals with opioid use disorder: how do we prevent HIV and HCV? Curr HIV/AIDS Rep. 2018;15(3):266–75. https://0-doi-org.brum.beds.ac.uk/10.1007/s11904-018-0396-x.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Oldfield BJ, Muñoz N, McGovern MP, Funaro M, Villanueva M, Tetrault JM, Edelman EJ. Integration of care for HIV and opioid use disorder. AIDS. 2019;33(5):873–84. https://0-doi-org.brum.beds.ac.uk/10.1097/QAD.0000000000002125.

    Article  PubMed  Google Scholar 

  34. Oldfield BJ, Munoz N, Boshnack N, Leavitt R, McGovern MP, Villanueva M, et al. “No more falling through the cracks”: a qualitative study to inform measurement of integration of care of HIV and opioid use disorder. J Subst Abuse Treat. 2019;97:28–40.

    Article  PubMed  Google Scholar 

  35. Williams J, Sayles HR, Meza JL, et al. Long-acting parenteral nanoformulated antiretroviral therapy: interest and attitudes of HIV-infected patients. Nanomedicine (Lond). 2013;8(11):1807–13. https://0-doi-org.brum.beds.ac.uk/10.2217/nnm.12.214.

    Article  CAS  PubMed  Google Scholar 

  36. Philbin MM, Parish C, Bergen S, et al. A qualitative exploration of women’s interest in long-acting injectable antiretroviral therapy across six cities in the women’s interagency HIV study: intersections with current and past injectable medication and substance use. AIDS Patient Care STDS. 2021;35(1):23–30. https://0-doi-org.brum.beds.ac.uk/10.1089/apc.2020.0164.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Simoni JM, Beima-Sofie K, Mohamed ZH, et al. Long-acting injectable antiretroviral treatment acceptability and preferences: a qualitative study among US providers, adults living with HIV, and parents of youth living with HIV. AIDS Patient Care STDS. 2019;33(3):104–11. https://doi.org/10.1089/apc.2018.0198.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Spreen WR, Margolis DA, Pottage JC. Long-acting injectable antiretrovirals for HIV treatment and prevention. Curr Opin HIV AIDS. 2013;8(6):565–71. https://0-doi-org.brum.beds.ac.uk/10.1097/COH.0000000000000002.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. Overton ET, Richmond G, Rizzardini G, et al. Long-acting cabotegravir and rilpivirine dosed every 2 months in adults with HIV-1 infection (ATLAS-2M), 48-week results: a randomised, multicentre, open-label, phase 3b, non-inferiority study. The Lancet. 2020;396(10267):1994–2005. https://0-doi-org.brum.beds.ac.uk/10.1016/S0140-6736(20)32666-0.

    Article  CAS  Google Scholar 

  40. Rizzardini G, Overton ET, Orkin C, et al. Long-acting injectable cabotegravir + rilpivirine for HIV maintenance therapy: week 48 pooled analysis of phase 3 ATLAS and FLAIR trials. JAIDS J Acquir Immune Defic Syndromes. 2020;85(4):498–506. https://0-doi-org.brum.beds.ac.uk/10.1097/QAI.0000000000002466.

    Article  Google Scholar 

  41. Haight BR, Learned SM, Laffont CM, et al. Efficacy and safety of a monthly buprenorphine depot injection for opioid use disorder: a multicentre, randomised, double-blind, placebo-controlled, phase 3 trial. Lancet. 2019;393(10173):778–90. https://0-doi-org.brum.beds.ac.uk/10.1016/S0140-6736(18)32259-1.

    Article  CAS  PubMed  Google Scholar 

  42. Andorn AC, Haight BR, Shinde S, et al. Treating opioid use disorder with a monthly subcutaneous buprenorphine depot injection: 12-month safety, tolerability, and efficacy analysis. J Clin Psychopharmacol. 2020;40(3):231–9. https://0-doi-org.brum.beds.ac.uk/10.1097/JCP.0000000000001195.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Frost M, Bailey GL, Lintzeris N, et al. Long-term safety of a weekly and monthly subcutaneous buprenorphine depot (CAM2038) in the treatment of adult out-patients with opioid use disorder. Addiction. 2019;114(8):1416–26. https://0-doi-org.brum.beds.ac.uk/10.1111/add.14636.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Young DS, Casey EA (2018) An examination of the sufficiency of small qualitative samples. Social Work & Criminal Justice Publications 500

  45. Lewis M, Bromley K, Sutton CJ, et al. Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back! Pilot Feas Stud. 2021;7:40. https://0-doi-org.brum.beds.ac.uk/10.1186/s40814-021-00770-x.

    Article  CAS  Google Scholar 

  46. Leon AC, Davis LL, Kraemer HC. The role and interpretation of pilot studies in clinical research. J Psychiatr Res. 2011;45(5):626–9. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jpsychires.2010.10.008.

    Article  PubMed  Google Scholar 

  47. Chambers DA, Norton WE. The adaptome: advancing the science of intervention adaptation. Am J Prev Med. 2016;51(4 Suppl 2):S124-131. https://0-doi-org.brum.beds.ac.uk/10.1016/j.amepre.2016.05.011.

    Article  PubMed  PubMed Central  Google Scholar 

  48. QSR International (2002) NVivo qualitative data analysis software [Software]. https://qsrinternational.com/nvivo/nvivo-products/

  49. Guest G, MacQueen K, Namey E. Applied thematic analysis. Thousand Oaks: SAGE Publications, Inc.; 2012. https://0-doi-org.brum.beds.ac.uk/10.4135/9781483384436.

    Book  Google Scholar 

  50. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101. https://0-doi-org.brum.beds.ac.uk/10.1191/1478088706qp063oa.

    Article  Google Scholar 

  51. The Miriam Immunology Center Database Annual Report 2020. Published online 2020:8.

  52. PhenX Toolkit. Social determinants of health: core. Accessed May 3, 2021. https://www.phenxtoolkit.org/sub-collections/view/28

  53. Buscher A, Hartman C, Kallen MA, Giordano TP. Validity of self-report measures in assessing antiretroviral adherence of newly diagnosed, HAART-naive, HIV patients. HIV Clin Trials. 2011;12(5):244–54. https://0-doi-org.brum.beds.ac.uk/10.1310/hct1205-244.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Ling W, Nadipelli VR, Solem CT, et al. Measuring recovery in opioid use disorder: clinical utility and psychometric properties of the treatment effectiveness assessment. SAR. 2019;10:13–21. https://0-doi-org.brum.beds.ac.uk/10.2147/SAR.S198361.

    Article  Google Scholar 

  55. National Institute on Alcohol Abuse and Alcoholism (NIAAA). National epidemiologic survey on alcohol and related conditions. Wave 1 (NESARC – WAVE 1). Alcohol use disorder and associated disabilities interview schedule. (Diagnostic and Statistical Manual of Mental Disorders). Accessed May 3, 2021. https://pubs.niaaa.nih.gov/publications/arh29-2/74-78.htm

  56. Simpson D. TCU HIV/AIDS risk assessment [Taken from Intake Form]; 1997.

  57. Stevanovic D. Quality of Life Enjoyment and Satisfaction Questionnaire-short form for quality of life assessments in clinical practice: a psychometric study. J Psychiatr Ment Health Nurs. 2011;18(8):744–50. https://0-doi-org.brum.beds.ac.uk/10.1111/j.1365-2850.2011.01735.x.

    Article  CAS  PubMed  Google Scholar 

  58. Weiner BJ, Lewis CC, Stanick C, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108. https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-017-0635-3.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76. https://0-doi-org.brum.beds.ac.uk/10.1007/s10488-010-0319-7.

    Article  PubMed  Google Scholar 

  60. O’Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ. 2010;341: c4587. https://0-doi-org.brum.beds.ac.uk/10.1136/bmj.c4587.

    Article  PubMed  Google Scholar 

  61. De Los Rios P, Young B, Marcotullio S, et al. Experiences and emotional challenges of antiretroviral treatment (ART)—findings from the positive perspectives study. Open Forum Infect Dis. 2019;6(Supplement_2):S481–S481. https://0-doi-org.brum.beds.ac.uk/10.1093/ofid/ofz360.1193.

    Article  PubMed Central  Google Scholar 

  62. Shubber Z, Mills EJ, Nachega JB, et al. Patient-reported barriers to adherence to antiretroviral therapy: a systematic review and meta-analysis. PLoS Med. 2016;13(11):e1002183. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pmed.1002183.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We acknowledge and thank the research assistants who have been involved in the recruitment of study participants including Lauren Danzey, Julianne Kim, and Jimin Shin.

Funding

Research reported in this publication was supported by the National Institute on Drug Abuse of the National Institutes of Health under Award Number 1R34DA055498-01. Drs. Langdon, Collins, Beckwith, Tashima, and Rich are all supported, in part, by a National Institute of General Medical Studies Grant (P20 GM125507) and National Institute of Allergy and Infectious Diseases (3P30AI042853-22). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Author information

Authors and Affiliations

Authors

Contributions

KJL and JR are the Principal Investigators for the study, led the conceptualization of the study and the drafting of the original grant proposal, and developed a first draft of the manuscript. AC, CB, SB, and KT are Co-Investigators for the study. They each contributed to the writing of the original grant proposal and successive drafts of the manuscript. AH drafted the discussion section and also contributed to successive drafts of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kirsten J. Langdon.

Ethics declarations

Ethics approval and consent to participate

The work described has been carried out in accordance with The Code of Ethics of the World Medical Association (Declaration of Helsinki) for experiments involving human subjects, and the procedures have been approved by the Lifespan Institutional Review Board.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Langdon, K.J., Hitch, A.E., Collins, A.B. et al. Integrating long-acting injectable treatment to improve medication adherence among persons living with HIV and opioid use disorder: study protocol. Addict Sci Clin Pract 18, 60 (2023). https://0-doi-org.brum.beds.ac.uk/10.1186/s13722-023-00418-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13722-023-00418-6

Keywords