Table 2 MATICCE measures, data sources, and timing

Baseline Survey of Organizational Characteristics:

CJ agency leadership and probation/parole officers; Treatment program leadership and clinical staff

Baseline

Survey measures organizational climate and culture from leadership and line staff in both CJ and treatment agencies. Includes items to be used as predictors or correlates of implementation outcomes.

Interorganizational Relationships Survey:

CJ agency probation/parole officers; Treatment program clinical staff; assessment agency staff where applicable

Baseline, 12 months

Survey in which staff at each agency rate the quality and frequency of interaction with other agencies involved in MATICCE. At minimum, probation/parole staff and treatment staff rate each other’s organizations. If separate assessment agency is involved in the offender referral process, then their staff also rate, and are rated by, the respective probation/parole and treatment agencies.

Opinions about MAT Survey:

CJ agency probation/parole officers

Baseline, 3 months, 12 months

Survey measures knowledge and perceptions about specific addiction pharmacotherapies, receipt of training, and willingness to refer clients to MAT.

Survey of Treatment Referrals:

Aggregated reports (office-level) from probation/parole agency and treatment program

Monthly from month 1 – 18

Monthly survey obtained from staff or from available information systems at probation/parole and treatment agency. Documents number of offenders referred to the treatment agency by the probation/parole office in the preceding 30 days, and the number of criminal justice-referred clients presenting to the treatment program in the same interval. Supplements agency record abstraction data.

Review of Agency Records:

Offender records maintained by probation/parole offices

Baseline, 12 months, 18 months

Agency records are reviewed to estimate the total number of offenders on agency caseloads during specified intervals, proportion of offenders with indicators of alcohol/drug involvement, and proportion with documented referral to substance abuse treatment. Records are reviewed until 100 alcohol/drug-involved offenders are identified at each interval, or until all records are exhausted. At baseline and 18 months, records are reviewed for the preceding 6 month interval. At the 12-month timepoint, records are reviewed for the preceding 3-month interval. Constructed measures include change over time in the proportion of records with documentation of alcohol/drug involvement and documented referral to treatment.

*Fidelity Checklist:

Researcher

Monthly from month 1 – 12

The primary research team member assigned to the PEC completes this 30-item checklist each month, indicating whether each of a series of milestones in the Organizational Linkage Intervention has been Not Yet Initiated; Initiated But Not Completed; or Completed.

*Working Alliance Measure:

PEC members and Connections Coordinator

Monthly from month 1 – 12

This instrument measures the quality of the working relationship between the PEC and the Connections Coordinator. Each rates the other using 16 Likert-type items.

*Satisfaction with Organizational Linkage Intervention:

PEC members

6 months, 12 months

This satisfaction survey is a 17-item instrument using 5-point Likert items to measure participant perceptions of the organizational benefits and costs associated with participating in the MATICCE intervention.

*Sustainability Survey:

PEC co-chair

18 months

Measures perceived benefits of the MATICCE intervention, staff engagement in the process, leadership buy-in and organizational structures in place to support continued sustainment of protocol outcomes and processes; collected at 6 months post-intervention.

*Key Informant Interviews:

4 probation/parole staff + 4 PEC members

Baseline, 12 months

Semi-structured interviews gather information on staff perceptions of interorganizational coordination, its impact on the acceptability of MAT, and the processes involved.