---
title: "Methods: Critical Ourcomes of Research Engagement. | Sutter Health"
description: "Article describes a workshop and process used to identify and develop Critical Outcomes of Research Engagement. Group will conduct study to validate measures."
url: "https://www.sutterhealth.org/research/publications/methods-critical-ourcomes-of-research-engagement-1055312434"
---

1.  [Home](https://www.sutterhealth.org/) /
2.  [Research](https://www.sutterhealth.org/research) /
3.  [Research publications](https://www.sutterhealth.org/research/publications) /
4.  Methods: Critical Ourcomes of Research Engagement.

# Measuring the impact of patient-engaged research: how a methods workshop identified Critical Outcomes of Research Engagement.

Dillon EC, Tuzzio L, Madrid S, Olden H, & Greenlee RT.

_J Patient Cent Res Rev. 2017;4:237-46._

2017-11-06

## Abstract

Purpose: While strategies to evaluate the influence of engaging patient partners in research, such as the Patient-Centered Outcomes Research Institute (PCORI) WE-ENACT surveys, are beginning to emerge, a systematic set of measures for assessing the impact of patient engagement in research (PER) on study approaches and outcomes is lacking. This article describes a workshop and process used to identify and develop Critical Outcomes of Research Engagement (COREs). It proposes preliminary measures for assessing the impact of PER on the research process and outcomes of research studies.

Methods: A group of 24 researchers and 5 patient partners participated in a PCORI-funded workshop designed to identify key research outcomes and corresponding measures to evaluate the impact of patient-engaged research on those outcomes. Interactive group discussion and synthesis by workshop attendees led to a proposed set of core components of patient-engaged research by each stage of a research study as well as some overarching principles. Postworkshop discussions further distilled the output and considered potential gaps.

Results: CORE components identified were: patient-centered, meaningful, team collaboration, understandable, rigorous, adaptable/integrity, legitimate, feasible, ethical and transparent, timely, and sustainable. Existing measures skew more toward measuring the process of engagement and less toward measuring downstream outcomes of patient-partner engagement in all phases of research.

Conclusions: Next steps include finalizing measures, pilot testing them with the workshop participants, and building a larger community of practice to further advance this work. The new community plans to create a measurement tool and conduct a study to validate the measures.

[PubMed abstract](https://digitalrepository.aurorahealthcare.org/jpcrr/vol4/iss4/6/)

## Research topics

-   [Health Services](https://www.sutterhealth.org/research-search-results?query=%22%5C%22Health+Services%5C%22%22)

## Related publications

[View all publications](https://www.sutterhealth.org/research-search-results?verticalKey=research_publication)

-   Publication
    
    ### [Patient-reported outcomes as a measure of healthcare quality.](https://www.sutterhealth.org/research/publications/pt-reported-outcomes-measures-healthcare-quality-1055312485)
    
    Frosch DL.
    
    J Gen Intern Med. 30(10):1383-4. doi: 10.1007/s11606-015-3476-2.
    
    2015 Oct 01
    
-   Publication
    
    ### [Experiences of primary care physicians and staff following Lean workflow redesign.](https://www.sutterhealth.org/research/publications/pcp-and-staff-experiences-with-lean-workflow-redesign-1055312311)
    
    Hung DY, Harrison MI, Truong Q, Du X.
    
    BMC Health Serv Res. 18(1):274. doi: 10.1186/s12913-018-3062-5.
    
    2018 Apr 10
    
-   Publication
    
    ### [Five decades of HSR-by words and figures.](https://www.sutterhealth.org/research/publications/five-decades-hsr-words-figures-1055312369)
    
    Luft HS.
    
    Health Serv Res. 52(3):908-918. doi: 10.1111/1475-6773.12717.
    
    2017 Jun 01
    
-   Publication
    
    ### [Scaling Lean in primary care: impacts on system performance.](https://www.sutterhealth.org/research/publications/scaling-lean-primary-care-system-perf-impact-1055312322)
    
    Hung DY, Harrison MI, Martinez MC, Luft HS.
    
    Am J Manag Care. 23(3):161-168.
    
    2017 Mar 01
    
-   Publication
    
    ### [Accuracy of data entry of patient race/ethnicity/ancestry and preferred spoken language in an ambulatory care setting.](https://www.sutterhealth.org/research/publications/data-entry-of-pt-race-language-in-primary-care-1055312548)
    
    Azar KM, Moreno MR, Wong EC, Shin JJ, Soto C, Palaniappan LP.
    
    Health Serv Res. 47(1 Pt 1):228-40. doi: 10.1111/j.1475-6773.2011.01305
    
    2011 Aug 24
    

[View all publications](https://www.sutterhealth.org/research-search-results?verticalKey=research_publication)

```json
{"@context":"https://schema.org","@type":"MedicalOrganization","name":"Sutter Health","@id":"https://www.sutterhealth.org/#medicalorganization","url":"https://www.sutterhealth.org","logo":"https://www.sutterhealth.org/static/images/sutter-health-logo.svg","address":{"@type":"PostalAddress","streetAddress":"2200 River Plaza Drive","addressLocality":"Sacramento","addressRegion":"CA","postalCode":"95833","addressCountry":"US"},"areaServed":{"@type":"AdministrativeArea","name":"California"},"sameAs":["https://www.facebook.com/SutterHealth","https://www.instagram.com/sutterhealth/","https://x.com/SutterHealth","https://www.youtube.com/sutterhealth","https://www.linkedin.com/company/sutter-health","https://en.wikipedia.org/wiki/Sutter_Health"]}
```

```json
{"@context":"https://schema.org","@type":"BreadcrumbList","@id":"https://www.sutterhealth.org/research/publications/methods-critical-ourcomes-of-research-engagement-1055312434#breadcrumblist","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://www.sutterhealth.org/"},{"@type":"ListItem","position":2,"name":"Research","item":"https://www.sutterhealth.org/research"},{"@type":"ListItem","position":3,"name":"Research publications","item":"https://www.sutterhealth.org/research/publications"},{"@type":"ListItem","position":4,"name":"Methods: Critical Ourcomes of Research Engagement."}]}
```

```json
{"@context":"https://schema.org","@type":"MedicalScholarlyArticle","@id":"https://www.sutterhealth.org/research/publications/methods-critical-ourcomes-of-research-engagement-1055312434#medicalscholarlyarticle","name":"Measuring the impact of patient-engaged research: how a methods workshop identified Critical Outcomes of Research Engagement.","headline":"Methods: Critical Ourcomes of Research Engagement.","abstract":"Purpose: While strategies to evaluate the influence of engaging patient partners in research, such as the Patient-Centered Outcomes Research Institute (PCORI) WE-ENACT surveys, are beginning to emerge, a systematic set of measures for assessing the impact of patient engagement in research (PER) on study approaches and outcomes is lacking. This article describes a workshop and process used to identify and develop Critical Outcomes of Research Engagement (COREs). It proposes preliminary measures for assessing the impact of PER on the research process and outcomes of research studies. Methods: A group of 24 researchers and 5 patient partners participated in a PCORI-funded workshop designed to identify key research outcomes and corresponding measures to evaluate the impact of patient-engaged research on those outcomes. Interactive group discussion and synthesis by workshop attendees led to a proposed set of core components of patient-engaged research by each stage of a research study as well as some overarching principles. Postworkshop discussions further distilled the output and considered potential gaps. Results: CORE components identified were: patient-centered, meaningful, team collaboration, understandable, rigorous, adaptable/integrity, legitimate, feasible, ethical and transparent, timely, and sustainable. Existing measures skew more toward measuring the process of engagement and less toward measuring downstream outcomes of patient-partner engagement in all phases of research. Conclusions: Next steps include finalizing measures, pilot testing them with the workshop participants, and building a larger community of practice to further advance this work. The new community plans to create a measurement tool and conduct a study to validate the measures.","description":"Article describes a workshop and process used to identify and develop Critical Outcomes of Research Engagement. Group will conduct study to validate measures.","keywords":["Health Services"],"datePublished":"2017-11-06","url":"https://www.sutterhealth.org/research/publications/methods-critical-ourcomes-of-research-engagement-1055312434","inLanguage":"en-US","isPartOf":{"@type":"Periodical","name":"J Patient Cent Res Rev"},"author":[{"@type":"Person","name":"Dillon EC"},{"@type":"Person","name":"Tuzzio L"},{"@type":"Person","name":"Madrid S"},{"@type":"Person","name":"Olden H"},{"@type":"Person","name":"Greenlee RT"}],"sourceOrganization":{"@type":"MedicalOrganization","name":"Palo Alto Medical Foundation Research Institute"},"about":[{"@type":"DefinedTerm","name":"Health Services","url":"https://www.sutterhealth.org/research-search-results?facets=%5B%7B%22i%22%3A%22c_researchTopics.name%22%2C%22v%22%3A%5B%22Health+Services%22%5D%7D%5D&verticalKey=research_publication"}],"mainEntityOfPage":{"@type":"WebPage","@id":"https://www.sutterhealth.org/research/publications/methods-critical-ourcomes-of-research-engagement-1055312434","breadcrumb":{"@id":"https://www.sutterhealth.org/research/publications/methods-critical-ourcomes-of-research-engagement-1055312434#breadcrumblist"}}}
```
