Langbahn Team – Weltmeisterschaft

Learning health systems

Learning health systems (LHS) are health and healthcare systems in which knowledge generation processes are embedded in daily practice to improve individual and population health. At its most fundamental level, a learning health system applies a conceptual approach wherein science, informatics, incentives, and culture are aligned to support continuous improvement, innovation, and equity, and seamlessly embed knowledge and best practices into care delivery[1][2][3]

The idea was first conceptualized in a 2006 workshop organized by the US Institute of Medicine (now the National Academy of Medicine (NAM)), building on ideas around evidence-based medicine[1] and "practice-based evidence".[4] and around recognition of the persistent gap between evidence generated in the context of biomedical research and the application of that evidence in the provision of care. The need to close this gap was further underscored by the growth of electronic health records (EHR) and other innovations in health information technology and computational power, and the resulting ability to generate data that can lead to better evidence and better outcomes. There has since been increasing interest in the topic, including the creation of the Wiley journal Learning Health Systems.[3]

Cornerstone elements of the LHS include:

  1. generation, application, and improvement of scientific knowledge;
  2. an organizational infrastructure that supports the engagement of communities of patients, healthcare professionals and researchers who collaborate to identify evidence gaps that could be addressed through research in routine healthcare settings;[5]
  3. deployment of computational technologies and informatics approaches that organize and leverage large electronic health data sets, i.e. "big data" for use in research;
  4. quality improvement at the point of care for each patient using new knowledge generated by research.

Other compatible ways of describing the LHS co-exist alongside the NAM definition, including the definition used by AHRQ, the Agency for Healthcare Research and Quality. AHRQ defines a learning health system as "a health system in which internal data and experience are systematically integrated with external evidence, and that knowledge is put into practice. As a result, patients get higher quality, safer, more efficient care, and health care delivery organizations become better places to work.”

In 2023, the NAM established ten core principles of learning health organizations to serve as a unifying touchstone for the field.[citation needed] The principles reflect and build upon the six aims of the seminal "Crossing the Quality Chasm" report published in 2001 (safe, equitable, effective, efficient, timely, and patient-centered),[6] and account for the ways in which health care has evolved since the publication of this 2001 report.

  • Engaged - Informed engagement, options, and choices for those who are served
  • Safe - Tested and up-to-date protocols to protect from harm
  • Effective - Evidence-based services tailored to understanding of each person's goals
  • Equitable - Parity in opportunity to attain desired health and goals
  • Efficient - Optimal outcomes for accessible, non-wasteful resources
  • Accessible - Effective services readily available where and when they are most needed
  • Measurable - Reliable and valid assessment of consequential activities and outcomes
  • Transparent - Clear information related to the nature, use, costs, and results of services
  • Secure - Validated access and use safeguards for digitally-mediated activities
  • Adaptive - Continuous learning and improvement are integral to organizational culture

History

The NAM’s early efforts to develop the ideas underpinning the LHS began in 2006, via a series of workshops held over several years from 2006-2013. Among several early publications to express the need for a rapid learning health system was a commentary in Health Affairs in 2007[7] where Lynn Etheredge applied the term “rapid learning health system” in recognition of the opportunity to leverage electronic health records (EHR) to “learn” what works in health care. The series of NAM workshops generated several summary publications on topics under the mantle of the LHS, including publications focused on the digital infrastructure[2] as well as on ethical considerations.[8] In 2013, the workshops culminated in a seminal report, “Best Care at Lower Cost: the Path to Continuously Learning Health Care in America.”[9] Summarizing the heretofore efforts, McGinnis and colleagues enumerate key milestones in the evolution of the LHS that include these reports as well as decades-old efforts to generate evidence from routine health care delivery.[10]

Nomenclature may vary in reference to the LHS concept. Some refer to a learning healthcare system, others refer to learning health systems or collaborative learning health systems.[11] The architecture and objectives are similar, irrespective of the label—addressing evidence gaps, harnessing data, and effectively utilizing the best evidence at the point of need. Related concepts include the use of real-world data to generate real-world evidence, and mobilizing computable biomedical knowledge.[12]

Given that the LHS has an expansive definition and scope, many of the early adopters of this approach were health systems that also had embedded research capabilities, such as a formal department or institute. The Veterans Administration Health System,[13] Group Health Cooperative,[14] Kaiser Permanente [15] and Geisinger Health System [16] were among the vanguard organizations who also published insights from their experience of launching formal learning health system activities. Increasingly, academic health systems have taken up the principles and practices espoused by the earliest adopters.

Adoption and spread

Early experiences with deploying the LHS have been instructive and have led to further adoption and spread. The LHS model is being applied in specific medical specialties such as pediatrics [17] and oncology,[18] and further examination of the environment and conditions that support learning have spurred development of increasingly detailed and specialized frameworks [19][20][21] that can support further adoption and adaptation based on the needs, features, and capabilities of a particular health system.

Along with a growing body of peer-reviewed publications on the specific experience of different systems as they evolve toward continuous learning, review articles have been published to reflect on the growth of the LHS as a whole. A systematic review by Budrionis [22] observed that the ability to evaluate how well an LHS improves outcomes was not well-explored in the literature. Subsequently, Platt [23] examined progress of theories and implementation of the LHS, Nash focused a review on deployment of the LHS in primary care,[24] and Ellis mapped empirical applications of the LHS.[25] Easterling and colleagues (REF LHS 2022) proffer an elaborate taxonomy of LHS elements and use this to describe an LHS-IP, or “Learning Health System In Practice” as a model for health care systems who seek to become an LHS.[26]

The motivations for applying LHS concepts are largely and logically focused on improving the quality of care. Exemplar organizations are numerous and growing and include both community-based health systems and university-based academic health systems/medical centers in the United States:

In many cases, these institutions are engaged in research activities such as the HCSRN, Clinical and Translational Science Awards (CTSA), and PCORnet where the LHS concepts are applied. The University of Michigan has also established a formal academic department, the Department of Learning Health Sciences. Alongside these exemplar organizations, related initiatives and consortia have been established in recent years. The Learning Health Community is an umbrella organization that has united many systems and health data organizations to develop shared principles and processes, and foster learning about the applications of technologies in the context of learning systems via a periodic virtual forum (LHS IT Forum). Given their centrality to the generation of health data and information, two of the largest EHR vendors have also created communities to support LHS: Cerner’s Learning Health Network and Epic System's Health Research Network. Still, much of the LHS development has been concentrated in large academic medical centers and health systems with a sizable footprint. Masica notes that nearly 85% of more than 6000 hospitals in the US are categorized as community hospitals, and the ability to develop and implement an LHS may be more challenging due to workforce and other constraints.[27]

Dissemination of the activities and experiences of learning health systems has been an instrumental aspect of their growth and spread.  While peer-reviewed literature on the LHS appears in a variety of journals, the creation of Healthcare: the Journal of Delivery Science and Innovation and the Learning Health Systems Journal are dedicated to manuscripts that showcase the experience of those deploying or refining aspects of learning in real-world practices. Each has also published special issues with thematic emphases on LHS-related topics such as embedded research and ethical, legal, and social implications of the LHS. Another marker of the spread of the LHS is its international adoption. Australia, Canada, the United Kingdom and other countries are applying the LHS concepts, offering opportunities to compare and contrast global experiences and develop a richer picture of how the local context, structure of care delivery, and regulatory environment affect the ability to support continuous learning. Patient involvement in the LHS has grown, partly due to the establishment of the Patient-Centered Outcomes Research Institute, continued emphasis on shared decision-making, and the growing recognition of participatory medicine. However, the engagement of patients is not consistent across health systems and there is not a uniform template for patient engagement or approaches to educating patients about the value and significance of the LHS as a model for improving evidence-based care.

Electronic health data as a central component to the LHS

A large proportion of LHS research relies on the use of electronic health records (EHRs) and must navigate the inherent challenges of EHRs.[28] EHRs were primarily created to support billing for clinical services and tracking health insurance claims. Generation of rich real-world clinical data is an essential "byproduct" of this highly transactional purpose of the contemporary EHR.

The LHS leverages a clinical lifecycle. Patient data is collected, which can then be amalgamated across multiple patients to identify, define, and analyze a problem or a gap in the application of evidence-based care.[29] These are activities largely driven by healthcare professionals. With the support of technology (both computational and statistical), an analysis of the amalgamated data can result in new evidence. Such knowledge generation can then spur changes in clinical practice, and thus to new patient data being collected.[3][30][31] This is the optimum for the LHS. However, dissemination of implementation of new evidence can be operationally and technically challenging in many settings, including the original health system that identified a problem based on their own clinical data.

McLachlan and colleagues (2018) suggest a taxonomy of nine LHS classification types:[3]

  1. Cohort identification looks for patients with similar attributes.[32]
  2. Positive deviance finds examples of better care against a benchmark.[33]
  3. Negative deviance finds examples of sub-optimal care.[30]
  4. Predictive patient risk modeling uses patterns in data to find groups at greater risk of adverse events.[34]
  5. Predictive care risk and outcome models identify situations that are at greater risk of poor care.[35]
  6. Clinical decision support systems use patient algorithms applied to patient data to make specific treatment recommendations.
  7. Comparative effectiveness research determines the most effective treatments.[35]
  8. Intelligent assistance use data to automate routine processes.[35]
  9. Surveillance monitors data for disease outbreaks or other treatment issues.[36]

Synergy with other disciplines

The LHS is a multidisciplinary and multi-stakeholder model for improvement, wherein clinical practitioners, health system leaders, data analysts and health IT experts, operations personnel, and researchers bring requisite expertise to bear throughout the cycle of improving health and healthcare. In a complex healthcare environment, sustained engagement of all health system stakeholders is necessary to successfully identify and prioritize evidence gaps, develop suitable interventions, analyze insights from the interventions, and deploy resulting changes. Hence, many disciplines and scientific domains may contribute various types of subspecialty expertise including:

Training

As the LHS has matured, leaders and vanguard organizations have identified the requisite skills needed to lead and develop interventions that support learning. The Agency for Healthcare Research and Quality convened a technical expert panel in 2016 to identify core competencies, which yielded 33 competencies spanning seven domains.[37] These competency domains are (1) Systems Science; (2) Research Questions and Standards of Scientific Evidence; (3) Research Methods; (4) Informatics; (5) Ethics of Research and Implementation in Health Systems; (6) Improvement and Implementation Science; (7) Engagement, Leadership, and Research Management. An 8th domain, Equity and Justice, was added in 2022 and a total of 38 competencies are now identified. These competencies form the backbone of a training program collaboratively funded by AHRQ and PCORI, two US funding agencies that also issue funding opportunities for LHS-related studies. A $40 million funding opportunity for mentored career development awards was issued in 2017 and 11 Centers of Excellence were awarded five years of federal funding in 2018 to support the training of clinician and research scientists to conduct patient-centered outcomes research within LHS.[38][39]

The LHS Centers of Excellence funded in 2018 were:[40]

  1. A Chicago Center of Excellence in Learning Health Systems Research Training (ACCELERAT), Northwestern University, Chicago, Ill.
  2. CATALyST: Consortium for Applied Training to Advance the Learning Health System with Scholars/Trainees, Kaiser Permanente Washington Research Institute, Seattle, WA.[41]
  3. Learning Health System Scholar Program at Vanderbilt University, Nashville, Tenn.
  4. Leveraging Infrastructure to Train Investigators in Patient-Centered Outcomes Research in Learning Health System (LITI- PCORLHS), Indiana University School of Medicine, Indianapolis, Ind.[42]
  5. Minnesota Learning Health System Mentored Career Development Program (MN-LHS), University of Minnesota, Minneapolis, Minnesota.[43]
  6. Northwest Center of Excellence & K12 in Patient Centered Learning Health Systems Science, Oregon Health and Science University, Portland, Oregon.[44]
  7. PEDSnet Scholars: A Training Program for Pediatric Learning Health System Researchers, Children’s Hospital of Philadelphia, Philadelphia, PA[45]
  8. Stakeholder-Partnered Implementation Research and Innovation Translation (SPIRIT) program, University of California Los Angeles, Los Angeles, California.[46]
  9. The Center of Excellence in Promoting LHS Operations and Research at Einstein/Montefiore (EXPLORE), Albert Einstein College of Medicine, Bronx, N.Y.
  10. Transforming the Generation and Adoption of PCOR into Practice (T-GAPP), University of Pennsylvania, Philadelphia, PA.
  11. University of California-San Francisco Learning Health System K12 Career Development Program, University of California San Francisco, San Francisco, California.

As the funding for the aforementioned Centers of Excellence concludes in 2023, a successor funding opportunity was created by AHRQ and PCORI to fund Learning Health System Embedded Scientist Training and Research (LHS E-STaR) Centers. Other similar training and fellowship programs have been offered by AcademyHealth via their Delivery System Science Fellowship program, Kaiser Permanente’s Division of Research, and the Veterans Administration via the Seattle-Denver Center of Innovation. Program offerings and emphases vary from institution to institution, but all involve training and professional development in topics related to improving health systems and the ability to generate and learn from evidence. Articles describing multidisciplinary workforce training efforts was published as a supplement to the LHS Journal in 2022, including an experience report summarizing the collective insights from the 11 initially funded Centers of Excellence.

Funding and financial support

Support for learning activities may be derived from federal, philanthropic, and other sources. Examples include the National Institutes of Health and AHRQ (federal); and the Robert Wood Johnson Foundation (philanthropic). The Patient-Centered Outcomes Research Institute (PCORI) has designated the realization of a national learning health system as one of their five national priorities for health, which is indicative of future funding opportunities. Funding provided to personnel within an organization (i.e., a health system) may be designated for internally-directed learning activities with no expectation about developing and publishing generalizable results. In this way, learning health system may be distinguished from traditional health services or informatics research and more closely resemble the funding and infrastructure that health systems designate for quality improvement activities. In 2015, the Centers for Medicare and Medicaid Services (CMS) funded the Health Care Payment Learning and Action Network to ascertain what works with respect to alternative health care delivery arrangements, however, reimbursement for learning activities from insurers/payers is not currently a steady avenue for financial support to incentivize health system learning.

Ethical considerations

Bioethics scholars including Faden, Asch, Finkelstein, Morain, and Platt have averred that in a learning health system, consideration should be given to both clinical ethics and research ethics. Faden, Kass and colleagues have put forth an ethics framework for the learning health system that is anchored on seven essential obligations: (1) respecting dignity and rights of all patients; (2) respecting clinical judgment; (3) providing optimal care to every patient; (4) avoiding the introduction of non-clinical burdens and risks; (5) reducing health inequities; (6) ensuring responsible activities are conducted in a way that fosters learning; and (7) contributing to the overall aim of improving quality and value in health care.[47] This framework and several companion articles were published as a special report from the Hastings Center. Subsequent articles by Finkelstein et al, as well as Asch and colleagues seek to use examples of learning activities as a means to describe different approaches to research oversight and compliance.[48][49] Rigorous deliberations about the approach to informed consent are also germane to the ethics of learning activities in the healthcare context.

See also

References

  1. ^ a b Olsen L, Aisner D, McGinnis JM, et al. (U.S. Institute of Medicine) (2007). "The Learning Healthcare System: Workshop Summary". Digital Infrastructure for the Learning Health System: The Foundation for Continuous Improvement in Health and Health Care. National Academies Press (US). ISBN 978-0-309-10300-8. PMID 22379651. Archived from the original on 2020-11-26. Retrieved 2018-06-15.
  2. ^ a b Grossmann C, Powers B, McGinnis JM, eds. (2011). Digital Infrastructure for the Learning Health System: The Foundation for Continuous Improvement in Health and Health Care (PDF). Washington, DC. ISBN 978-0-309-15416-1. Archived (PDF) from the original on 2022-01-20. Retrieved 2018-06-15. {{cite book}}: |work= ignored (help)CS1 maint: location missing publisher (link)
  3. ^ a b c d McLachlan S, Potts HW, Dube K, Buchanan D, Lean S, Gallagher T, Johnson O, Daley B, Marsh W, Fenton N (June 2018). "The Heimdall Framework for Supporting Characterisation of Learning Health Systems". Journal of Innovation in Health Informatics. 25 (2): 77–87. doi:10.14236/jhi.v25i2.996. PMID 30398449. S2CID 53235486.
  4. ^ Greene SM, Reid RJ, Larson EB (August 2012). "Implementing the learning health system: from concept to action". Annals of Internal Medicine. 157 (3): 207–10. doi:10.7326/0003-4819-157-3-201208070-00012. PMID 22868839. S2CID 6387264.
  5. ^ Forrest CB, Margolis P, Seid M, Colletti RB (July 2014). "PEDSnet: how a prototype pediatric learning health system is being expanded into a national network". Health Affairs. 33 (7): 1171–7. doi:10.1377/hlthaff.2014.0127. PMID 25006143.
  6. ^ Institute of Medicine (2001). Crossing the Quality Chasm: A New Health System for the 21st Century. Washington DC: National Academy Press. p. 360. doi:10.17226/10027. ISBN 978-0-309-46561-8. PMID 25057539.
  7. ^ Etheredge LM (2007). "A rapid-learning health system". Health Affairs. 26 (2): w107–18. doi:10.1377/hlthaff.26.2.w107. PMID 17259191.
  8. ^ Faden RR, Kass NE, Goodman SN, Pronovost P, Tunis S, Beauchamp TL (2013). "An ethics framework for a learning health care system: a departure from traditional research ethics and clinical ethics". The Hastings Center Report. Spec No: S16–27. doi:10.1002/hast.134. PMID 23315888.
  9. ^ Smith M, Saunders R, Stuckhardt L, McGinnis JM, Committee on the Learning Health Care System in America, Institute of Medicine, et al. (Committee on the Learning Health Care System in America; Institute of Medicine) (2013). Smith M, Saunders R, Stuckhardt L, McGinnis JM (eds.). Best Care at Lower Cost: The Path to Continuously Learning Health Care in America. Washington, D.C.: The National Academies Press. doi:10.17226/13444. ISBN 978-0-309-26073-2. PMID 24901184. S2CID 173866008.
  10. ^ McGinnis JM, Fineberg HV, Dzau VJ (July 2021). "Advancing the Learning Health System". The New England Journal of Medicine. 385 (1): 1–5. doi:10.1056/NEJMp2103872. PMID 34192452. S2CID 235696457.
  11. ^ Seid M, Hartley DM, Margolis PA (July 2021). "A science of collaborative learning health systems". Learning Health Systems. 5 (3): e10278. doi:10.1002/lrh2.10278. PMC 8278442. PMID 34277944.
  12. ^ Williams M, Richesson RL, Bray BE, Greenes RA, McIntosh LD, Middleton B, et al. (January 2021). "Summary of third annual MCBK public meeting: Mobilizing computable biomedical knowledge-Accelerating the second knowledge revolution". Learning Health Systems. 5 (1): e10255. doi:10.1002/lrh2.10255. PMC 7804998. PMID 33490385.
  13. ^ Demakis JG, McQueen L, Kizer KW, Feussner JR (June 2000). "Quality Enhancement Research Initiative (QUERI): A collaboration between research and clinical practice". Medical Care. 38 (6 Suppl 1): I17–I25. doi:10.1097/00005650-200006001-00003. PMID 10843267. Archived from the original on 2022-12-07. Retrieved 2022-12-07.
  14. ^ Greene SM, Reid RJ, Larson EB (August 2012). "Implementing the learning health system: from concept to action". Annals of Internal Medicine. 157 (3): 207–210. doi:10.7326/0003-4819-157-3-201208070-00012. PMID 22868839. S2CID 6387264.
  15. ^ Institute of Medicine (US) (2010-07-02). A Foundation for Evidence-Driven Practice: A Rapid Learning System for Cancer Care: Workshop Summary. Washington, D.C.: National Academies Press. doi:10.17226/12868. ISBN 978-0-309-15126-9. PMID 25032381.
  16. ^ Psek WA, Stametz RA, Bailey-Davis LD, Davis D, Darer J, Faucett WA, et al. (2015-03-10). "Operationalizing the learning health care system in an integrated delivery system". eGEMs. 3 (1): 1122. doi:10.13063/2327-9214.1122. PMC 4434917. PMID 25992388.
  17. ^ Forrest CB, Margolis PA, Bailey LC, Marsolo K, Del Beccaro MA, Finkelstein JA, et al. (2014-07-01). "PEDSnet: a National Pediatric Learning Health System". Journal of the American Medical Informatics Association. 21 (4): 602–606. doi:10.1136/amiajnl-2014-002743. PMC 4078288. PMID 24821737.
  18. ^ Abernethy AP, Etheredge LM, Ganz PA, Wallace P, German RR, Neti C, et al. (September 2010). "Rapid-learning system for cancer care". Journal of Clinical Oncology. 28 (27): 4268–4274. doi:10.1200/JCO.2010.28.5478. PMC 2953977. PMID 20585094.
  19. ^ McLachlan S, Potts HW, Dube K, Buchanan D, Lean S, Gallagher T, et al. (June 2018). "The Heimdall Framework for Supporting Characterisation of Learning Health Systems". Journal of Innovation in Health Informatics. 25 (2): 77–87. doi:10.14236/jhi.v25i2.996. PMID 30398449. S2CID 53235486.
  20. ^ Menear M, Blanchette MA, Demers-Payette O, Roy D (August 2019). "A framework for value-creating learning health systems". Health Research Policy and Systems. 17 (1): 79. doi:10.1186/s12961-019-0477-3. PMC 6688264. PMID 31399114.
  21. ^ Foley, Tom; Vale, Luke (2022-05-20). "A framework for understanding, designing, developing and evaluating learning health systems". Learning Health Systems. 7 (1): e10315. doi:10.1002/lrh2.10315. ISSN 2379-6146. PMC 9835047. PMID 36654802. S2CID 248976825.
  22. ^ Budrionis A, Bellika JG (December 2016). "The Learning Healthcare System: Where are we now? A systematic review". Journal of Biomedical Informatics. 64: 87–92. doi:10.1016/j.jbi.2016.09.018. PMID 27693565.
  23. ^ Platt JE, Raj M, Wienroth M (March 2020). "An Analysis of the Learning Health System in Its First Decade in Practice: Scoping Review". Journal of Medical Internet Research. 22 (3): e17026. doi:10.2196/17026. PMC 7118548. PMID 32191214.
  24. ^ Nash DM, Bhimani Z, Rayner J, Zwarenstein M (June 2021). "Learning health systems in primary care: a systematic scoping review". BMC Family Practice. 22 (1): 126. doi:10.1186/s12875-021-01483-z. PMC 8223335. PMID 34162336.
  25. ^ Ellis LA, Sarkies M, Churruca K, Dammery G, Meulenbroeks I, Smith CL, et al. (February 2022). "The Science of Learning Health Systems: Scoping Review of Empirical Research". JMIR Medical Informatics. 10 (2): e34907. doi:10.2196/34907. PMC 8908194. PMID 35195529.
  26. ^ Easterling D, Perry AC, Woodside R, Patel T, Gesell SB (April 2022). "Clarifying the concept of a learning health system for healthcare delivery organizations: Implications from a qualitative analysis of the scientific literature". Learning Health Systems. 6 (2): e10287. doi:10.1002/lrh2.10287. PMC 9006535. PMID 35434353.
  27. ^ Masica AL, Velasco F, Nelson TL, Medford RJ, Hughes AE, Pandey A, et al. (October 2022). "The Texas Health Resources Clinical Scholars Program: Learning healthcare system workforce development through embedded translational research". Learning Health Systems. 6 (4): e10332. doi:10.1002/lrh2.10332. PMC 9576247. PMID 36263262.
  28. ^ McLachlan S, Dube K, Johnson O, Buchanan D, Potts HW, Gallagher T, Fenton N (October 2019). "A framework for analysing learning health systems: Are we removing the most impactful barriers?". Learning Health Systems. 3 (4): e10189. doi:10.1002/lrh2.10189. PMC 6802533. PMID 31641685.
  29. ^ Paul Taylor (2007). Taylor P (ed.). From Patient Data to Medical Knowledge: The Principles and Practice of Health Informatics. Blackwell Publishing Ltd. doi:10.1002/9780470994702. ISBN 9780470994702. Archived from the original on 2021-06-17. Retrieved 2018-06-15.
  30. ^ a b Deeny SR, Steventon A (August 2015). "Making sense of the shadows: priorities for creating a learning healthcare system based on routinely collected data". BMJ Quality & Safety. 24 (8): 505–15. doi:10.1136/bmjqs-2015-004278. PMC 4515981. PMID 26065466.
  31. ^ Abernethy AP, Ahmad A, Zafar SY, Wheeler JL, Reese JB, Lyerly HK (June 2010). "Electronic patient-reported data capture as a foundation of rapid learning cancer care". Medical Care. 48 (6 Suppl): S32–8. doi:10.1097/MLR.0b013e3181db53a4. PMID 20473201. S2CID 25887372.
  32. ^ Friedman CP, Wong AK, Blumenthal D (November 2010). "Achieving a nationwide learning health system". Science Translational Medicine. 2 (57): 57cm29. doi:10.1126/scitranslmed.3001456. PMID 21068440. S2CID 19569336.
  33. ^ Bradley EH, Curry LA, Ramanadhan S, Rowe L, Nembhard IM, Krumholz HM (May 2009). "Research in action: using positive deviance to improve quality of health care". Implementation Science. 4: 25. doi:10.1186/1748-5908-4-25. PMC 2690576. PMID 19426507.
  34. ^ Lewis G, Kirkham H, Duncan I, Vaithianathan R (April 2013). "How health systems could avert 'triple fail' events that are harmful, are costly, and result in poor patient satisfaction". Health Affairs. 32 (4): 669–76. doi:10.1377/hlthaff.2012.1350. PMID 23569046.
  35. ^ a b c Foley TJ, Vale L (October 2017). "What role for learning health systems in quality improvement within healthcare providers?". Learning Health Systems. 1 (4): e10025. doi:10.1002/lrh2.10025. PMC 6508561. PMID 31245567.
  36. ^ Ye Y, Wamukoya M, Ezeh A, Emina JB, Sankoh O (September 2012). "Health and demographic surveillance systems: a step towards full civil registration and vital statistics system in sub-Sahara Africa?". BMC Public Health. 12: 741. doi:10.1186/1471-2458-12-741. PMC 3509035. PMID 22950896.
  37. ^ Forrest CB, Chesley FD, Tregear ML, Mistry KB (August 2018). "Development of the Learning Health System Researcher Core Competencies". Health Services Research. 53 (4): 2615–2632. doi:10.1111/1475-6773.12751. PMC 6051975. PMID 28777456.
  38. ^ "AHRQ and PCORI Institutional Mentored Career Development Program (K12) to Support the Next Generation of Learning Health System Researchers". www.ahrq.gov. Archived from the original on 2021-06-23. Retrieved 2021-05-22.
  39. ^ "Supporting the Next Generation of Learning Health Systems Researchers". www.pcori.org. October 27, 2017. Archived from the original on February 19, 2020. Retrieved February 19, 2020.
  40. ^ "AHRQ and PCORI Announce Awards to Support The Next Generation of Learning-Health-System Researchers". www.ahrq.gov. Archived from the original on 2021-05-22. Retrieved 2021-05-22.
  41. ^ "CATALyST K12 - Early Career Scientist Training". Archived from the original on 2020-03-20. Retrieved 2020-02-19.
  42. ^ "IU-Regenstrief receive award for learning health system researchers". Archived from the original on 2020-02-19. Retrieved 2020-02-19.
  43. ^ "Minnesota Learning Health System - Projects and Research Studies - School of Public Health - University of Minnesota". Archived from the original on 2020-02-19. Retrieved 2020-02-19.
  44. ^ "PACT-K12 | OHSU". www.ohsu.edu. Archived from the original on 2021-09-09. Retrieved 2020-02-19.
  45. ^ "Scholars - PEDSnet". pedsnet.org. Archived from the original on 2020-02-19.
  46. ^ "SPIRIT K12 - General Internal Medicine & Health Services Research - UCLA Health - Los Angeles, CA". www.uclahealth.org. Archived from the original on 2020-02-19. Retrieved 2020-02-19.
  47. ^ Faden RR, Kass NE, Goodman SN, Pronovost P, Tunis S, Beauchamp TL (January 2013). "An ethics framework for a learning health care system: a departure from traditional research ethics and clinical ethics". The Hastings Center Report. Spec No (s1): S16–S27. doi:10.1002/hast.134. PMID 23315888.
  48. ^ Finkelstein JA, Brickman AL, Capron A, Ford DE, Gombosev A, Greene SM, et al. (October 2015). "Oversight on the borderline: Quality improvement and pragmatic research". Clinical Trials. 12 (5): 457–466. doi:10.1177/1740774515597682. PMC 4699562. PMID 26374685.
  49. ^ Asch DA, Joffe S, Bierer BE, Greene SM, Lieu TA, Platt JE, et al. (December 2020). "Rethinking ethical oversight in the era of the learning health system". Healthcare. 8 (4): 100462. doi:10.1016/j.hjdsi.2020.100462. PMID 32992106. S2CID 221725518.