Skip to toolbar
  • Home
  • Browse All
  • Search
  • My History
  • Login
  • More
  • Contact Us
  • Using the Collections
  • How to Tag Items
  • Login
  • Register
4760

Warning. Cloning this item will not retain its parent-child relationship.

Open/Close Toolbox
    Format: Publication
    Linked To
    Publication Collection
    • Northern Institute - Learning Communities: International Journal of Learning in Social Contexts
    Tweet this on TwitterShare this on FacebookShare this on LinkedInShare this on TumblrShare this via email
    Tools
    DownloadAdd to My CollectionContact us about thisCitation for this item
    • Library
    • Art Collection & Gallery
    • Surprise Me
    • Contact Us
    Welcome GuestLogin
    Previous: Telling Context from Mechanism in Realist Evaluation: The role for theoryNext: On being realistic about reducing the prevalence and impacts of youth sexual violence and abuse in two Australian Indigenous communitiesPublications

    The case for experimental design in realist evaluation

    Expand/collapse
    Details
    Publication TypeJournal articleAbstractThis article argues the realist critique of experimental design to evaluate interventions in complex social systems is valid but incomplete. It argues for experimental approaches to testing realist theory and for estimating effect sizes.

    The paper aims to provide a means for scientific understanding of the relative value of interventions in different contexts, for whom and to what effect. The paper is grounded in a realist philosophy of science and a realist approach to evaluation. It argues for the use of experimental design to test and estimate the magnitude of an outcome in a hypothesised realist Context-Mechanism-Outcome (CMO) configuration. The approach requires that program theory (rather than the program) is the unit of analysis. It also requires that context – crucial for a mechanism firing – is brought into the effect size equation, while at the same time attempts are made to control for the effects of other mechanisms.

    The focus of this paper is on the general approach rather than a particular method. The approach was applied in an evaluation of a youth mentoring program. The method used was a matched-pair, pre and post-test, control group quasi-experimental design. The results of our application of the approach were limited but provided insight about the extent to which a particular mentoring mechanism, when properly targeted, could generate outcomes for certain students.

    This approach to evaluation is consistent with underlying principles of scientific realism and theory testing and provides a means for generating evidence about the value of interventions in complex social systems, for whom and to what extent.
    AuthorHawkins, A.Date2014Publication CollectionNorthern Institute - Learning Communities: International Journal of Learning in Social ContextsVolume14/ 2014Page Number46-59CopyrightCreative Commons Attribution 3.0 Australia License.Suggested CitationHawkins, A. (2014). The case for experimental design in realist evaluation. Learning Communities: International Journal of Learning in Social Contexts [Special Issue: Evaluation], 14, 46-59. DOI: http://doi.org/10.18793/LCJ2014.14.04.ISSNISSN 1329-1440 (online)ISSN 2202-7904 (print)PublisherFaculty of Law, Education, Business and Arts CHARLES DARWIN UNIVERSITYPlace of PublicationDarwin
    Hawkins, A., The case for experimental design in realist evaluation (2014). Charles Darwin University, accessed 06/02/2023, https://digitalcollections.cdu.edu.au/nodes/view/4760
    Privacy Policy | Terms of Use
    Content on this site may be subject to Copyright, please contact Charles Darwin University before any reuse if you are unsure.
    RECOLLECT is Copyright © 2011-2023 by Recollect Limited | Page rendered in 0.2792 seconds

    Charles Darwin University acknowledges the traditional custodians across the lands on which we live and work, and we pay our respects to Elders past, present and emerging.

    CRICOS Provider No: 00300K (NT/VIC) 03286A (NSW) RTO Provider No: 0373 TEQSA Provider ID PRV12069

    ABN 54 093 513 649 | Privacy | Copyright and Disclaimer | Cookies | Feedback