WHAT IS A SYSTEM?
A system is “an integrated whole whose essential properties arise from the relationship [interdependence] between its parts (p. 142)."
Ison, R. L. (2008). Systems thinking and practice for action research.
“There's always a flaw in the system” - Beetee (The Hunger Games Catching Fire)
OUR CONTRIBUTION TO SYSTEM EVALUATION
We are proud to be one of the world leaders in system evaluation. Dr. Renger published system evaluation theory (SET) which he developed based on his work in the emergency response sector. Our evaluation family has since published 7 articles on the application of SET. SET combines systems thinking and system theory to walk the client through three steps to evaluate their systems. SET is especially helpful in evaluating agencies working together around a common goal.
WHAT SYSTEM EVALUATION SERVICES DO YOU OFFER?
When evaluating a system we explore your needs in 2 main areas.
1. DEFINING YOUR SYSTEM
Working with leadership we will define who shares your common goal and how are you connected. For more information, please refer to our article on defining systems linked below.
2. EVALUATING SYSTEM EFFICIENCY
We will examine your standard operating procedures for:
1. System waste: we look for unnecessary duplication of effort (waste). We will then evaluate the source for this waste. Is it a staff training issue? Is your information technology (IT) causing delays? If your leadership supportive and providing the resources needed? Is your staff culture supportive of your goal? For more information, please refer to our article on system waste linked below.
2. Cascading failures: we don’t just look at where we see the problem, but evaluate to determine whether there is an upstream cause. For more information, please refer to our article on system cascading failures linked below.
3. Functional feedback loops: system health depends on functional feedback loops. We examine whether information is getting back to who needs it and whether the feedback is viewed as credible, relevant, specific, timely and sufficiently frequent. For more information, please refer to our article on system
feedback loops linked below.
4. Reflex arcs: is there a way to streamline your operations without sacrificing quality?
COLLECTION OF SYSTEM EVALUATION PUBLICATIONS
PDF Copies of each article can be accessed by clicking the hyperlinks below.
Knight, R. & Baldwin, L. (2022) Systems change theory and practice: A brief review and practical insights. The Australian Centre for Philanthropy and Nonprofit Studies, Queensland University of Technology.
Renger, R., Basson, M. D., Hart, G., Van Eck, R., Souvannasacd, E., Renger, J., & Foltysova, J. (2020). Lessons learned in evaluating the infrastructure of a Centre for Translational Research. Evaluation Journal of Australasia, 20(1), 6-22.
Renger, R., Foltysova, J., Renger, J., Donaldson, S.I., Hart, G., & Hawkins, A. (2020). Comparing and contrasting a program versus system approach to evaluation: the example of a cardiac care system. Canadian Journal of Program Evaluation, 35(2), 240-257.