Our impact evaluation framework
Our impact evaluation activities provide credible evidence of the effects of our research and innovation activities on the economy, environment and society.
Our research activities and their impacts are diverse in nature and occur across many sectors of the economy. While some impacts are primarily economic and capable of being evaluated in monetary terms, many others – especially those relating to environmental or social effects – may have to be evaluated qualitatively. Ultimately though, each impact must be assessed within the context of a common framework if a comprehensive understanding of our impact and return on investment is to be developed.
Our Impact Evaluation Guide articulates such a common framework, and its consistent and rigorous use across our organisation ensures that outcomes from each evaluation are comparable – across Research Units and across time.
The guide describes the minimum requirements for all our impact evaluations, regardless of the purpose of the evaluation or the 'unit of evaluation' (which could be an individual project, subject area, Research Unit or the whole enterprise). It guides researchers, staff and engaged external support to address key relevant questions in a logically consistent manner and to select the appropriate resources and methods in the evaluation of our research.
We have just released an updated version of our Guide - View the full Impact Evaluation Guide.
The major changes made were:
- A refinement of CSIRO’s impact assessment process, including a clearer distinction between steps and the components included in each step.
- An expanded description of relevant analysis and measurement methodologies for both evaluation approaches and impact measurement, including added appendices on quasi-experimental methods and qualitative approaches.
- An updated list of source materials reflecting updated guidelines from the Department of the Prime Minister and Cabinet, Department of Finance, Infrastructure Australia, New Zealand Treasury, U.S. Office of Management and Budget, and His Majesty’s Treasury, among others.
- Enhanced guidance on completing distributional analysis, including the option for applying income weights to economic analyses.
- Added guidance on documenting recommendations for optimising impact, including lessons learnt, best practices and barriers to adoption.
- An increased focus on enhancing the comparability of case studies by suggesting applying a library of common statistics when measuring impacts wherever possible.
- Enhanced guidance on benefit-cost cash flow analysis, including detailed appendix examples and a checklist outlining processes.
The International School on Research Impact Assessment
CSIRO is a partner of the International School on Research Impact Assessment (ISRIA) that was founded to foster the capacity and capability of individuals and organisations to assess the impact of research investments and activities.
To accelerate the sharing of knowledge, ISRIA has adopted an open access strategy whereby resources and tools are available to anyone for a public purpose.
ISRIA can assist with information and advice around research impact assessment and provides access to a growing global community of practice through its partner and participant network.
Our impact evaluation framework
Our impact evaluation activities provide credible evidence of the effects of our research and innovation activities on the economy, environment and society.
Our research activities and their impacts are diverse in nature and occur across many sectors of the economy. While some impacts are primarily economic and capable of being evaluated in monetary terms, many others – especially those relating to environmental or social effects – may have to be evaluated qualitatively. Ultimately though, each impact must be assessed within the context of a common framework if a comprehensive understanding of our impact and return on investment is to be developed.
Our Impact Evaluation Guide articulates such a common framework, and its consistent and rigorous use across our organisation ensures that outcomes from each evaluation are comparable – across Research Units and across time.
The guide describes the minimum requirements for all our impact evaluations, regardless of the purpose of the evaluation or the 'unit of evaluation' (which could be an individual project, subject area, Research Unit or the whole enterprise). It guides researchers, staff and engaged external support to address key relevant questions in a logically consistent manner and to select the appropriate resources and methods in the evaluation of our research.
We have just released an updated version of our Guide - View the full Impact Evaluation Guide PDF (2 MB).
The major changes made were:
- A refinement of CSIRO’s impact assessment process, including a clearer distinction between steps and the components included in each step.
- An expanded description of relevant analysis and measurement methodologies for both evaluation approaches and impact measurement, including added appendices on quasi-experimental methods and qualitative approaches.
- An updated list of source materials reflecting updated guidelines from the Department of the Prime Minister and Cabinet, Department of Finance, Infrastructure Australia, New Zealand Treasury, U.S. Office of Management and Budget, and His Majesty’s Treasury, among others.
- Enhanced guidance on completing distributional analysis, including the option for applying income weights to economic analyses.
- Added guidance on documenting recommendations for optimising impact, including lessons learnt, best practices and barriers to adoption.
- An increased focus on enhancing the comparability of case studies by suggesting applying a library of common statistics when measuring impacts wherever possible.
- Enhanced guidance on benefit-cost cash flow analysis, including detailed appendix examples and a checklist outlining processes.
The International School on Research Impact Assessment
CSIRO is a partner of the International School on Research Impact Assessment (ISRIA) that was founded to foster the capacity and capability of individuals and organisations to assess the impact of research investments and activities.
To accelerate the sharing of knowledge, ISRIA has adopted an open access strategy whereby resources and tools are available to anyone for a public purpose.
ISRIA can assist with information and advice around research impact assessment and provides access to a growing global community of practice through its partner and participant network.