Research and evaluation

A User's Guide to Advocacy Evaluation Planning (Harvard Family Research Project, 2009) (PDF, 3227kb)
A guide for advocates, evaluators, and funders who want guidance on how to evaluate advocacy and policy change efforts. The User's Guide takes you through four basic steps that generate the core elements of an advocacy evaluation plan, including what will be measured and how.

Conducting a search for research literature (Research in practice, 2008) (PDF, 177kb)
Step-by-step guide to facilitate the process of a literature search.

Evaluating your project - using evidence to improve outcomes for communities (South Australia Community Health Research Unit, 2009) (PDF, 575kb)
This factsheet outlines in simple steps the key evaluation process. A resource relevant to community development and primary health care professionals.

Evaluation: A guide for good practice (Mental Health and Special Programs Branch, Department of Health and Aged Care, Commonwealth of Australia, 2001) (PDF, 979kb)
This practical guide helps designing and implementing evaluation for a wide range of promotion and prevention initiatives. It outlines how people can work with each other, their stakeholders, clients and community to develop relevant, affordable and achievable evaluations for their initiatives. It also demonstrates how these evaluation processes can become part of day-to-day practice.

Evaluation of information sources (The world-wide web virtual library)
Points to criteria for evaluating information resources, particularly those on the internet. It is intended to be particularly useful to those who are selecting sites to include in an information resource guide, or informing users as to the qualities they should use in evaluating internet information.

Mythbusters teaching resource (Canadian Health Science Research Foundation, 2008) (PDF, 1mb)
How to write easy to read research summaries to policy makers funders and planners, managers and providers.

PHC RIS Factsheet Dissemination Matters (Primary Health Care Research & Information Service, 2009)
This factsheet outlines how to create a constructive communication between researchers and policy developers to support the development of effective, evidence based public policy.

PowerPoint does rocket science - and better techniques for technical reports (Edward Tufte, 2005)
Reflect on how to illustrate/present data and the impact of presentations. The website also focuses on visual explanations, the visual display of quantitative information, and data analysis for politics and policy.

Product evaluation/evaluation tool (Educational Psychology and Instructional Technology)
A set of templates, logs, forms and tables for product evaluation.

Quick tips for the evaluation process (Program development and Education, University of Wisconsin - Extension, varied)
Range of brief practical suggestions by subject heading related to the research process, for example, ensuring adequate response rates, extracting relevant information from qualitative research, managing data and more.

Resources (Canadian Health Science Research Foundation)
Articles and fact sheets that enable the sharing of knowledge/results between researchers and people who need the research.

Scoping study: Monitoring and evaluation research communication (Collaborative work between Health Link, Institute of Development Studies and other UK organisations, 2006) (PDF, 359kb)
Highlight issues related to communicating study results to a narrow target group.

Statistics at square one (British Medical Journal, 1997)
Manipulation of data is a major step in research and evaluation. Statistical terms are explained in a simple comprehensive way with relevant examples, aiming more effective data manipulation.

Step by step manuals (Centres for disease control and prevention, evaluation working group)
Wide range of resources and links for program evaluation in public health, research methods and online publications.

A guide for using statistics for evidence based policy (Australian Bureau of Statistics, 2010)
This guide provides an overview of how statistical information can be used to make well informed policy decisions. Throughout the guide references are made to other resources, relevant training courses and associated frameworks that provide more detail.

A basic guide to program evaluation (Authenticity Consulting, 2002)
A clear explanation in plain language of myths of evaluation and practical steps for conducting such an evaluation

First steps in monitoring and evaluations (Charities Evaluation Services, 2002) (PDF, 78kb)
A guide for small voluntary organisations with little or no experience of monitoring and evaluation.

Introduction to evaluation (Te Pou, 2008) (PDF, 104kb)
A two page summary about evaluation and what to consider.

Promoting good(ness) - A guide to evaluating programmes and projects (Rachel Trotman, 2008) (PDF, 727kb)
This comprehensive and easy to read introduction guide with a great overview and step by step tips targets those who want to do an evaluation themselves.

Mental Health and Addiction Service Evaluator Workbook (Te Pou, 2010) (PDF, 1.8 mb)
This workbook is designed as an introductory resource for service users who are considering taking part in an auditing or evaluation process. It is also a useful resource for service users involved in service planning and development, quality improvement, systemic advocacy, leadership and management.

Designing a cross-project evaluation (Urban Institute, 2008) (PDF, 503kb)
A model to conduct an evaluation of a range of programs with similar goals so that data maybe aggregated across projects.

Enhancing program performance with logic models (University of Wisconsin - Extension)
A multimedia online course on logic model for a holistic approach to planning and evaluating education and outreach programs.

Logic models - requirements for many funders and organisations (Program development and Education, University of Wisconsin - Extension)
Developing logic models helps to plan, implement, evaluate and communicate within public, private and non-profit sectors.

Most Significant Change technique (Dart, J.J. and Davies R.J., 2005)
Describes the Most Significant Change (MSC) technique, a participatory monitoring and evaluation method.

Outcomes central (Dr Paul Duignan, 2005)
A resource for those working with outcomes, strategy and evaluation; includes logic model information, DoView model (logic model) software, links to outcomes and evaluation sites, guidelines, easy to do steps.

Participatory planning, evaluation and monitoring (Clear Horizon (led by Jess Dart))
Useful information about design of monitoring, evaluation and learning frameworks and the Most Significant Change (MSC) technique.

Quick start guide (Dart, J.J. and Davies R.J., 2003) (PDF, 167kb)
A self help guide for implementing the Most Significant Change (MSC) technique.

Resources for methods in evaluation and social research (The global social change research project)
Lists free resources on "how-to" do evaluation research and the methods used, for example surveys, focus groups, sampling, interviews, and other methods.

Understanding what matters: A guide to using patient feedback to transform care (Department of Health, UK, 2009)
This guide outlines how the range of different sources of patients experience information can be an integral part of local quality improvement systems. The described feedback cycle sets out best practice in terms of collecting, analysing and using patient feedback to transform services. It supports the embedding of patient insight within everyday practice.

A Practical Guide for Engaging Stakeholders in Developing Evaluation Questions (Robert Wood Johnson Foundation, 2009) (PDF, 1mb)
The presented five-step process, four worksheets and case examples increase the value and usefulness of evaluation and assist in developing evaluation questions.

Systematic review of methods for evaluating healthcare research economic impact (Yazdizadeh B, Majdzadeh R, & Salmasian, H., Health Research Policy & Systems, 8, 6, 2010) (PDF, 28kb)
This peer-reviewed article uses the electronic search of databases and websites as its core methodology. Its seeks to study the economic benefits of healthcare research, so as to ensure that appropriate resources are allocated to it, particularly in developing countries.

Performance audit handbook: Routes to effective evaluation (Rand Corporation , 2009)
The Performance Audit Handbook provides a first-stop shop for anyone interested in the theory and practice of delivering performance audits. It is intended for: evaluators working to support accountability and learning in the public sector; those seeking to commission or use such services; and researchers interested in the unfolding practice of evaluating in the public interest.

Helping social research make a difference (Davies & Powell, 2010) (PDF, 327kb)
This discussion paper and seminar examins why interactions around research between researchers, policy makers, managers and practitioners can feel disappointing and frustrating. The paper aims to begin creative discussions on how social research might make a bigger difference through exploring a wider repertoire of approaches to its creation, communication and application.

Measuring impact in health improvement: An accessible guide for health practitioners (Local Government: Improvement and Development, 2011) (PDF, 770kb)
This UK guide has been developed for practitioners working for councils and public health organisations who have been given the task of evaluating the impact of a project or initiative. It will take you through the process of designing, implementing and disseminating an impact assessment and will also provide information on the range of tools and help that is available.

Whānau Ora health impact assessment (Ministry of Health )
A useful resource for policy makers used to predict the potential health effects of a policy on Māori and their whānau. It pays particular attention to Māori involvement in the policy development process and articulates the role of the wider health determinants in influencing health and well-being outcomes.

Code of practice for tangata whenua, community and voluntary sector research centre (The Clearing House, 2007)
The Code describes optimum practices in community research for the tangata whenua, community and voluntary sector research centre.

Guidelines on Pacific health research (Health Research Council of New Zealand, 2008) (PDF, 419kb)
Assist research with Pacific peoples, living in Aotearoa, New Zealand. The focus is on the New Zealand context of Pacific health research.

Kāupapa Māori Research (Rautaki Ltd and Māori and Indigenous Analysis Ltd. )
This website provides definitions, research and articles related to kaupapa Māori research.

Making research work (Canadian health services research foundation, 2007)
Useful papers and links about knowledge exchange, research, funding and capacity development.

Survivor-Controlled Research: A New Foundation for Thinking About Psychiatry and Mental Health (Russo, 2012)
This paper outlines the general achievements and challenges of survivor-controlled research. Arguing for the value of this research approach to demonstrate the ways in which it raises fundamental issues related to conventional knowledge production and challenges the nature of what counts as psychiatric evidence.

The evaluation hikoi: A Maori overview of programme evaluation (Te Ropu Whariki, Massey University, 2009) (PDF, 185kb)
Provides an overview of the issues surrounding public health programme evaluation by and for Maori, gives examples of the range of approaches that might be useful and highlights areas that evaluators may need to consider.

Why institutions are not the only thing that matters: Twenty-five years of health care reform in New Zealand (Starke, 2010) (PDF, 240kb)
This article questions the dominance of institutional based accounts on the causes of health care reform. It examines some theories of reform that go beyond institutionalism in an endeavor to fill in knowledge gaps that cannot be addressed with institutionalist theories alone. This is a an informative paper for policy makers, researchers and educators.

Freemind (Wikipedia, GPL - GNU General Public Licence)
This free mind-mapping software is very easy to use and highly rated as a useful tool for teams and educators.

Learning software (New Zealand Ministry of Education)
This website lists a range of quality software and support resources to assist educators to make informed decisions when identifying and using software. The snapshots of learning section contains screen shots showing how software (freeware and non-freeware) has been used in learning sessions.

NZ Government datasets online (NZ Government)
This directory of publicly available New Zealand government datasets. Users can search for NZ datasets and submit datasets. The site is a pilot and will be reviewed in June 2010.

Social by Social (Andy Gibson, et.al, 2009)
Social by Social is a practical guide to using new technologies to create social impact. The online or downloadable book makes tools accessible that are needed to engage a community, offer services, scale up activities and sustain projects.

SurveyMonkey (SurveyMonkey)
An easy to use website for creating surveys with supplied templates and question types for all levels; a user login and password are required to create and administer surveys.

Top100 Tools (Centre for Learning & Performance Technologies)
This website has links to useful learning software and tools, including free public tools and presents a top 25 ranked list of tools for personal learning/productivity and for creating learning solutions.

QuickStats – about a place (Statistics New Zealand, 2007)
These QuickStats can be very useful for estimating the make up of Asian and other ethnic populations, non-English speaking and overseas born. The census based information includes ethnic make up, birthplace, and languages spoken at regional, territorial authority (city or district community areas)