Track & Fan: New and Promising Actions Using Sprint Evaluation

The main questions of sprint evaluation

Spurtevaluerunger examines whether new initiatives in the public sector have made a positive difference, which dictates that we enlarge and spread the action.
The key questions are: What is being done differently? What positive effects can be documented? What is the mechanism that has created the proven result? Under what circumstances can the measure be expected to have a positive effect? What does it take from another organization that wants to use the measure in a customized form?

Initiation and execution of a sprint evaluation

A sprint evaluation can be initiated by researchers who have heard of or seen a promising action and therefore contact the responsible actors. Practitioners who experience success in making a positive difference can also initiate a sprint evaluation. The common denominator is that the promoters consider that the initiative can serve as inspiration for others, and that both researchers and practitioners contribute to the evaluation.

If the interest in doing a sprint evaluation is mutual, it is important that researchers and practitioners meet to reconcile their expectations and agree on the basis and procedure for the evaluation. The meeting can be either physical or online and should include a presentation of the action as well as a clarification of who is collecting the data and conducting the analysis. It is also useful to get into how, when and in what form the result is presented. Finally, it must be agreed how any costs will be covered. There may be situations in which a researcher conducts evaluation, as part of his or her own research, based on data obtained with the assistance of practitioners. Other times, one or more students may be interested in conducting the evaluation under the guidance of a researcher.

Typically, a sprint evaluation will build on the relevant documents, 5 to 15 interviews with affected informants (potentially supplemented/replaced in part by observation), as well as quantitative data illuminating the results. Data are analyzed and reported in a 5-7 page report, which is preferably presented at a joint meeting. The report is then made publicly available and the main points are communicated through digital communication channels or orally via submissions at conferences, seminars, etc.

Form and content of the sprint evaluation

The analysis of key documents, interviews with stakeholders, inventory of results achieved and observation shall clarify the background, form, effect and conditions of the new action.

In assessing the impact of a new measure, it is important to provide a comparative basis for the assessment. Does the new measure have a positive effect on one or more parameters in a given entity (organisation, municipality, region, government, etc.)? The comparison may be to other entities, previous actions or the situation before the new measure was applied. If the potential effect is examined via comparison with other devices, it is important that the devices are comparable. Similarly, there must be comparability over time (e.g. in terms of resources and difficulty of the task) if one looks at the results before and after the action.

In general, the more knowledge we have about the measure itself, the actual and expected consequences of the measure, measured through a comparison of past and present results in the given unit or between different entities, the stronger the argument for magnifying the possible positive effect of the measure.

It can be important to assess the effect on several different parameters. What does the measure mean, for example, for employee well-being, efficiency and user satisfaction? The negative effects must also be elucidated, while assessing whether some of these effects are compensated in one way or another.

In assessing the impact, it is important to take into account whether the measure has been implemented as planned and what factors contributed or hindered the achievement of a positive result. Other entities, depending on their own circumstances, will be able to benefit more or less from being inspired by the new measure.

‍

A completed sprint evaluation will typically contain the following items:
‍

• A description of the new initiative and its background: Who has done what, how and when, against what background and with what intention?
• An account of effects focusing on comparison between before and now and/or between different entities with different ways of doing things
• A description of the effective mechanism of the new action which is expected to have produced the positive impact: what has made a positive difference?
• An analysis of the local conditions that have inhibited and promoted the positive effect of the identified mechanism
• A conclusion on the proliferation potential: what can other public organisations achieve by being inspired by the new measure?
• An explanation of the data base and any reservations
• A list of relevant contact persons

‍

The idea is that a sprint evaluation will be carried out and reported within three months of the first meeting of the agreement. This ensures that interest in the evaluation is maintained and that the result has good opportunities to be applied and useful.

Magnification of positive actions

Positive actions are magnified when others implement them in customized form. It requires them to disperse. This can be done, for example, through research publications in which they illustrate new theories or concepts. It can also be done through lectures where you can get in depth with different aspects, or through sample collections and digital communication.

Positive public administration

The effort to find and magnify new interventions that work, using spurt evaluations, is part of an international research group's effort to develop positive public administration research. There is still a need for researchers to take a critical look at societal developments and the public sector, but there is also a need to draw positive experiences from new initiatives to light. It allows research and practice to jointly create improvements for the benefit of citizens and society.