RBM provides an approach and tools for both project design and project execution. Furthermore, it also uses the concept of the learning cycle to learn from one project and use it for future activities. We’ll describe the RBM process in 13 steps (for good luck).
The project design phase has two main parts:
During this first phase, problems and issues are identified, as well as possible ways to tackle them (strategies for solutions). Then the best intervention strategy is selected, which will be the basis for the project plan.
Usually the organisation that takes the initiative will have a basic idea of the problem it wants to tackle, the future intervention area and possible stakeholders. In this phase, these preliminary ideas are put to the test through participatory methods. But first you need to find people that want to help you with the identification of the problems and needs.
There are different categories of stakeholders that you could involve in the project’s design. In first instance, the potential beneficiaries of course: these can be local farmers or entrepreneurs; people that make use of medical facilities; villagers; local business people; women; young people; members of minority groups… It all depends on the type of project and the local situation. In addition, you can talk with local authorities, local NGOs, village councils (village elders), ministry delegates and so on.
For each group you can describe:
During this step, a problematic situation is analysed with the different stakeholders, including the (potential) beneficiaries of the project. Usually a method like the problem tree analysis or a fishbone analysis is used. Once the central problem is identified, the participants to the workshop can identify its root-causes. The following step is to describe the negative consequences of the problem and select the most important ones.
The problem tree then can be turned into a solutions tree, which will probably contain different ways of approaching the problem. Depending on the possibilities and capacities of the different partners and of the beneficiaries, the best approach or strategy to dealing with the central problem can be identified.
The Performance Framework (not to be confused with the Performance Measurement Framework) describes the intervention logic of the project. It describes how what we invest and what we do will lead to tangible results.
With the information from the solution tree analysis (or another method), the basic elements of the project can be identified:
The next step is to determine the results chain:
Outputs, effects and impact have to be described in such a way that they are clear for everyone and can’t be misinterpreted. It’s best to avoid overly complex formulations and complex concepts that may be interpreted differently in various contexts (for instance: ‘gender equality’ or ‘durability’). It’s better to explain what you mean by those fancy concepts in as plain a language as possible.
The performance Framework will later be used to fill out the left column of the logical framework.
The Performance Measurement Framework (PMF) is the next step after the Performance Framework. For each result that we expect for our project, we’ll identify indicators, ways to verify the information, ways to collect the information, the frequency at which the information is gathered and who is responsible for gathering that information.
For each level in the results chain (outputs – effects – impact), indicators have to be found. ‘Indicators’ does not necessarily equal ‘hard numbers’. However for RBM it is important to find indicators that are clear, concise and not up for interpretation. It’s a good idea to list as many indicators as you can to start with, and then select the most pertinent ones. You want these indicators to be:
Finding indicators is again a participatory exercise. At the very least people have to be able to be feedback to the indicators you suggest. It’s a good idea to test your draft list of indicators in real-world conditions.
Apart from the ‘classic’ output, effect and impact indicators, RBM also uses outreach indicators. Outreach indicators say something about the people that you reach. Very often, project indicators only talk about things like production, quality improvement, availability of services, training and capacities, etc. The human dimension – in other words the very reason for doing a development project in the first place – is totally left out.
RBM pushes you to reflect about outreach on all three levels of the results chain. The higher up the chain, the more difficult it becomes to accurately assess how many people the project will reach. Here are some questions to help you identify the outreach:
Where can you find the information for your indicators? You can make use of:
In some cases it may be interesting to have various sources of information that you can compare to each other (triangulation). Or you may need to combine different sources of information to get a complete picture.
Another question is how you will practically gather the information: using registration forms or questionnaires; registering it in a database or a spreadsheet; doing surveys… You must also decide on how regularly you will gather the information. And last but not least whose responsibility it is to gather what information.
There is more than just deciding on who is responsible for gathering certain pieces of information. It has to be clearly established how the responsibility for achieving the results is shared.
With all this information, the PMF can be established:
|
Indicators |
Verification sources |
Collection method |
Frequency |
Responsible |
Impact |
|
|
|
|
|
Effects |
|
|
|
|
|
Outputs |
|
|
|
|
|
Activities |
|
|
|
|
|
Outreach |
|
|
|
|
|
Inputs |
|
|
|
|
|
The O&A matrix is a planning tool that can be used to elaborate the more practical side of the project. For each output and effect it allows you to specify what activities are necessary, what resources (inputs) you will need and who will be responsible for that activity.
|
Activities |
Resources |
Responsible party |
Effect 1 |
|
|
|
Effect 2 |
|
|
|
Output 1 |
|
|
|
Output 2 |
|
|
|
When you take a closer look at the results chain, you will probably see that the cause and effect relations between activities and outputs, between outputs and effects and between outputs and impact are conditional. Basically, if all holds well we can expect that we’ll get the results that we want at the end. This means that we (implicitly) make a number of assumptions. What does it mean ‘if all goes well’?
RBM makes a distinction between assumptions, which are positive conditions, and risks that are negative factors. Both assumptions and risks can be internal or external factors. Internal factors are the things we have under control: the capacities of our staff, our management capacity, delegation of authority, etc. External factors are influences from the environment on our project.
There are different types of risks and assumptions:
Risks can have varying degrees of impact on our project. The influence of some risks will be negligible, or else they may be a nuisance but nothing we can’t handle. In other cases they may have a severe influence on whether we will be able to realise our objectives. In the worst case scenario, we may be forced to stop the project altogether.
Another factor we have to assess is what the chance is realistically that a risk will materialise during the project. The combination of the impact that a risk might have and its likelihood helps us to assess the situation and take (preventive) action. If a risk has low impact and is not likely, it’s really not worth mentioning in your logframe. High impact risks with low likelihood still have to be monitored. And when a risk really threatens the project and is very likely, it’s probably not worth starting the project in the first place.
Merely identifying the risks is not enough: it’s also important to reflect on what you will do if or when the risk occurs:
The Risk Register is a tool to identify and monitor risks over the course of the project. It resembles the PMF and lists the risks, the risk indicators, information sources, methods to collect information, the frequency at which the information will be collected and who is responsible for this information gathering.
Risks |
Indicators |
Information sources |
Data collection methods |
Frequency |
Responsible party |
|
|
|
|
|
|
At this point, it is time to take a look at the activities from a very practical point of view:
For simple activities, you may not have to go through this whole list of questions, but complex activities need to be planned and budgeted in some detail.
The intervention logic is the cause-and-effect chain or results chain that’s been identified in the Performance Framework:
This information is presented in the logical framework (first column, except for the resources).
Note that compared to the ‘classic’ logical framework as it is used in LFA and PCM, there is a dimension of time in the intervention logic of RBM, as well as a spatial dimension. We immediately get the outputs as a consequence of the activities. But it takes time for the effects to materialise (near the end of the project or maybe even after it) and the impact will only be visible after a long time (sometimes years or even decades after the project). The outputs will be used directly by the people involved in the project, while the effects are generally felt by those people and their immediate surroundings (family, clan, village). The impact on the other hand may be visible in a widespread area (region, country, internationally).
Now it’s time to bring together all the information that you’ve gathered so far into the logical framework matrix:
Once you’ve filled out the basic ideas, it’s time to worry about formulation. Make sure that your results are clear and not too overly complex. It’s important that they are unambiguous – meaning that they are understood the same way by everyone involved in the project. Avoid overly complex concepts such as ‘gender neutral’, ‘globalisation’, ‘sustainable’ that can be interpreted in many different ways. If you need such concepts, make sure that you specify them in your logframe and/or explain them somewhere.
It’s best to make sure that your results are formulated in a SMART way:
Outputs can be things or services, but at least on the level of the intermediate results (the purpose of your project or the specific objective in PCM/LFA talk) talk about results in terms of people. You are trying to improve the lives of your beneficiaries (clients), not some kind of abstract change of situation.
The logical framework and the other tools such as the budget, the PMF and the risk register provide you with the basic information for the project proposal document. Generally, the narrative project document contains information about:
This narrative project document is completed with a number of annexes:
In the concept of RBM, the partners should be closely involved in the elaboration of the project proposal. This means that they participate in the writing but also that they officially approve the end result. Following this process of internal review and approval, the proposal is sent to one or more donors.
RBM doesn’t end with project design. The systems for monitoring and evaluation of performance and for risk management that were designed during the design phase have to be deployed during the initial stages of the project. In addition, RBM provides you with a set of tools that you can use for project management, follow-up and evaluation.
Performance is an important concept in RBM. It means the progress towards the different results. This means that monitoring isn’t restricted to verifying whether the activities take place according to planning. The plan may have to be modified, but the most important thing is to know whether the results are or will be achieved (in time). The idea behind tracking the performance through monitoring and evaluation, is to better manage the outputs and effects that are the real development results.
Compared to other approaches, RBM puts the emphasis on the effects or intermediate results (purpose of the project), instead of on the immediate results or outputs (or even activities).
However when you develop your monitoring system, in the RBM approach it is important to work on a participatory basis. In order to avoid that you develop a system that is too complex and cumbersome, you need to make sure that the monitoring system:
The information from the monitoring system should allow you to act: to modify your planning, your activities, the distribution of resources, etc. to changes in the context and to make sure that the results will be achieved.
Similarly, the evaluation of the project’s effects should be done based on participation of the stakeholders. Any evaluator (of the organisation or external) should consult the stakeholders, including the (intended) beneficiaries of the project.
The monitoring system with its indicators and description of who will measure what at which intervals (or for how long) allows you to collect information in a systematic way. Once collected, the information can be aggregated and synthesised if necessary and then be analysed.
Information gathering happens at regular intervals (daily, weekly, monthly, every 3 or 6 months or sometimes once a year) or every time an activity occurs. Sometimes this happens by going over the whole list of indicators and establishing the situation for every indicator at that moment, for instance during a monitoring mission. In this case you will get a set of information (data) at a given point in time. By putting this information in a table and adding new columns for consecutive sets, you will be able to see the evolution.
In other cases information gathering for different indicators happens at different moments and you don’t measure the whole set of indicators each time.
Using the Performance Measurement Framework, you can analyse the information that you gathered to assess:
Analyses and the conclusions are generally noted down and distributed in the form of reports. Again, keeping the participatory nature of RBM in mind, you should not forget that reporting is not something you do for the benefit of the donor and for headquarters only (upward accountability). Partners and beneficiaries must be informed too (downward accountability). The whole idea of this participatory approach to monitoring and learning is to stimulate a feeling of ownership of the project and its results by the beneficiaries.
Normally, a series of intermediate progress reports are produced over the course of a project. Often donors or organisations will have their own templates that are mandatory to use. In any case, such reports should contain:
During the project’s design phase, the risks and assumptions were identified and listed in the risk register. This risk register can be used during the execution of the project to reassess the situation and the risks periodically.
The risk register allows you to reassess whether:
It is possible that the project becomes less sensitive to certain risks over time, because the population becomes more resilient to those risks thanks to the achievements of the project. On the other hand, new and unexpected risks may materialise. This may even lead to a situation where it becomes practically impossible or too dangerous to continue the project. In such extreme cases, the information gathered using the risk register may help you support your decisions and convince your donor.
Like Project Cycle Management, RBM is based on the idea of the learning cycle. In fact, you could say that there are two learning cycles. The first one is a cycle that includes the activities, the monitoring and the evaluation. By tracking the performance of the project, you are able to learn what you need to modify the execution of your project in a flexible way. This learning ensures that you achieve your final objectives.
The second cycle gathers the experiences from one project and uses them for consecutive projects. The information gathered from (monitoring) reports and evaluations is used to modify the organisation’s strategy, to plan new projects and to improve the overall approaches of the organisation. This is where Results Based Management meets organisational learning.