Observation as an Evaluation Technique

When is observation a particularly appropriate tool?

Usually observation is a qualitative research method, and therefore has the previously identified strengths and weaknesses. It can be used quantitatively- eg when counting the number of times a participants talks in a group; or the amount of time a caller has to wait in the reception area before seeing an advisor. It might involve being part of a group doing something and seeing what happens; or sitting in a Voluntary Organisation's waiting area.

Observation can be both a diagnostic tool- to help understand what is going well and what is going wrong- and an illuminative tool, when it is particularly useful in helping discover what individual organisations do and don't do, rather that what they say they are doing. It is particularly relevant in organisations where the work is based on relationships rather than definite services and is therefore difficult to specify. Observation can produce description at such a depth and detail that it allows the reader almost to enter the experience. Though we are dealing with short observations, they can produce material that is very rich and emphases meanings and experiences.

The principal difficulties in using observation in evaluation come in the very careful negotiations that need to take place beforehand about the role of the observer, and the large amount of data which it produces. As with all qualitative research methods, it is worth linking it with other methods, rather than using it on its own.

Different types of observation

There are different types of observation which focus both on:
how the observation is done:
ie open / unfocussed observation structured observation
and how the observer behaves:
being external to what is observed being a participant in what is observed

Your place on the participant observer continuum is likely to move and change all the time.

You also have choices about whether your observation is overt or covert- though you would be unwise for it to be covert and not negotiated. Having said that watching what is going on whilst visiting can be very useful, and does not need anyone's agreement.

How to undertake observation

It is just a more careful and recorded version of the skills we already have in the NGO sector.
  1. Obviously it is worth noting something about the:
    • Building/space/layout
    • Actors/roles - age, sex, ethnicity, appearance, groupings.....
    • Time
    • Activities
    • Objects, furniture
    • Actions - who makes decisions?
    • Events and their sequence
    • Time
    • Aims
    • Your feelings and reactions.

    Also drawing and photographing can be helpful.

  2. In relation to activities, the kind of questions I have found helpful are:
    • Who is present?
    • How is an activity introduced?
    • What are people trying to achieve?
    • What`s said?
    • How did participants respond?
    • What happens next? - especially unplanned action and informal interaction
    • What does not happen?
    • Who participates? And how? Who does not?
    • What are people doing? What are their bodies ‘saying‘?
    • What is the atmosphere?

    Your feelings/reactions as an observer are part of the data and need noting.


Back to top