Example of Tool 1 utilization

A tool-kit for the evaluation of sustainability processes and
sustainability levels of public health programs and projects

Example of TOOL 1 utilization.

This tool was used in different contexts, specifically in Canada and Haiti. The following is an example of its utilization in a health project in Haiti.

Centre for nutritional recuperation (Haiti)

« Terre des hommes » Foundation is a Swiss nongovernmental organization (NGO) that has been working in Haiti since 1989. This NGO is concerned with nutrition and providing direct aid to children. In 1997, the NGO implemented a unit to manage severe acute malnutrition in children. Five years later, after an evaluation conducted by the NGO and local health authorities, the Unit was altered to focus on issues of moderate malnutrition.

In 2003, the NGO was responsible for the Unit, and began to transfer this responsibility to the paediatrics service of the departmental hospital. To aid in this transition the NGO organized activities to increase the sustainability processes of the Unit in the hospital. At the end of 2004, the Unit was functioning within the hospital. Between 2005 and 2007, the NGO’s goal was to pass on sole responsibility of the Unit to the hospital. It is in this context that the NGO decided to perform an initial evaluation of the sustainability processes started in 2003. This evaluation was undertaken to promote necessary adjustment for the Unit’s sustainability.

Concerning the program/project Events (e.g. actions taken) Favourable Unfavourable
Specific sustainability events
Stabilization of organizational resources
  • The actual capabilities of the State and its failure to keep its promises during a project in 1999 are not taken into account.
  • Unlike what was planned, the NGO still pays the Unit salaries instead of giving the hospital a grant before official agents are nominated.

 

Organizational risk-taking
  • Two entities function separately in only one building.
  • Staff reduction in the Unit and asking parents to compensate.

Joint sustainability and implementation events
Incentives or benefits for people involved
Adaptation of the activities  Good reputation of the NGO concerning the quality of nutrition projects via past activities in this area of the country.
Objectives fit with those of the organization  Signing of a memorandum of understanding.
Transparent communication between people involved
  • Consultation for the writing of the protocol.
  • Setting up of a committee (board).
  • Lack of follow-up with the newly assigned Minister of Health.
  • Not enough meetings with all the hospital staff.

 

 

 

 

Sharing of culture and artefacts with the organization
Integration of rules into those of the organization  Hospital routines not taken into account (staff turnover).
Specific implementation events
Investment of adequate resources to complete the activities
  • Construction of a building; material supplies.
  • Training and practical training of nurses in two entities (NGO and hospital).
  • No practical training for hospital support staff.

 

 

 

Technical or practical compatibility of the activities with those of the organization  Addition of a joint building to the hospital with its staff.

 

With the information presented in the above synthesis-table, it was estimated that the sustainability process was moderate to low. In fact, more unfavourable events than favourable ones were mentioned during the evaluation process. The synthesis-table also shows that no “specific sustainability events” identified as favourable were mentioned.

It was also important to know the perspective of key people in relation to what immediate actions may be taken to promote the sustainability process of the Unit. The stabilization of resources and the operational imbrications of the Unit and the hospital were mentioned. The importance of collaboration between members of the Unit and the hospital was also stressed. This type of integration could be accomplished by sharing staff and material resources with greater transparency and confidence possible. Also, the NGO provided significantly more human and material resources to the Unit in comparison to the hospital. In order to make the Unit sustainable, the hospital needs to take more risks.

Example of Tool 2 utilization

A tool-kit for the evaluation of sustainability processes and
sustainability levels of public health programs and projects

Example of TOOL 2 utilization.

This tool was used in different contexts, specifically in Canada and Haiti. The following is an example of its utilization in a health project in Haiti.

Centre for nutritional recuperation (Haiti)

« Terre des hommes » Foundation is a Swiss nongovernmental organization (NGO) that has been working in Haiti since 1989. This NGO is concerned with nutrition and providing direct aid to children. In 1997, the NGO implemented a unit to manage severe acute malnutrition in children. Five years later, after an evaluation conducted by the NGO and local health authorities, the Unit was altered to focus on issues of moderate malnutrition.

In 2003, the NGO was responsible for the Unit, and began to transfer this responsibility to the paediatrics service of the departmental hospital. To aid in this transition the NGO organized activities to increase the sustainability processes of the Unit in the hospital. At the end of 2004, the Unit was functioning within the hospital. Between 2005 and 2007, the NGO’s goal was to pass on sole responsibility of the Unit to the hospital. It is in this context that the NGO decided to perform an initial evaluation of the sustainability level.

Tool 2. Sustainability level of the Nutritional care unit
Concerning the program/project Yes No Indicators (Justify your yes/no answers)
Memory (specific indicators)
Financial resources of the organization No resources supplied by the hospital; very low budgetary allocation from the State to the hospital.
Human resources of the organization No nomination by the State of civil servants required for the functioning.
FMaterial resources of the organization No resources supplied by the hospital.
Other resources of the organization No resources supplied by the hospital.
Adaptation (specific indicators)
Adaptation to the context The management of severely underfed children is the responsibility of a referred hospital.
Adaptation to the effects Tools are adapted to local capacities and to the context for follow-up and evaluation of the effects of the Unit.
Barriers to adaptation Relevance of the Unit’s activities was not challenged.
Values (specific indicators)
Coherence with the organization’s objectives Implicit sharing of objectives but absence of an established plan mentioning the Unit.
Symbols in the organization Presence of a symbol for the Unit but it was the NGO’s logo.
Rituals in the organization No formal meetings organized.
Specific language or jargon Existence of specific technical jargon but limited to a few people with a low degree of familiarity.
Rules (specific indicators)
Nomination of a supervisor from the organization No supervisor assigned to the coordination of all of hospital’s activities.
Inclusion in the organization’s planning No real inclusion in the planning, but in the memorandum of understanding.
Tasks description Very good task description for unit staff.
Written procedures Existence of a practical guide for nutrition monitoring and many therapeutic protocols.

With the collected information presented in the above synthesis-table, it was estimated that the sustainability level of the Unit in the hospital was low (see the five levels table at the How to use Tool 2 section). Official hospital activities are derived from the Unit, but they don’t posses all of the characteristics required to qualify as routinized. They are not routinized because they can drastically change on a short term basis. A large number of activities derived from the NGO’s program are still carried out by the Unit. However, they are far from integrated in the hospital’s functioning.

There were notable achievements in relation to some characteristics of sustainability: adaptation to context, nutrition management procedures, tasks description, follow-up system (monitoring). However, the low level of sustainability can partly be explained by the Unit’s implementation and partly by the lack of activities or events favourable to routinization (see the Example of Tool 1 utilization section). The implementation of the Unit was the responsibility of the NGO. Activities were carried out in the hospital’s facilities but were financed, staffed and supplied by the NGO. In order to insure a higher level of sustainability, the hospital needs to take more organizational risks.

Tool 2: Sustainability level

A tool-kit for the evaluation of sustainability processes and
sustainability levels of public health programs and projects

TOOL 2. Sustainability level

Step 1 (collection): Complete as many Tool 2 forms as necessary (e.g. one form per interview).
Step 2 (synthesis): Complete one Tool 2 form (synthesis-table) per organization or organization type).

See the How to use Tool 2 section.

Concerning the program/project Yes No Indicators (Justify your yes/no answers)
Memory (specific indicators)
Financial resources of the organization
Human resources of the organization
Material resources of the organization
Other resources of the organization
Adaptation (specific indicators)
Adaptation to the context
Adaptation to the effects
Barriers to adaptation
Values (specific indicators)
Coherence with the organization’s objectives
Symbols in the organization
Rituals in the organization
Specific language or jargon
Rules (specific indicators)
Nomination of a supervisor from the organization
Inclusion in the organization’s planning
Tasks description
Written procedures
Institutional standards (specific indicators)
Accordance with public policy

Printable version of Tool 2

Tool 1: Sustainability process

A tool-kit for the evaluation of sustainability processes and
sustainability levels of public health programs and projects

TOOL 1: Sustainability process

 

Step 1 (collection): Complete as many Tool 1 forms as necessary (e.g. one form per interview)Step 2 (synthesis): Complete one Tool 1 form (synthesis-table) per organization or organization type). See the How to use Tool 1 section.

 

Concerning the program/project Events (e.g. actions taken) Favourable Unfavourable
Specific sustainability events
Stabilization of organizational resources
Organizational risk-taking
Joint sustainability and implementation events
Incentives or benefits for people involved
Adaptation of the activities
Objectives fit with those of the organization
Transparent communication between people involved
Sharing of culture and artefacts with the organization
Integration of rules into those of the organization
Specific implementation events
Investment of adequate resources to complete the activities
Technical or practical compatibility of the activities with those of the organization

 

Printable version of Tool 1