Executive
Summary
End-of-Project Independent External Evaluation
“Ethiopian Management of Participatory
Opportunities for Women in Extension and Research
(EMPOWER) Program”
The EMPOWER project was
an agriculture technology transfer and gender mainstreaming project focused
on food security and enhanced gender relationships in the small-holder sector
of rural
The End-of-Project Independent External Evaluation was commissioned by USAID, Ethiopian Mission and conducted by DevTech Systems of Arlington, Virginia. A four member evaluation team was organized to conduct the external review using participatory and multidisciplinary inputs. Field work was concentrated in the month of December, 2003. The three most dominant methods used in the evaluation were:
Both quantitative and qualitative data were used in addressing the questions that guided the evaluation. The field work capitalized on verifying project claims and reports and in understanding project components and contributions. Project achievements were summarized from quantitative data reported in end-of-project reports and estimates of economic impact were derived from research and situation-specific examples and then generalized to the population as a whole. Following is a brief summary of the evaluation findings, conclusions and lessons learned articulated by the evaluation team.
The EMPOWER Project Model
The EMPOWER Project included the following components or strategies:
·
ONFARM technology testing, adaptation and dissemination to
enhance food production
·
Income generation through credit to diversify/increase agricultural
production
·
Training in various technologies and gender awareness to capacitate
the rural community and various extension workers/institutions
·
Scholarships to upgrade the credentials of women professionals
to serve decision-making and leadership roles in the agriculture and rural
sector.
·
Integration and institution building to sustain women’s voice
in development
A.1. ONFARM
The ONFARM technology transfer component used basic principles of agriculture extension applied to a specific set of communities. Worldwide, most extension programs are criticized for their ineffectiveness in moving research based innovations into the smallholder sector. But EMPOWER proved that small and often poor subsistence level farmers, even farmers of female headed households and those from very remote and isolated communities can fully participate in the processes of adoption and diffusion. WI empowered farmers to manage the innovation testing process and make their own decisions as to what was worth adopting using a farmer-led approach. This farmer centered approach created confidence and enthusiasm for the innovation-testing process that created curiosity and led to peer dissemination and natural diffusion. Diffusion rates of 3-5 times are recorded in the project documents and the personal testimonies of interviewees indicate even greater penetration into the non-partner population. Thus the project can be considered a good example of the technology transfer model of extension.
For those 3914 farmers (57% female) able to participate in demonstrations
(target or participating farmers/households) the results were significant
and impressive. Even if farm households only participated in one of the many
agricultural interventions introduced, they realized important productivity
gains (20-50%) that stretched their access to food for two or more months.
If combined with income generation activities, farm households could make
significant gains in both income and food security. Across the years these
gains could be expanded and solidified to improve their resilience and progress
toward their food security and quality of life goals.
These projected gains are especially noteworthy in face of the fact that project staff were extremely stretched. The scope of the geographic areas to be covered, the inaccessibility of communities and the scarcity of local resources provided almost impossible working conditions. Luckily the WI staff established rapport and good working relationships with their allied Office of Agriculture peers and created strong linkages with the academic and research community. These networks were important assets creating access to the farm community in a timely fashion and in backstopping the technology access and transfer process. Limitations of reliance on these systems included accepting the associated opinions of farmers about past interactions with “extension,” relying on the research community to recommend crop varieties and innovations that may or may not be appropriate to local needs, and investing in training and capacity building in systems with high turnover. In spite of these limitations, these relationships were important in the long run to stretch the capacity of WI staff to reach remote areas, to reinforce the importance of the work WI was undertaking and to institutionalize and sustain project impacts.
An overall weakness of the program as perceived by Regional Officials was its limited penetration capacity in terms of numbers of farmers directly involved. The WI hired Development Agents (DA) served as many farmers as the government DAs, and in the north served many more. And the WI program was more intense and required more contact and follow-up with farmers. But the resources of the project were extremely limited. On the supportive side, WI provided transportation for their DAs (motorcycles or mules) and had a strong backup system that provided financial and technical support and allowed a great deal of flexibility for agents to make decisions on their own. These conditions created an enhanced work environment that empowered staff and created internal rewards to sustain their heavy workloads. But the scope of the potential audience that needed their help was overwhelming, and the pressures from wereda officials to expand because they lacked resources themselves, was continuous. These were unfortunate pressures and realities that diminished the project in the eyes of some regional leaders.
A second weakness voiced about the project was its short-lived presence.
Even if the anticipated continuation of the project timeline had been received,
these were four-five year commitments. True development gains take longer
to stabilize and institutionalize. These ONFARM strategies could easily have
continued and expanded to additional communities and weredas and thus maximize
the lessons learned and high start-up costs. But the unexpected termination
decision removed WI staff before either farmers or OA personnel were ready
or prepared to takeover. In every community visited, farmers and officials
lamented the fact that a second wave of activities would not be available
to involve more farmers directly in the training and loan activities. Similar
concerns were voiced concerning the training and scholarship dimensions.
A.2. Income Generation
The Income Generation
(IG) component can generally be considered very successful. It created income-generating
opportunities for over 2,000 poor farmers, around 80% of whom were women.
It was successfully implemented in all four project areas and at least 10
different agriculturally related income generating activities were taken-up
by farmers, most of which exceeded their numerical targets in terms of the
number of participants. [2] The project was also able to make
credit available to women, in most cases for the first time. This was done
either by providing resources to existing service and production cooperatives,
which had previously catered almost exclusively to men, to allow women to
participate and to borrow; or by establishing new savings and credit cooperatives
exclusively for women. The creation of credit sources for women must be considered
a major achievement of the project, particularly given the difficult history
of cooperatives in
It is difficult to assess the economic impacts of the income generating component at this early stage as many families were still consuming most of their own produce (which, in itself is an important outcome). However, under favorable circumstances the IG activities were able to generate earnings equal to 50% to 100% of typical household earnings from traditional agricultural production. This was achieved by a combination of sale of crops or animals produced with the loan, own consumption of produce and use of earnings to accumulate assets increasing future earnings.
A number of challenges and issues were identified. Many of these were related to the unanticipated early termination of the project, which meant that many activities had not had time to become fully established. One of the potential weaknesses of the project was the lack of marketing support. This omission would be especially troublesome if the project attempted to scale-up participation. Also, despite the excellent progress made in providing credit, a potential weak link is the credit mechanisms. The project ending before all of the credit programs had been completely legalized and before there was time to work with the different organizations to complete the first and second cycle of loans to women and thus work out any operational problems.
On the positive side, the IG Component can be credited with significant social impacts:
· Provided women with credit, which permitted them to purchase the inputs to start their own business and gave them recognition of productive contributors to the household and community economy.
· Women were able to reinvest part of their earnings in productive assets so that they increased their control over resources and over their own lives.
· Women’s economic empowerment also gained them recognition as equal partners with men in farming activities and gained them the right to participate in community decision-making.
A.3. Introducing Appropriate
Domestic/Non-farm Technology
A total of seven new labor and fuel reduction technologies were introduced. The technologies most widely adopted by women were: “mirt” mud stoves (872 adoptions); fireless cookers (794 adoptions); and enset decorticators (670 adoptions). The technologies most widely adopted by both men and women were: iceless coolers (438 women and 240 men) and improved grain storage (354 women and 330 men). All of these technologies were widely accepted although there were a number of specific criticisms such as the fact that the mirt stove took up more room than the traditional stove and could be damaged if something dropped on it.
Winrock’s four-step introduction and dissemination methodology proved effective through:
The system worked well
and most volunteers were very enthusiastic disseminators. Some women noted
that 24 or 26 other women had built an improved stove with their help. The
enset decorticator saved so much time and human energy that it was quickly
adopted and used to transform the workweek for many women. The fact that
the technologies had impressive advantages such as fuel savings of three to
five times over open fires, and grain loss reductions of 40-60% for storage
devices, helped to create demand in these poor struggling households.
A.4. Short-term TrainingThe training component can be characterized as focusing on four types of training—
Across these types of training, nearly 1400 individuals were involved. [3] All of these various forms of short-term training have been amazingly well received and effective. As a result the dialog and skills developed through training, widespread support has been achieved for women’s involvement at the household, farm, and community level. One of the goals of EMPOWER was to change the institutions and environments that affect rural populations to create more supportive environments for men and women to together, address development challenges. By all intent and purpose a great deal of progress has been achieved in the project sites. However the needs for training are never ending. Even during the implementation period the training component seemed thin. Larger numbers of community agency representatives and emerging women leaders needed to be trained in order to be available to train and influence the very large populations that waited to be reached. Likewise ongoing training programs need to be institutionalized in communities to provide updating and higher order skill development to be able to respond to future needs. Great strides have been made, and the types of training have been judged very appropriate and relevant. The only criticism is that not more is being done.
The scholarship component
of the project enlarged the pool of professional women with upgraded academic
credentials and thus qualifications in the agriculture and rural sector by
92 individuals! This is a critical mass for any sector and is even more impressive
in that 90% of these individuals are currently concentrated in two regions
of the country.
This component of the EMPOWER project was a long-term capacity building and institutional change effort. Throughout the world a dearth of females are evident in the professional and leadership ranks of agricultural and rural development institutions. Some experts associate this lack of female voices in the planning and implementation of programs and policies as directly and adversely affecting the ability of these programs and policies to address the needs of women. EMPOWER hoped to change that relationship and bring more women into positions of influence so that their experiences, sensitivities and ability to relate to other women’s realities could be incorporated into the work of their institutions.
There is no doubt that access to upgraded credentials has had impressive consequences for the lives and futures of these women, and indirectly to their work and to the status of women in general.
Another aspect of the
scholarship component has already had impacts on the research and scholarship
available about rural issues. As part of the BSc degree, domestic students
were engaged in a research or extension project as part of their coursework.
Likewise, MSc and PhD candidates were required to conduct original research.
All of these scholarly assignments created an opportunity to expand the knowledge
of rural issues, especially issues affecting rural women. Topics of these
research projects included nutrition and child growth, domestic violence,
the biochemical characteristics of various food products and processes, crop
production enhancements, animal production, the process of introducing new
technologies, promotion of new food products, household technology adoption
and forestry introductions. Of particular note is the practicality of these
studies, providing relevant information for extension applications; and the
gender sensitivity of these topics, investigating problems of immediate concern
to women. These studies enlarged the knowledge base in
Finally, a sustainability
strategy was planned, to provide an ongoing networking and advocacy support
system for these and other professional women in the agriculture and rural
sector. That strategy involved the creation of a professional association—The
Association of Women in Agriculture and the Environment (AWLAE). A great
deal of effort has been expended to create the organization and secure legal
status for it as a domestic NGO, but it is not yet functional as a peer support
system. The untimely termination of the EMPOWER project places this organization
in jeopardy as it still relies heavily on the WI staff for leadership. Given
the high levels of commitment of its members, however, its prognosis is positive.
B. Assessing the EMPOWER Model
The External Evaluation Team was asked to try to identify what was unique about EMPOWER. Was it the types of technologies introduced or how they were introduced? Was it the working relationships established between project staff and participating families? Was it the differences in how WI functioned and how government extension functions? Was it the gender components? What made the program work?
Some of the unique and critical features of the approach as articulated by the evaluation team include:
· Women’s empowerment and gender mainstreaming. The project combines a focus on gender equity and women’s empowerment (through scholarships for women professionals, creating credit mechanisms accessible to women etc.); with a gender mainstreaming strategy focusing on both female and male farmers and adapting conventional economic and social roles to ensure both sexes can maximize their contribution to household welfare. The approach also promotes equal participation of both sexes in household, community and local government (wereda) decision-making.
·
Close cooperation with government at the wereda, zonal and regional
level to give ownership of the program and capacity to government agencies
who will be responsible for its continuation. This includes a commitment
from units in original agreements for cooperation and eventual take-over,
an official “phase-over document” designed by both farmers and officials delineating
take-over strategies, the extensive training and involvement of government
functionaries in project activities to ensure familiarization, and the step-by-step
turning over of project resources and responsibilities at the end of the project.
All of these efforts were designed to maximize the likelihood that government
agencies would be willing and able to continue the activities of the project
and use the methodologies for other efforts.
·
Adapting national technologies to the ecological, economic
and cultural conditions of the farms and households in each region, rather
than bringing-in foreign technology. The EMPOWER approach involves working
with farmers in a farmer-led process to adapt technologies developed by government
agencies and national research institutions so as to make them affordable
and to ensure their compatibility with local conditions. In the process this
establishes ownership and the capacity to innovate in the future.
An important feature of the EMPOWER model is the emphasis on the integration of the different components through:
· A systematic focus on women’s empowerment and gender mainstreaming in all of the project activities;
· Maximizing the role of women in agriculture by supporting agriculturally related income generation activities that reinforced women’s contributions to agriculture and household welfare;
· Combining the impact of ONFARM and income generation to illustrate a potential strategy to break the “cycle of low price seasonal sales” that is a serious bottleneck to poverty reduction in rural areas;
· Reinforcing the new capacities of recent academic graduates with leadership training to ensure risk-taking and proactive support for change;
· Having a sustainability strategy that combined self-sustaining elements with phase-over plans to transfer responsibilities to appropriate government agencies;
Are any one of the EMPOWER components more important than others? That would be hard to answer. Each has its individual merits and yet each contributed to the project goals as a whole.
C. Estimating Project Impacts on Food Security, Gender Relationships, and Institutional Capacity
C.1. Food Security
Best estimates would suggest that food availability gains of from 20%-50% were feasible. Translated into food security, these gains would provide two or more months of additional food availability (based on baseline estimates of 6 months). The partner families in the south reported similar estimates when quarried directly about increased food security. Ninety percent of families noted that they had food available for 9 months or more at the end of the project, when estimates at the beginning of the project were for 6 months. [4] No similar data were collected in the north where food security was more tenuous. The 20-50% gains are extrapolated from the following data:
· Improved varieties of basic food crops with 22%-125% yield advantages suggesting that farmers could produce at least 20%-50% more grain in any one season;
· Post-harvest storage techniques that extended storage times by 3 or more months provided reduced crop losses and the ability of farmers to sell gain at more advantageous times (see example in ONFARM chapter of earnings of 100 birr per family); and
· Income generation activities that increased incomes on the average of 150 birr per household; which, when compared to an average earnings of 730 birr per year, is a 21% increase in income.
Any one of these innovations would allow a family to increase food availability beyond the 20% targeted in original project documents.
C.2. Gender Relationships
No data are available to estimate how many families or communities experienced improved gender relations, but a number of qualitative indicators suggest substantial progress:
·
At all project sites, male farmers spoke enthusiastically
about what their wives had accomplished;
·
At all project sites, women were sitting along
side men and speaking freely in group meetings;
·
At all project sites, reports were told of
single women getting married partly because of the assets they were able to
bring to a union;
·
At all project sites, local community and
religious leaders praised the project for building gender awareness and changing
attitudes towards women;
·
In all communities involved in EMPOWER activities,
women are now available to participate in leadership and public affairs roles;
and
·
In all communities involved in EMPOWER, leaders
are speaking out against harmful traditional practices.
C.3. Institutional Capacity
Again, no data exists to document the change in institutional capacity
because of the EMPOWER project. However, the following indicators suggest
enormous impacts:
· A new department and BSc major in Rural Development and Family Sciences available to train development workers at Awassa College of Agriculture.
These indicators would suggest that the EMPOWER project made substantial inroads on the food security, gender relationship and the capacity building goals set before it.
D. Prognosis for Program Sustainability and Replication
Another goal of the external evaluation was to estimate the degree to which sustainability strategies incorporated into the project would ensure that the project continues, that impacts would be sustainable or that benefits would be expanded to others in the future. The prospects for the sustainability and replicability of the project can be summarized as follows:
E. A Summary of Lessons Learned
The EMPOWER project was a very complex and multifaceted program. The external evaluation team was admonished to try to identify lessons learned from the EMPOWER experience to help learn from their experience but also to assist in showcasing the program to other development agencies. Thus the following lessons learned have been articulated by the evaluation team. These are only tentative suggestions. The actual EMPOWER staff, who know the program more intimately, might have more detailed suggestions.
E.1. Lessons Learned from ONFARM
E.2. Lessons Learned from Income Generation
E.3. Lessons Learned from the Introduction of Appropriate Technologies
E.4. Lessons Learned about Training
E.6. Lessons Learned about Project Design
Generally speaking, the EMPOWER project has met the goals and most of the specific targets articulated in the project plan. There is no doubt that the program and the model has proven that significant increases in agricultural productivity can be achieved and that seemingly insurmountable obstacles to raising women’s status and participation can be overcome. Serious sustainability questions remain, primarily because of the termination of the project leaving many processes and activities unfinished or immature. And replication is also questionable, not because of the relevance and value of the program, but because of the political will of funding and operational units.
[1] Project Proposal, 1996.
[2] The following figures show actual number of participants as compared to original targets. Yem: poultry 103% and beehives 151%. Gimbo: poultry 123% and beehives 247%. Enebssie and Libokemkem combined: poultry 194%, beehives 92%, oxen 100%, sheep 117%, fishing 132% and irrigation pump 90%. Source: End of Project Report (draft) November 2003, Tables 10, 11 and 12. These are the only activities for which the achievement percentages are given.
[3] Source: End of Project Report, (draft) November 2003, page 77.
[4] Baseline data estimates seem to have been secured from PRA studies, not directly from partner families, although end-of-project data were collected from project families (Gimbo staff interpretations).