Executive Summary
End-of-Project Independent External Evaluation
“Ethiopian Management of Participatory
Opportunities for Women in Extension and Research
(EMPOWER) Program”

The EMPOWER project was an agriculture technology transfer and gender mainstreaming project focused on food security and enhanced gender relationships in the small-holder sector of rural Ethiopia. The project had an overall goal to improve household level agricultural production and productivity in order to enhance food security, reduce vulnerabilities and improve income generation. It also hoped to create more enabling environments for women to fully participate in the processes of development. The cornerstone of the EMPOWER project was capacity building. The project was managed by Winrock International (WI) and funded by the United States Agency for International Development (USAID), Ethiopian Mission. It operated for five years, from 1998-2003, in four sites within two regions of the country—Southern Nations, Nationalities and Peoples Regional State (SNNPRS) and the Amhara National Regional State (ANRS).

The End-of-Project Independent External Evaluation was commissioned by USAID, Ethiopian Mission and conducted by DevTech Systems of Arlington, Virginia. A four member evaluation team was organized to conduct the external review using participatory and multidisciplinary inputs. Field work was concentrated in the month of December, 2003. The three most dominant methods used in the evaluation were:

Both quantitative and qualitative data were used in addressing the questions that guided the evaluation. The field work capitalized on verifying project claims and reports and in understanding project components and contributions. Project achievements were summarized from quantitative data reported in end-of-project reports and estimates of economic impact were derived from research and situation-specific examples and then generalized to the population as a whole. Following is a brief summary of the evaluation findings, conclusions and lessons learned articulated by the evaluation team.

The EMPOWER Project Model

Ethiopia has widespread food security problems.  The Food and Agricultural Organization (FAO) World Food Program estimates that over 40% of the country’s rural households do not produce enough food or income to meet basic nutritional needs (this figure is much higher in the areas served by the EMPOWER project). [1]   Degraded soils, rudimentary rural roads and infrastructure, insufficient access to land, widespread rural poverty and the lack of agricultural inputs, information and technologies creates vulnerabilities that over the years have been enhanced by war and droughts.  It is well accepted that rural women contribute more than 50% of the labor to operate and manage farm production, but their contributions go unacknowledged and their access to training, credit and productive assets lag behind that of men.  No rural development or agricultural enhancement program could succeed without the active participation of women—and yet few projects proactively work to remove the barriers that prevent women from contributing to development goals.  EMPOWER was conceived to do so! But EMPOWER was not a women’s program.  It carefully targeted both men and women and mainstreamed each gender as appropriate in various components of an integrated approach.  The EMPOWER Project can be characterized as supporting improved household production and food security while creating an enabling environment for both men and women to effectively work to insure and sustain future food security.

The EMPOWER Project included the following components or strategies:

·        ONFARM technology testing, adaptation and dissemination to enhance food production
·        Income generation through credit to diversify/increase agricultural production
·        Training in various technologies and gender awareness to capacitate the rural community and various extension workers/institutions
·        Scholarships to upgrade the credentials of women professionals to serve decision-making and leadership roles in the agriculture and rural sector.
·        Integration and institution building to sustain women’s voice in development

A.1. ONFARM

The ONFARM technology transfer component used basic principles of agriculture extension applied to a specific set of communities.  Worldwide, most extension programs are criticized for their ineffectiveness in moving research based innovations into the smallholder sector.  But EMPOWER proved that small and often poor subsistence level farmers, even farmers of female headed households and those from very remote and isolated communities can fully participate in the processes of adoption and diffusion.  WI empowered farmers to manage the innovation testing process and make their own decisions as to what was worth adopting using a farmer-led approach.  This farmer centered approach created confidence and enthusiasm for the innovation-testing process that created curiosity and led to peer dissemination and natural diffusion.  Diffusion rates of 3-5 times are recorded in the project documents and the personal testimonies of interviewees indicate even greater penetration into the non-partner population.  Thus the project can be considered a good example of the technology transfer model of extension.

For those 3914 farmers (57% female) able to participate in demonstrations (target or participating farmers/households) the results were significant and impressive.  Even if farm households only participated in one of the many agricultural interventions introduced, they realized important productivity gains (20-50%) that stretched their access to food for two or more months.  If combined with income generation activities, farm households could make significant gains in both income and food security.  Across the years these gains could be expanded and solidified to improve their resilience and progress toward their food security and quality of life goals.

These projected gains are especially noteworthy in face of the fact that project staff were extremely stretched.  The scope of the geographic areas to be covered, the inaccessibility of communities and the scarcity of local resources provided almost impossible working conditions.  Luckily the WI staff established rapport and good working relationships with their allied Office of Agriculture peers and created strong linkages with the academic and research community.  These networks were important assets creating access to the farm community in a timely fashion and in backstopping the technology access and transfer process.  Limitations of reliance on these systems included accepting the associated opinions of farmers about past interactions with “extension,” relying on the research community to recommend crop varieties and innovations that may or may not be appropriate to local needs, and investing in training and capacity building in systems with high turnover.  In spite of these limitations, these relationships were important in the long run to stretch the capacity of WI staff to reach remote areas, to reinforce the importance of the work WI was undertaking and to institutionalize and sustain project impacts.

An overall weakness of the program as perceived by Regional Officials was its limited penetration capacity in terms of numbers of farmers directly involved.  The WI hired Development Agents (DA) served as many farmers as the government DAs, and in the north served many more.  And the WI program was more intense and required more contact and follow-up with farmers.  But the resources of the project were extremely limited.  On the supportive side, WI provided transportation for their DAs (motorcycles or mules) and had a strong backup system that provided financial and technical support and allowed a great deal of flexibility for agents to make decisions on their own.  These conditions created an enhanced work environment that empowered staff and created internal rewards to sustain their heavy workloads.  But the scope of the potential audience that needed their help was overwhelming, and the pressures from wereda officials to expand because they lacked resources themselves, was continuous.  These were unfortunate pressures and realities that diminished the project in the eyes of some regional leaders. 

A second weakness voiced about the project was its short-lived presence.  Even if the anticipated continuation of the project timeline had been received, these were four-five year commitments.  True development gains take longer to stabilize and institutionalize.  These ONFARM strategies could easily have continued and expanded to additional communities and weredas and thus maximize the lessons learned and high start-up costs.  But the unexpected termination decision removed WI staff before either farmers or OA personnel were ready or prepared to takeover.  In every community visited, farmers and officials lamented the fact that a second wave of activities would not be available to involve more farmers directly in the training and loan activities.  Similar concerns were voiced concerning the training and scholarship dimensions. 

A.2. Income Generation

The Income Generation (IG) component can generally be considered very successful.  It created income-generating opportunities for over 2,000 poor farmers, around 80% of whom were women.  It was successfully implemented in all four project areas and at least 10 different agriculturally related income generating activities were taken-up by farmers, most of which exceeded their numerical targets in terms of the number of participants. [2]   The project was also able to make credit available to women, in most cases for the first time.  This was done either by providing resources to existing service and production cooperatives, which had previously catered almost exclusively to men, to allow women to participate and to borrow; or by establishing new savings and credit cooperatives exclusively for women.  The creation of credit sources for women must be considered a major achievement of the project, particularly given the difficult history of cooperatives in Ethiopia.

It is difficult to assess the economic impacts of the income generating component at this early stage as many families were still consuming most of their own produce (which, in itself is an important outcome).  However, under favorable circumstances the IG activities were able to generate earnings equal to 50% to 100% of typical household earnings from traditional agricultural production.  This was achieved by a combination of sale of crops or animals produced with the loan, own consumption of produce and use of earnings to accumulate assets increasing future earnings.

A number of challenges and issues were identified.  Many of these were related to the unanticipated early termination of the project, which meant that many activities had not had time to become fully established.  One of the potential weaknesses of the project was the lack of marketing support. This omission would be especially troublesome if the project attempted to scale-up participation.  Also, despite the excellent progress made in providing credit, a potential weak link is the credit mechanisms.  The project ending before all of the credit programs had been completely legalized and before there was time to work with the different organizations to complete the first and second cycle of loans to women and thus work out any operational problems.

On the positive side, the IG Component can be credited with significant social impacts: 

·        Provided women with credit, which permitted them to purchase the inputs to start their own business and gave them recognition of productive contributors to the household and community economy.

·        Women were able to reinvest part of their earnings in productive assets so that they increased their control over resources and over their own lives. 

·        Women’s economic empowerment also gained them recognition as equal partners with men in farming activities and gained them the right to participate in community decision-making.

A.3. Introducing Appropriate Domestic/Non-farm Technology

A total of seven new labor and fuel reduction technologies were introduced.  The technologies most widely adopted by women were: “mirt” mud stoves (872 adoptions); fireless cookers (794 adoptions); and enset decorticators (670 adoptions).  The technologies most widely adopted by both men and women were: iceless coolers (438 women and 240 men) and improved grain storage (354 women and 330 men).  All of these technologies were widely accepted although there were a number of specific criticisms such as the fact that the mirt stove took up more room than the traditional stove and could be damaged if something dropped on it.

Winrock’s four-step introduction and dissemination methodology proved effective through:

The system worked well and most volunteers were very enthusiastic disseminators.  Some women noted that 24 or 26 other women had built an improved stove with their help.  The enset decorticator saved so much time and human energy that it was quickly adopted and used to transform the workweek for many women.  The fact that the technologies had impressive advantages such as fuel savings of three to five times over open fires, and grain loss reductions of 40-60% for storage devices, helped to create demand in these poor struggling households.

A.4. Short-term Training

The training component can be characterized as focusing on four types of training—

Across these types of training, nearly 1400 individuals were involved. [3]   All of these various forms of short-term training have been amazingly well received and effective.  As a result the dialog and skills developed through training, widespread support has been achieved for women’s involvement at the household, farm, and community level.  One of the goals of EMPOWER was to change the institutions and environments that affect rural populations to create more supportive environments for men and women to together, address development challenges.  By all intent and purpose a great deal of progress has been achieved in the project sites.  However the needs for training are never ending.  Even during the implementation period the training component seemed thin.  Larger numbers of community agency representatives and emerging women leaders needed to be trained in order to be available to train and influence the very large populations that waited to be reached.  Likewise ongoing training programs need to be institutionalized in communities to provide updating and higher order skill development to be able to respond to future needs.  Great strides have been made, and the types of training have been judged very appropriate and relevant.  The only criticism is that not more is being done. 

A.5. Scholarships

The scholarship component of the project enlarged the pool of professional women with upgraded academic credentials and thus qualifications in the agriculture and rural sector by 92 individuals! This is a critical mass for any sector and is even more impressive in that 90% of these individuals are currently concentrated in two regions of the country.  Ethiopia’s professional ranks are slim and for so many females to be in critical decision-making positions in the Bureau of Agriculture and related agencies that affect rural populations is outstanding!

This component of the EMPOWER project was a long-term capacity building and institutional change effort.  Throughout the world a dearth of females are evident in the professional and leadership ranks of agricultural and rural development institutions.  Some experts associate this lack of female voices in the planning and implementation of programs and policies as directly and adversely affecting the ability of these programs and policies to address the needs of women.  EMPOWER hoped to change that relationship and bring more women into positions of influence so that their experiences, sensitivities and ability to relate to other women’s realities could be incorporated into the work of their institutions.

There is no doubt that access to upgraded credentials has had impressive consequences for the lives and futures of these women, and indirectly to their work and to the status of women in general.

Another aspect of the scholarship component has already had impacts on the research and scholarship available about rural issues.  As part of the BSc degree, domestic students were engaged in a research or extension project as part of their coursework.  Likewise, MSc and PhD candidates were required to conduct original research.  All of these scholarly assignments created an opportunity to expand the knowledge of rural issues, especially issues affecting rural women.  Topics of these research projects included nutrition and child growth, domestic violence, the biochemical characteristics of various food products and processes, crop production enhancements, animal production, the process of introducing new technologies, promotion of new food products, household technology adoption and forestry introductions.  Of particular note is the practicality of these studies, providing relevant information for extension applications; and the gender sensitivity of these topics, investigating problems of immediate concern to women.  These studies enlarged the knowledge base in Ethiopia about rural issues and contributed substantially to understanding smallholder adoption patterns.  A criticism of this research component is the limited availability of these papers/reports.  A more systematic collection, inventorying and dissemination of the papers are needed.  A secure library should be identified to house the collection and make the results accessible electronically, if possible.

Finally, a sustainability strategy was planned, to provide an ongoing networking and advocacy support system for these and other professional women in the agriculture and rural sector.  That strategy involved the creation of a professional association—The Association of Women in Agriculture and the Environment (AWLAE).  A great deal of effort has been expended to create the organization and secure legal status for it as a domestic NGO, but it is not yet functional as a peer support system.  The untimely termination of the EMPOWER project places this organization in jeopardy as it still relies heavily on the WI staff for leadership.  Given the high levels of commitment of its members, however, its prognosis is positive. 

B.     Assessing the EMPOWER Model

The External Evaluation Team was asked to try to identify what was unique about EMPOWER. Was it the types of technologies introduced or how they were introduced? Was it the working relationships established between project staff and participating families? Was it the differences in how WI functioned and how government extension functions? Was it the gender components? What made the program work?

Some of the unique and critical features of the approach as articulated by the evaluation team include:

·        Women’s empowerment and gender mainstreaming.  The project combines a focus on gender equity and women’s empowerment (through scholarships for women professionals, creating credit mechanisms accessible to women etc.); with a gender mainstreaming strategy focusing on both female and male farmers and adapting conventional economic and social roles to ensure both sexes can maximize their contribution to household welfare.  The approach also promotes equal participation of both sexes in household, community and local government (wereda) decision-making. 

·        Close cooperation with government at the wereda, zonal and regional level to give ownership of the program and capacity to government agencies who will be responsible for its continuation.  This includes a commitment from units in original agreements for cooperation and eventual take-over, an official “phase-over document” designed by both farmers and officials delineating take-over strategies, the extensive training and involvement of government functionaries in project activities to ensure familiarization, and the step-by-step turning over of project resources and responsibilities at the end of the project.  All of these efforts were designed to maximize the likelihood that government agencies would be willing and able to continue the activities of the project and use the methodologies for other efforts.

·        Adapting national technologies to the ecological, economic and cultural conditions of the farms and households in each region, rather than bringing-in foreign technology.  The EMPOWER approach involves working with farmers in a farmer-led process to adapt technologies developed by government agencies and national research institutions so as to make them affordable and to ensure their compatibility with local conditions. In the process this establishes ownership and the capacity to innovate in the future.

An important feature of the EMPOWER model is the emphasis on the integration of the different components through:

·        A systematic focus on women’s empowerment and gender mainstreaming in all of the project activities; 
·        Maximizing the role of women in agriculture by supporting agriculturally related income generation activities that reinforced women’s contributions to agriculture and household welfare;
·        Combining the impact of ONFARM and income generation to illustrate a potential strategy to break the “cycle of low price seasonal sales” that is a serious bottleneck to poverty reduction in rural areas;
·        Reinforcing the new capacities of recent academic graduates with leadership training to ensure risk-taking and proactive support for change;
·        Having a sustainability strategy that combined self-sustaining elements with phase-over plans to transfer responsibilities to appropriate government agencies;  

Are any one of the EMPOWER components more important than others?  That would be hard to answer.  Each has its individual merits and yet each contributed to the project goals as a whole.

C.     Estimating Project Impacts on Food Security, Gender Relationships, and Institutional Capacity

C.1. Food Security

Best estimates would suggest that food availability gains of from 20%-50% were feasible.  Translated into food security, these gains would provide two or more months of additional food availability (based on baseline estimates of 6 months).  The partner families in the south reported similar estimates when quarried directly about increased food security.  Ninety percent of families noted that they had food available for 9 months or more at the end of the project, when estimates at the beginning of the project were for 6 months. [4]   No similar data were collected in the north where food security was more tenuous.  The 20-50% gains are extrapolated from the following data: 

·        Improved varieties of basic food crops with 22%-125% yield advantages suggesting that farmers could produce at least 20%-50% more grain in any one season;

·        Post-harvest storage techniques that extended storage times by 3 or more months provided reduced crop losses and the ability of farmers to sell gain at more advantageous times (see example in ONFARM chapter of earnings of 100 birr per family); and

·        Income generation activities that increased incomes on the average of 150 birr per household; which, when compared to an average earnings of 730 birr per year, is a 21% increase in income.

Any one of these innovations would allow a family to increase food availability beyond the 20% targeted in original project documents. 

C.2. Gender Relationships

No data are available to estimate how many families or communities experienced improved gender relations, but a number of qualitative indicators suggest substantial progress:

·        At all project sites, male farmers spoke enthusiastically about what their wives had accomplished;
·        At all project sites, women were sitting along side men and speaking freely in group meetings;
·        At all project sites, reports were told of single women getting married partly because of the assets they were able to bring to a union;
·        At all project sites, local community and religious leaders praised the project for building gender awareness and changing attitudes towards women;
·        In all communities involved in EMPOWER activities, women are now available to participate in leadership and public affairs roles; and
·        In all communities involved in EMPOWER, leaders are speaking out against harmful traditional practices.

C.3. Institutional Capacity

Again, no data exists to document the change in institutional capacity because of the EMPOWER project.  However, the following indicators suggest enormous impacts:

9 new savings and credit associations/cooperatives established in the SNNRPS and 7 in ANRS;
290 professionals trained in participatory planning/programming from grass roots agencies;
149 development agents and supervisors from Offices of Agriculture trained in various agricultural techniques associated with ONFARM activities;
92 women professionals with upgraded credentials taking decision-making roles in agricultural and rural organizations, 90% concentrated in two regions of the country;
110 male and female professionals from two regions trained in leadership skills and willing and able to train others; and

·        A new department and BSc major in Rural Development and Family Sciences available to train development workers at Awassa College of Agriculture.

These indicators would suggest that the EMPOWER project made substantial inroads on the food security, gender relationship and the capacity building goals set before it.

D.  Prognosis for Program Sustainability and Replication

Another goal of the external evaluation was to estimate the degree to which sustainability strategies incorporated into the project would ensure that the project continues, that impacts would be sustainable or that benefits would be expanded to others in the future.  The prospects for the sustainability and replicability of the project can be summarized as follows:

E.  A Summary of Lessons Learned

The EMPOWER project was a very complex and multifaceted program.  The external evaluation team was admonished to try to identify lessons learned from the EMPOWER experience to help learn from their experience but also to assist in showcasing the program to other development agencies.  Thus the following lessons learned have been articulated by the evaluation team.  These are only tentative suggestions.  The actual EMPOWER staff, who know the program more intimately, might have more detailed suggestions. 

E.1. Lessons Learned from ONFARM

  1. Agricultural innovations of value to farmers are available from research centers within Ethiopia.  But they need to be tested and sometimes adapted to fit farmer-managed and local situations.
  2. Agricultural productivity gains are possible even among smallholder farming households, female-headed households and those in isolated and remote communities with limited access to information and services.
  3. Farmer participation in the demonstration/testing/adoption/diffusion process is invaluable.  It creates capacity for experimentation and learning, generates natural curiosity and dissemination potential and provides confidence and hope to farmers who have few support services.
  4. Significant female participation in agricultural innovation testing and adoption is feasible given a supportive environment for their involvement.
  5. More than one innovation is needed to generate food security.  The combination of access to improved seeds, production practices and post harvest storage techniques together create significant productivity gains that contribute to food security or increased income.
  6. The Income Generation component coupled with the ONFARM component in the same household holds great promise to overcome the cycle of low price seasonal sales.
  7. Investments in natural resource management techniques to reduce soil and water loss can generate enthusiasm and hope in a community that can complement agronomic innovations.

E.2. Lessons Learned from Income Generation

  1. Agricultural-focused income generation helped raise women’s esteem and recognition as being “farmers” and equal partners with men in farming activities.
  2. Women’s successful involvement in both economic activities and the testing and adoption of innovations helps to change perception among men and especially local leaders about the capabilities and decision-making potential of women.  This results in women being invited to community meetings, being asked to serve on local committees and being viewed as contributing members of society. 
  3. Access to credit is essential, but institutional credit is a weak link.  Investments in farmer operated savings and credit cooperatives can be an alternative.
  4. Women’s participation in credit cooperatives has important effects beyond the provision of credit.  It offers a way for women to participate, often for the first time, in formal organizations and group processes.  Also the presence of a collective body creates opportunities for women to exercise their voice in public affairs. 
  5. Enhanced economic status gains women greater equality within the household and community

E.3. Lessons Learned from the Introduction of Appropriate Technologies

  1. Farmers, male and female, are willing and able to adopt new technologies if affordable and useful to their daily routine. 
  2. Training is essential with all technology introductions.
  3. An informal dissemination process can work well to spread the adoption of appropriate technologies as initial adopters are usually enthusiastic and motivated to share their experiences, and neighbors are eager to learn.
  4. Development agents need to maintain close contact with adopters to provide on-the-ground support and feedback on problems or improvements. 
  5. Adoption and dissemination worked particularly well for technologies such as the enset decorticators which were used by women working in groups. 
  6. It is important to document the reactions of adopters to appropriate technologies so as to be able to share information about strengths and weaknesses and to judge the benefits generated.  Of particular importance is collecting estimates of reduction in women’s time and energy burden, as these are especially onerous constraints to women’s participation in development activities. 

E.4. Lessons Learned about Training 

  1. Training in leadership skills can help participants become more confident and willing to take risks. 
  2. Training in gender and cultural barriers can bring about relative attitudinal change in rural areas as manifested by support given to women by spouses and the progress being made to do away with harmful traditional practices. 
  3. Local officials and agency staff need training in tools and skills to be able to support women’s participation in development programs and community activities.
  4. Empowered women become role models and change agents in their communities.
  5. Gender awareness training needs to be provided intensely and repeatedly so that the gender agenda can remain in the forefront of community conversation.
  6. There is never enough gender awareness training, but training with skill building is essential to create action.

E.5. Lessons Learned from the Scholarship Component

25.  Existing academic programs designed for traditional students do not serve non-traditional students well.  Specially designed programs that focus on mature learners, concentrate coursework to reduce total time and provide support services better meet their needs.

  1. Scholarships targeted exclusively for any group will raise concerns, but the goals of the effort must be considered and weighed against other competing goals.
  2. Infusing a substantial number of newly upgraded mid-career professionals to any sector should have an immediate and lasting impact.  The strategy to quickly create a critical mass of trained and credentialed women professionals in the Bureau of Agriculture and Women’s Affairs Offices at the regional and federal levels in Ethiopia is producing substantial attitude change and recognition/respect for women and their potential.
  3. Selecting training sites in-country not only reduces costs, but may contribute to retention.
  4. On the other hand, international training creates opportunities for developing new networks, information streams and access to critical resources.
  5. Newly trained individuals need continuing contact with each other and with stimulating activities to maintain enthusiasm. 

E.6. Lessons Learned about Project Design

  1. The majority of rural populations have multifaceted problems brought about by chronic poverty.  Therefore, projects need to be integrated and multifaceted also, to bring about meaningful results.
  2. Projects to address women need to involve both men and women, to avoid restrictions/conflicts and to maximize benefits. 
  3. Monitoring data should include sufficient information to estimate effects of interventions, such as gains in productivity, income or time, even if only captured on a sampling of participants.
  4. The processes of phase-over and institutionalization need to start at the project design stage and fully involve those affected line agencies and organization from the beginning.  It is important for projects to incorporate self-sustaining features in the design of activities to the extent possible (e.g.  train-the-trainer, local capacity building, peer dissemination).
  5. All externally funded projects need a “champion” within government or community bureaucracies to assist during project implementation and to oversee post-project commitments for sustainability. 

F. Summary

Generally speaking, the EMPOWER project has met the goals and most of the specific targets articulated in the project plan.  There is no doubt that the program and the model has proven that significant increases in agricultural productivity can be achieved and that seemingly insurmountable obstacles to raising women’s status and participation can be overcome.  Serious sustainability questions remain, primarily because of the termination of the project leaving many processes and activities unfinished or immature.  And replication is also questionable, not because of the relevance and value of the program, but because of the political will of funding and operational units. 



[1] Project Proposal, 1996.

[2] The following figures show actual number of participants as compared to original targets.  Yem: poultry 103% and beehives 151%.  Gimbo: poultry 123% and beehives 247%.  Enebssie and Libokemkem combined: poultry 194%, beehives 92%, oxen 100%, sheep 117%, fishing 132% and irrigation pump 90%.  Source: End of Project Report (draft) November 2003, Tables 10, 11 and 12.  These are the only activities for which the achievement percentages are given.

[3] Source: End of Project Report, (draft) November 2003, page 77.

[4] Baseline data estimates seem to have been secured from PRA studies, not directly from partner families, although end-of-project data were collected from project families (Gimbo staff interpretations).