Nexus Associates, Inc.
Economics and Management Consulting
Program Evaluation
We have considerable expertise in evaluating a broad range of programs.  Over the past few years alone, we have undertaken evaluations of programs designed to reform business regulations, streamline administrative procedures, improve access to capital, improve labor conditions, and address deficiencies in energy markets.  As a result of our experience, we have gained considerable insight into factors that contribute to the success of programs.

 

Nexus Associates is committed to providing sound, objective information that stakeholders can use to make decisions regarding needed changes in design, operations and resource allocation.  There are several elements of our approach that merit emphasis:

  • We view evaluation foremost as a management tool.  Managers in all organizations need good information in order to run their operations effectively on a day-to-day basis and make decisions with respect to future directions.  Properly executed, evaluations can enable managers to make more informed decisions based on sound empirical evidence, rather than opinions and simple anecdotes.  Evaluations can also be used by donors to ensure accountability and make better decisions with respect to future funding.  Given these purposes, in undertaking evaluation, we pay particular attention to the nature of the decisions that managers and funding agencies might contemplate and the information that they would find useful to their deliberations.  Moreover, we believe it is imperative that program managers and other stakeholders be involved in the evaluation process both to ensure that needed information is collected and assure that recommendations that emerge from the analysis will be implemented.
  • We base evaluations on explicit program theories.  Evaluations should be based on models of how programs are supposed to work – what they are expected to do and what they are expected to accomplish.  Every program is based on assumptions regarding the structure, functions, procedures and processes that are necessary to achieve its goals.  The assumptions underlie the theory of the program in that they define the sequence of cause-and-effect relationships linking activities to desired outcomes.  We work with stakeholders to articulate program theories using formal program logic models.  Such models subsequently serve as the basis for defining process and outcome measures.
  • We address multiple dimensions of performance.  There are multiple dimensions of performance that are of interest to managers, donors and stakeholders.  Relevance refers to the extent to which programs are germane to identified needs and consistent with the mandate of the organization.  Effectiveness deals with the extent to which programs yield intended outcomes and have a positive impact with respect to economic and social objectives.  Operating efficiency considers resource expenditures in comparison to the outputs generated as a result of these expenditures.  Finally, sustainability considers the ability to continue to provide needed services on an ongoing basis.  We work with stakeholders to understand different dimensions of performance and reach agreement on the aspects that should be reflected in the evaluation.
  • We develop and use appropriate measures of performance.  Measurable indicators need to be developed to gauge performance.  To be useful, performance measures need to be valid, reliable and practical.  Valid measures provide an accurate reflection of the underlying concept that is supposed to be measured.   Reliable measures are those that can be consistently applied without substantial measurement error.  Measures also have to be practical in terms of implementation – data necessary to calculate measures must be available given budgetary, time and other constraints.  We have substantial expertise in a wide range of statistical and econometric techniques, as well as substantial experience designing and implementing surveys. 

 

Recent projects


Evaluation of International Finance Corporation Private Enterprise Partnerships

The International Finance Corporation (IFC) has established a number of donor-funded organizations around the world to promote private sector development. These organizations typically undertake projects in five program areas: access to finance, business enabling environment (investment climate), corporate advice, public-private partnerships, and environmental and social sustainability. Over the past six years, Nexus Associates has undertaken independent evaluations of eight of these organizations, including the Africa Project Development Facility (APDF), Mekong Project Development Facility (MPDF), Private Enterprise Partnership for the Middle East & North Africa (PEP-MENA), Private Enterprise Partnership for the Pacific (PEP-Pacific), Private Enterprise Partnership for the Philippines (PEP-Philippines), Program for Eastern Indonesia Small & Medium Enterprise Assistance (PENSA), SouthAsia Enterprise Development Facility (SEDF), and Southeast Europe Enterprise Development (SEED). Based on a combination of qualitative and quantitative research, each of the evaluations examined the relevance, efficiency, and effectiveness of programs undertaken by the organizations.

Evaluation of the Business Registration Simplification Project in Central America
 
The State Secretariat for Economic Affairs (SECO) agreed in December 2002 to provide roughly US$748,000 to FUNDES International (FUNDES) to support work to simplify business registration and licensing procedures in Bolivia, Costa Rica, and El Salvador.  In May 2005, SECO approved an additional US$2.36 million for a second phase of the project, focusing on Costa Rica, El Salvador, and Guatemala.  SECO retained Nexus Associates to conduct an end-of-phase evaluation of the second phase of the project.  The purpose of the evaluation is two-fold: i) provide an objective assessment of the approach used by FUNDES in Phase II to simplify procedures; and ii) draw lessons that might be applied to future projects to help ensure their success in terms of impact and sustainability.  The evaluation addresses issues related to relevance, effectiveness and sustainability, efficiency, and organizational performance.  It is based on a review of documents; interviews with managers and staff; interviews with government officials and representatives of private sector associations in Costa Rica, El Salvador, and Guatemala; and analysis of monitoring data.

 
Mid-Term Review of International Finance Corporation Sustainability Business Innovator

In June 2006, the IFC Board of Directors approved the creation of the Sustainability Business Innovator (SBI) Facility to develop and test new approaches to achieving environmental and social aims, and to encourage the private sector in emerging markets to adopt approaches that have proven successful.   One month later, the SBI Division was established within the Environment and Social Development Department (CES).  The SBI Division has undertaken projects in six practice areas – biodiversity, cleaner technology, social responsibility, sustainable energy, sustainable investing, and women in business – with funding from the SBI Facility and other sources.  IFC retained Nexus Associates to conduct an independent review of the performance of SBI since its inception.  In keeping with the terms of reference (TOR), the mid-term review addresses issues related to the relevance, effectiveness, sustainability, efficiency, and organizational performance of SBI.  The review is based on interviews with IFC managers and staff; analysis of budget and expenditure data; analysis of SBI project portfolio and review of M&E data; desk reviews of selected projects; survey of task team leaders (TTLs) outside of SBI; and survey of donors.

 

Review of the Investment Climate Facility for Africa

Publicly launched in June 2006, the objective of the Investment Climate Facility for Africa (ICF) is to remove barriers to private investment in Africa.  ICF retained Nexus Associates to conduct an independent review of ICF, covering the period from its inception through 30 September 2009.  The review addresses issues related to relevance, effectiveness (impact), efficiency, and organizational performance.  It includes a review of the organization’s operational performance as well as an independent assessment of selected projects, focusing on project design, project implementation, and resulting outcomes.  The ten project reviews reflect all areas in which ICF has been involved and include both Francophone and Anglophone countries.  All told, the projects account for roughly 87 percent of total expenditures through 30 September 2009.  The evaluation draws on a review of ICF documentation; interviews with members of the Board of Trustees (BOT) and ICF staff as well as representatives of donors and corporate contributors, beneficiaries and other stakeholders; and secondary research. 

Evaluation of the Foreign Investment Advisory Service 

Established in 1987, FIAS operates as a donor-funded “joint service” of the International Finance Corporation (IFC) and the International Bank for Reconstruction and Development (IBRD).  The organization focuses on helping governments promote greater foreign and domestic investment.  FIAS retained Nexus Associates to conduct an independent evaluation of the organization, covering the period from 1 July 2004 to 31 December 2006. The evaluation addresses issues related to compliance, relevance, effectiveness, sustainability, efficiency, and governance and management.  In so doing, the report provides information that can be used to refine the organization’s strategy and strengthen operations. The evaluation is based on a combination of quantitative and qualitative research. This included a detailed analysis of project and financial data, a survey of senior government officials, a survey of World Bank and IFC country managers/directors, the preparation of three country case studies – China, Mexico and Sierra Leone – and desk reviews of eight projects – including the Investment Law and Municipal Simplification in Indonesia.

Mid-Term Review of Invest in the Western Balkans Program

The Invest in the Western Balkans (IWB) Program was established by MIGA in late 2003 with support from the Austrian Ministry of Finance and commenced operations in early 2004. The program’s objective is to assist the countries of the Western Balkans region (Albania, Bosnia and Herzegovina, Croatia, FYR Macedonia, and Serbia and Montenegro) to attract greater foreign direct investment (FDI). Responsibility for administration of the program was transferred to FIAS in 2007.  Nexus Associates conducted a formative evaluation of IWB. The evaluation was intended to provide a strong foundation for shaping IWB strategies and activities going forward.  As such, it focuses on identifying key lessons from past experience that can be applied to enhance the relevance, effectiveness, efficiency, and sustainability of the program.  The evaluation is based on a review of program documents, a survey of potential investors, interviews with companies that have invested in the Western Balkans, interviews with investment promotion agencies in the region, and extensive discussions with IWB and FIAS staff.

Development of evaluation frameworks for International Finance Corporation Advisory Services 

The SME Department of the International Finance Corporation (IFC) asked Nexus Associates to develop core performance indicators for different types of programs, including programs aimed at providing greater access to financing, improving the legal and regulatory environment, and boosting the productivity of small enterprises. A series of output and outcome indicators were defined for each program based on detailed program logic models. In a subsequent assignment, Nexus Associates was asked to develop an approach to assess the potential benefits and cost of various programs as part of the project approval process. After defining a comprehensive accounting framework for each type of program, Nexus Associates prepared a manual and developed Excel spreadsheets that could be used by program staff to conduct necessary analyses.

Evaluation of the Massachusetts Renewable Energy Trust 
 
RET has undertaken a variety of initiatives across the Commonwealth that are intended either directly or indirectly to alter the attitudes and behavior of individuals with respect to clean energy.  This includes clean energy choice, green buildings and schools, and community wind as well as general public awareness campaigns.  Nexus Associates designed a household survey to assess the extent to which individuals in different communities are knowledgeable of specific facts concerning clean energy, hold specific opinions concerning clean energy, and have undertaken specific actions with respect to clean energy.  The survey was administered by telephone to a stratified random sample of 1,000 households in selected communities based on factors (stratifiers) that may affect attitudes and behavior of individuals including community demographics and exposure to different RET interventions. 

 

Evaluation of the industry technical institutes in Thailand 

With support provided by the World Bank, the Thai Government retained Nexus Associates to evaluate the performance of the National Food Institute, Thai-German Institute, and the Thai Productivity Institute.  The evaluation resulted in a series of recommendations concerning the overall direction and ongoing management of these three institutes. It is also intended that the process of evaluating these three institutes will serve to build the capacity of a counterpart team to evaluate the performance of other institutes in the future.  The assignment included the development of a set of performance indicators, design and implementation of a comprehensive data collection strategy, detailed statistical analyses of operating and survey data, preparation of case studies, and a qualitative assessment of operating processes and procedures.

 

Evaluation of skills training institutes 

The Economic Planning Unit (EPU) asked Nexus Associates to evaluate three selected institutes: German-Malaysian Institute (GMI), MARA Skill Training Institute (IKM TYSA), and the Selangor Human Resource Development Centre (SHRDC). In addition to assessing the performance of these institutions, the purpose of the assignment is to develop a methodology that might be replicated in future studies and help build the capacity of local organizations to carry out similar evaluations.  The evaluation is based on qualitative and quantitative research, involving a review of program documentation provided by the training institutions, an analysis of operating and financial data, meetings with senior management, focus groups with faculty and students, surveys of recent graduates and their current employers, and a series of in-depth interviews with selected employers.  Multivariate regression techniques were used to estimate the returns to skills training.

 

Assessment of Connecticut Department of Economic and Community Development

The purpose of this project was to conduct an assessment of CONNSTEP and identify additional forms of assistance that should be provided to enhance the competitiveness of manufacturers in Connecticut in light of increased globalization and other significant trends.  Nexus Associates conducted a statistical analysis of factors influencing firm performance based on results of a survey of 576 manufacturers in the US, Canada and Mexico conducted by MMTC Performance Benchmarking Service.

 

The Role of the Multilateral Investment Guarantee Agency's Investment Marketing Services in Strengthening PROESA and the Subsequent Impact on Foreign Direct Investment in El Salvador

Nexus Associates prepared a case study report on the role that the Multilateral Investment Guarantee Agency (MIGA) has played in strengthening PROESA – an investment promotion agency in El Salvador – and its subsequent impact on foreign direct investment (FDI) in the country.  The final report draws on the results of a client survey designed by Nexus Associates.  The in-person survey was administered to the principal contact of PROESA clients that have invested in El Salvador and are still in business.   Respondents were asked questions concerning their business operations in El Salvador, the type and level of foreign direct investments in this company, the reasons why foreign investors chose El Salvador, interactions with PROESA, experience with other investment service providers, and the overall impact and quality of PROESA’s services.  Of the 62 surveyable firms, 34 completed the survey representing an effective response rate of 55%.

 

Assessing the impact of SME programs on the poor

Donor agencies have undertaken a broad range of initiatives to promote the development of small enterprises in developing countries.  These programs have been designed to help companies gain access to financing and business development services as well as to strengthen the overall business enabling environment. In so doing, the overall goal of these programs is to reduce poverty.  The Committee of Donor Agencies for Small Enterprise Development (Donor Committee) asked Nexus Associates to prepare a paper on assessing the impact of SME programs on the poor.  The paper provides a conceptual framework for measuring the poverty impacts of small enterprise programs, particularly those that focus on business development services (BDS).  It describes various evaluation methods that could be used to determine the extent to which particular programs reduced poverty within a target population.  Given the interest in assessing the impact of programs on the poor, the methods described in the paper focuses on estimating the effectives of programs in boosting household income in a target population above a specified poverty line.

 

Strengthening the investment climate in India
 
The Operations Evaluation Department (OED) of the World Bank conducted a thematic evaluation of the institution's activities in support of improved investment climates in client countries. As part of this effort, Nexus Associates was asked to prepare a case study on the Bank’s activities over the past decade to help strengthen the investment climate in India, focusing on lending and non-lending operations in two states – Andhra Pradesh and Karnataka. The case study draws on numerous sources of information, including project documents, published reports, internal memoranda, and the general literature as well as interviews with Bank staff, government officials, and representatives of industry, academia and other non-governmental organizations.

 

Evaluation of the economic impact of Connecticut Innovations’ equity investments 

Nexus Associates was hired to conduct an independent evaluation of the equity financing programs of Connecticut Innovations, Inc. (CI).  The study aimed to determine the extent to which CI investments have yielded positive economic returns in terms of employment, income, and tax revenues in Connecticut.  The study draws on a survey of portfolio companies that was designed, administered and analyzed by Nexus Associates.  The evaluation team surveyed all 55 companies that received equity or equity-like financing from CI between FY95 and FY02.  A total of 48 companies completed the survey, representing an effective response rate of approximately 87%. 

 

Impact assessment of Pennsylvania's Ben Franklin Partnership

Created to promote technological innovation in order to spur economic growth and prosperity in the region, the Ben Franklin Partnership retained Nexus Associates to conduct an independent, objective evaluation of the economic impact of the program and the degree to which it was fulfilling its stated mission.  The first impact analysis was conducted in 1999 and a follow-up study covering the program from 1989 to 2001 was conducted in 2003.  In the follow-up study, direct program impacts were estimating using a quasi-experimental research design that compared 818 Ben Franklin clients to a statistically similar, individually matched, control group of 2782 non-client manufacturers.  Differences between the two groups (client impacts) were then used to model the program's overall economic impact on the state's employment, gross state product (GSP) and tax revenues.  Data for the comparison group were drawn from the ES202 database, a collection of employment and wage data from employers participating in government unemployment insurance (UI) programs.  The assessment also included eight (in 1999) and four (in 2003) in-depth case studies outlining the specific role of the BFP program in the success of participating companies and regional initiatives.

 

Evaluation of the Africa Management Services Company in Sub-Saharan Africa

AMSCO is a donor-funded business development organization in Africa that places experienced managers in small and medium size enterprises in Africa, as well as providing training and other services.  Headquartered in Amsterdam, it has regional offices in Harare, Abidjan, Nairobi, Port Louis, Lagos, Pretoria and Accra and employs 54 people.  It was established in 1989 as a joint initiative of the United Nations Development Programme (UNDP), the African Development Bank (ADB) and the International Finance Corporation (IFC).  Nexus Associates was hired as part of a team by the International Finance Corporation (IFC) to conduct a comprehensive evaluation of AMSCO’s activities and impact covering the period between 1995 and 2001.  Nexus’ role in the project included assistance with research design and survey development as well as all statistical and econometric analysis.

 

Development of planning and evaluation system for SME programs in Mexico
 
In a project funded by the World Bank, Nexus Associates, Inc. developed plans for the establishment of a planning unit within the Mexican Government to focus on issues related to small and medium-sized enterprises. Based on an intensive review of existing planning processes, recommendations centered on establishing systems to monitor SME performance, undertake research on the SME needs, review programs to ensure alignment with policy objectives, and support the preparation of the National Development Plan and annual budgets. In a second project, Nexus Associates designed an evaluation system for SME programs. The evaluation system is intended to help program administrators, senior government officials, and other stakeholders determine the extent to which Mexico’s assistance organizations are meeting their stated missions of improving the performance of SMEs in Mexico.  The system includes standards for program evaluation, performance indicators, data collection strategies and suggested analytical techniques.

Development of monitoring and evaluation system for cluster programs in Latin America
 
The Inter-American Development Bank (IDB) has established a number of projects throughout Latin America and the Caribbean to help improve the competitiveness of small businesses through collective action.  Funded through the Multilateral Investment Fund (MIF), these projects are intended to boost the productivity and sales of participating companies, leading to economic development in the respective regions.  IDB asked Nexus Associates to develop a common M&E system that could be used by the Executing Agencies that are undertaking cluster programs.  Nexus Associates will define performance indicators and establish data collection procedures (including company surveys) that will be used by all Executing Agencies that are responsible for implementing the cluster programs in their respective countries.  The firm will also develop an internet-based application for entering, storing and retrieving data on particular projects.

Evaluation of the Center for Economic and Technological Development in Mexico

The rural region of Nueva Vizcaya in Mexico suffered a major economic crisis with the collapse of metal prices in international markets in 1991. In response, a series of initiatives were launched to revitalize the economy including the creation of CIDEyT, a business development center, to provide consulting and technical assistance services to existing businesses and promote new business developments. Based on the initial success of these regional efforts the Inter-American Development Bank (IDB) agreed to provide approximately $1.3 million over three years beginning in 1998 to support the ongoing efforts of CIDEyT. Nexus Associates was been retained by IDB to conduct an evaluation of CIDEyT’s operations, measure its impact on the regional economy, and assess the reliability of the program in similar communities in other developing countries.  The evaluation involved case studies, participant assessments, and quasi-experimental analyses based on client surveys and data obtained from the national statistical agency (INEGI).

 

Evaluation of the Center for Productivity in Chile

CEPRI is a non-profit organization established in 1994 to improve the competitiveness of SMEs in Chile.  With support provided by the Inter-American Development Bank (IDB), CEPRI hired Nexus Associates to undertake an independent evaluation of the organization, focusing on the period from 1999 to 2001. The evaluation included interviews with CEPRI staff, a review of program documents and administrative records, detailed statistical analyses of operating and survey data, as well as case studies of exemplary projects undertaken by CEPRI.

Evaluation of the Enterprise Development Center in Argentina

The Inter-American Development Bank (IDB) asked Nexus Associates to assess the performance of the EDC Rafaela Esperanza and to develop an evaluation methodology that could be replicated within similar programs in Latin America.  The project included a survey of all program participants to date, analysis of the centers’ operational and financial data, as well as in-depth case studies of several companies that received services.

Assessment of the Industrial Integration Program in Mexico  

Considering financing the second phase of the Industrial Integration Program (IIP), the Inter-American Development Bank (IDB) asked Nexus Associates to assess the institutional capacity of the Fundación para la Transferencia Tecnológica a las Pequeñas y Medianas Empresas (FUNTEC) to manage the expanded program.  The assessment included a review of the organization’s operations and an assessment of the factors that limited the ability of FUNTEC to execute the new program. The report contained detailed recommendations regarding staff development, budgeting, administrative controls, and monitoring and evaluation.

Back

Home  
About Us 
Expertise and Services 
   
> SME Development  
   >
Science & Technology  
   >
Investment Climate  
   >
Renewable Energy    
Join Us 
Contact Us

Web Hosting Companies