DM2009 - Assessment

Assessment 

The 100 finalist proposals were selected from 1,755 applications through a rigorous two-stage assessment process guided by the principles of fairness, transparency and consensus. Nearly 200 experts from the World Bank Group and a range of other organizations volunteered their time to serve as assessors, each reviewing 20 to 35 proposals.

Each proposal was evaluated by a minimum of three assessors from a diverse range of backgrounds. Assessors individually read an assigned batch of proposals and then, grouped in teams of three to five, narrowed down the number of proposals through discussion and consensus. At least one person in each assessment team participated from outside the World Bank Group to ensure a varied perspective.

Proposals were evaluated against the criteria of innovation, results, project design and organizational capacity, sustainability, and growth potential. Special emphasis was placed on innovation, as DM's foremost interest is to find new, creative and innovative approaches to development.

Follow the links to find out more about the selection process, selection criteria, and the assessors.

1. How were the finalists selected? 

2. What are the selection criteria? 

3. Who assessed the proposals? 

1. How were the finalists selected?
Once the call of proposals closed, the following process was used to select the winners:

a. All submitted proposals were screened by the DM Program and World Bank sector specialists to ensure eligibility.

b. Eligible proposals were assessed by experts in each sub-theme on how innovative the project idea is. The most innovative subset of proposals was then assessed by experts using all five assessment criteria. At least three sector specialists read each proposal. In aggregate, at least half of the assessors are experts from outside the World Bank.

c. The 100 top ranked proposals are invited to become finalists, subject to the condition that at least the 20 top ranked proposals from each of the three sub-themes are invited to become finalists. (This condition is in place to ensure all three sub-themes are adequately represented at the Marketplace).

d. The 100 finalists are invited to submit a more detailed full proposal in English and attend the Marketplace Event at World Bank Headquarters in November 2009 in Washington DC. There, an independent jury comprised of senior World Bank staff and leading individuals in development outside the World Bank (from academia, civil society, foundations, government, other donor institutions and the private sector) will select 20-25 winners based on the five selection criteria and a review by the World Bank to ensure consistency with applicable World Bank policies, procedures and practices and aligned with the World Bank's mission.

Click here to return to the top of the page.

2. What are the selection criteria?
Proposals will be assessed according to the following criteria:

1. Innovation
Innovation is a major differentiating element of DM competitions compared to other development grant programs. All proposals selected for funding should go beyond standard climate change adaption development projects. The proposal will be assessed according to how it differs from existing approaches. Note that transferring an approach to solve a common problem from one beneficiary group or from one geographic area to another is not considered innovative by the DM Program. Please see the Annex for details.

2. Objective & Measuring Results
The project should have clear and measurable results that will have a direct impact on improving individuals’ or communities’ ability to adapt to climate change. The expected results / outcome of the proposed project should be achievable within the timeframe of implementation of the DM funding. Assessors will also examine the quality of proposed indicators of the outcome/results you expect to achieve and review any other method(s) that you propose to use to measure project success.

3. Project Design & Organizational Capacity
The project should have a realistic plan with concrete steps/activities to achieve the project objective within the two-year or less span of implementation. The organization’s, and if applicable, its partner’s capacity to implement the project will be assessed.

4. Sustainability of Impact
Assessors will assess the characteristics of the project that, if successful, will help ensure that its results and development impact are sustainable after DM funding. Depending on the project design, the characteristics could involve financial and/or organizational sustainability.

For organizational sustainability, proposals should describe the factors related to your organization’s capacity and the capacity of your partner organization to sustain the results of the project.

For financial sustainability, the strategy to become self-perpetuating will differ depending on the type of project.

• For revenue-generating projects, a realistic timeframe and pathway to reach the point of revenue breakeven should be included. If possible, project the long term expenses and revenue/income stream (noting any market assumptions for sources such as user fees, sales revenues, community contributions, etc.). If breakeven is not expected by the end of DM support, the strategy for external donor or investor support between the end of the DM project and the breakeven point should be stated.
• For projects that are not generating any income or revenue, the proposal should provide a realistic strategy for sustaining the project’s results after completion of DM support from sources such as other donors, private foundations, and government agencies, etc.

5. Growth Potential
DM places a premium on projects that have the potential to have a large scale development impact. Assessors will explore possible constraints as well as the opportunities to scaling up / replicating.

Note:
Replicability is when a project can be adopted by other groups. For example, a new method for organizing work flow and quality control to increase production of bamboo-based home decorations tested by a DM project is then transferred / learned by a rural artisan cooperative of Vietnamese women, and as a result they increase production from 1,000 pieces to 10,000 pieces per month, enabling them to get a major EU retailer to become a customer of the cooperative.

Scalability is when a project can be expanded within a geographic area to benefit more people in the project area. For example, an innovative approach to use specific types of grasses to stabilize freshwater embankments that has been successfully tested on a few hectares of embankments is then rolled out on a massive scale along creeks in fragile, high rainfall areas on the Eastern slopes of the Andes Mountains.

Click here to return to the top of the page.

3. Who Assessed the Proposals

Assessor Profile

Assessors for the DM2009 came from a range of organizations. In addition to World Bank Group staff, assessors volunteered from 70 other organizations across the globe. Follow the link for a full list of organizations that contributed to the DM2009 Assessment.

Click here to return to the top of the page.