Level-2 Evaluation Toolkit - List of Tools

Step 1: A planning matrix provides an overview of the resources and time required to conduct a Level-2 evaluation, as well as guidelines about what to set in place at the early stage of the course design.

Step 2: Guidelines on how to create a test specification matrix help to design a test well aligned with the course learning objectives. 

Step 3: (Optional) Reviewing past items may save test development time. A database of items is available to World Bank staff on the Test items and results database page located on the intranet. Find your way quickly in following the guidelines on how to check items used in past tests.

Step 4: Guidelines on how to write multiple-choice test items provide advice on the overall test construction, as well as how to phrase the stems and response options.

Step 5: The guidelines on how to pair test items provide examples and advice to make the pre- and post-tests equivalent in difficulty.

Step 6: Field testing your items before using them on actual participants helps improve the quality of the tests. Tips on how to pilot test items explain how to make this step feasible in the World Bank context.

Step 7: A checklist enables a systematic review of the items, for content experts, good writers, and for courses with a previous statistical item analysis.

Step 8: The guidelines on how to prepare test forms explain how to use:

Step 9: The guidelines on how to collect pre-test responses from participants at the beginning of the course help to get quality data. Read them before the course to be ready to implement tips for higher response rates.

Step 10: The guidelines on how to collect post-test responses at the end of the course help to get quality data. Read them before the course to be ready to implement tips for higher response rates.

Step 11: The guidelines on how to tabulate responses explain how to process the test responses using the Level-2 evaluation tabulation template that includes a macro which automatically computes the statistical item analysis based on the item analysis template. Then the definitions of statistical terms help to read the results.

Step 12: Send your test forms and results to WBIEG (for WBI only).

Step 13: The guidelines on how to interpret Level-2 evaluation results helps to read the results and to compare them with all other courses or only with courses that you choose to query.

Other Tools:   Glossary of Terms used in the Toolkit, Frequently Asked Questions that notably explain how to avoid major evaluation design faults, and Toolkit flyer.

Give us your feedback:   A very short survey to assess the Toolkit and help us to improve it.

Additional resources: Test development guidelines in Spanish, Directrices de Desarrollo de Examen en español (translated by the Inter-American Development Bank's "Programa Nacional INDES Guatelama").

Page last updated on August 25, 2005