Although there is no methodological template for analyzing the poverty and social impacts of policy, it is possible to identify a number of elements that make for good-practice PSIA. This section outlines 10 key elements that those attempting to undertake or advise on PSIA will need to address:
While there is a logical sequence to these elements, this does not imply that they need to be undertaken in strict order or that all the steps will be feasible in every country. This section provides a broad overview of specific methods and tools that can be used to address each of these elements.
1. Asking the Right Questions The first stage of PSIA is to identify (1) the reform or set of reforms for analysis, and (2) the key questions to be addressed by the analysis. 1. The identification of the policy reform for analysis is a matter of judgment at the country level. It will likely depend on factors such as: - The expected size and direction of the poverty and social impacts,
- The prominence of the issue in the government's policy agenda,
- The timing and urgency of the underlying policy or reform, and
- The level of national debate surrounding the reform.
2. The formulation of the key questions for analysis requires an understanding of the underlying problems that the reform is intended to address, both in the short and the long term. The formulation can be done with a problem diagnosis, which organizes the chain of cause and effect from policy objectives to constraints, to choices, to impacts. It is also important to define a counterfactual, i.e. what the social and poverty impact of not having the reform would be. Back to Top 2. Identifying Stakeholders Stakeholder analysis identifies the people, groups and organizations that are important to consider when looking at the poverty and social impacts of reforms. It describes their characteristics and assesses their interests in relation to the reform. Identification of stakeholders is important because policy changes affect different groups differently and stakeholders can influence the adoption and implementation of various parts of a reform agenda. The analysis of poverty and social impacts should examine the following: - Stakeholders who may be affected by the reform, positively or negatively.
- Stakeholders who may affect the reform, by supporting or resisting it.
Back to Top 3. Understanding Transmission Channels After analyzing stakeholders, PSIA identifies the channels through which a particular policy change is expected to affect them. The expected impacts of a policy change on the welfare of different stakeholders will manifest themselves through various transmission channels. There are five main channels through which policies affect stakeholders: - Employment
- Prices - production, consumption, and wages
- Access to goods and services
- Assets - physical, natural, social, human, financial
- Transfers and taxes
The transmission channels will convey different impacts on stakeholders, depending on the reform in question. Impacts may differ along two key dimensions. First, impacts can be direct (when they result directly from changes in the policy levers altered by the reform) or indirect (when they result from the reform through other channels). Second, the nature of impacts may vary over time, and so will net impacts on various stakeholders. Back to Top 4. Assessing Institutions The channels through which policy reforms affect stakeholders run through institutions. Institutions are the formal and informal rules of the game that affect the behavior and incentives of stakeholders. Institutions determine the framework in which policy reforms may affect households and individuals, and are the main arenas in which stakeholders interact with one another. Changes in these institutions are themselves often the object of policy reforms. Also, many policy changes require particular organizations to play central roles in their implementation. In this regard, PSIA needs to consider: - How institutions and interests mediate the impact of policy reforms
- How the analysis of markets and organizational structures reveals the necessary conditions for the benefits of interventions to reach the poor
Back to Top 5. Gathering Data and Information Once the policy issues, stakeholders and likely transmission channels have been identified, the analyst should assess the available data to determine what type of analysis is feasible and plan future data collection. Four steps are suggested: - Mapping out desirable data and information for PSIA (includes both quantitative and qualitative)
- Taking stock of available information and prior analyses
- Adapting PSIA to data and information limitations ex ante (includes selecting a feasible analytical approach and collecting additional data)
- Planning to prevent limitations in the future (includes developing a strategy for data collection, monitoring and ex-post analysis that builds national capacity for PSIA)
Back to Top 6. Analyzing Impacts
The choice of approach and tools employed to analyze impacts will depend on the types and importance of the expected impacts (direct and indirect), and the availability of data, time and local capacity.
The methodology selected may include a combination of the following tools: - Social tools (social impact assessment, participatory poverty assessment, beneficiary assessment, and social capital assessment)
- Direct impact analysis tools (such as average and marginal incidence analysis, poverty mapping, and tools to assess public service delivery)
- Behavioral models (including supply and demand analysis, behavioral incidence analysis, and household models)
- Partial equilibrium analysis (such as multi-market models or reduced-form techniques)
- General equilibrium models (including social accounting matrices and computable general equilibrium models - CGEs)
- Tools linking microeconomic behavior or distribution with macroeconomic frameworks or models.
For comprehensive and effective impact analysis, the PSIA approach advocates the integrated use of both quantitative and qualitative tools and methods. Back to Top 7. Contemplating Enhancement and Compensation Measures If the ex-ante analysis reveals adverse effects on the living standards of the poor or other vulnerable groups, one could: - Consider alternative design: the design of the reform can be improved by including enhancement or mitigation measures, or a different sequencing of public actions
- Consider direct compensatory mechanisms: when adverse effects are unavoidable, one can consider compensatory measures on poverty, equity, or political economy grounds
- Consider delay or suspension of reforms: if the benefits of the reform are lower than the costs of mitigating or compensating the poor
Back to Top 8. Assessing Risks Risk assesment addresses the risk that some of the assumptions underlying the analysis may not be realized. This provides further insights into policy choice and design. In addition, when combined with careful monitoring, risk analysis can help anticipate and address major unintended consequences by adjusting the reform during implementation. There are four main types of risk in PSIA: - Institutional risks: risks that assumptions regarding institutional arrangements and/or organizational performance were incorrect (for instance, unexpected market failure, reform complexity exceeding institutional capacity, vested interests in the agency)
- Political economy risks: risks that groups may block implementation, capture benefits, or reverse reform actions
- Exogenous risks: risks of shocks such as conflict, financial crisis, terms of trade shocks, or natural disaster
- Other country risks: risks of political instability, conflict or social tensions undermining effective reform
Back to Top 9. Monitoring and Evaluating Impacts Monitoring and evaluation play an important role in the analysis of poverty and social impacts of reforms. During implementation, they are critical to validate ex-ante analysis and, where necessary, to influence the reformulation of policy reforms. By following impact indicators and the assumptions underlying the analysis, monitoring helps to signal unexpected developments. Monitoring and evaluation are also central in the promotion of accountability and ownership. In order to enhance their impact, monitoring and evaluation systems are best set up during the initial stages of reform. They should also be integrated with existing systems in order to strengthen national capacity. Back to Top 10. Fostering Policy Debate and Feeding Back into Policy Choice
PSIA is an integral element of the dialogue on the country's poverty reduction strategy. Fostering and drawing upon public discussion of policy can be useful at various points of the PSIA process. At an early stage, the debate can inform the choice of reform for which analysis should be undertaken. During the analysis, discussions can help analyze stakeholders, understand transmission channels, and validate technical impact analysis. Policy debate among stakeholders is also essential to develop consensus, build ownership and to create leverage of social accountability, since it enhances the understanding of the potential poverty and social impacts of the reform. Finally, it can also be useful for monitoring and evaluation purposes.
Ensuring that the lessons learned from the policy analysis, implementation and monitoring are fed back into the policy process is central to PSIA. The feedback of lessons is a critical step, and adequate institutional setup is required to "close the loop". |