Factors relevant to World Bank project outcomes

Project level

Design
(QAE, other design rating)

Implementation (QOS)

Country level

Socioeconomic Conditions

Governance (CPIA, WGI)

Time

Cost

human resources {should clarify that this means Bank human resources

TTL quality / leadership {as measured or signaled by what?}

Team capacity {as measured or signaled by what?}

Initial budget size

Change in budget size (+/-) {this is not so much the budget but the cost, or the difference between the original cost estimate and the actual cost in terms of Bank funds expended} {did any of the sources look at Trust Funds? if not, we should note this absence}
{seems like we need to add an element here of final project cost?}

Project duration {as defined by what dates?}

Cost-benefit analysis {does this refer to whether or not a cost-benefit analysis was undertaken at all, or whether the project was found to exceed threshold level of benefit-cost ratio? although not sure it would be possible to define such a threshold}

M&E capacity / quality {why is this a different color?}

Environment & natural resources {This is an important category but this name sounds too much like the old sector board. Think of a different wording for the name.} {What's the rationale for placing this under Socioeconomic conditions? How about renaming the main branch to something like "Socioeconomic and Natural Environment" ? {Also, is this strictly a country-level characteristic? Are the examples under this across countries or only in one country? Should it be separate from either country-level or project-level?} {Is this informed by the work with Stephen, i.e. to define the sample for the Environment part?}

Human development {add examples of how this would be measured; we should consider having a version of the tree that has the sub-items, at least such that they could be clicked and looked up}

Effectiveness of governing institutions

Transparency, accountability, control of
corruption & citizen engagement {make citizen engagement separate}

Political economy {right now I would have a hard time drawing the line between our Governance category above and this one. how did you draw the line? how would we explain it to others?}

Public administration capacity {are there other sub-branches we plan to add here? if not, seems like it suggests that effectiveness of governing institutions is synonymous with public administration capacity}

Fragile & conflict affected situations

Government commitment & engagement

Quality of policy instruments

Project extension {explain better, what is the distinction between project extension and delay?}

Delay

Results framework quality

Relevance {of what to what?}

Other project characteristics

Selectivity / realistic objectives {I don't think the "selectivity" sounds like the right word here, if what we are talking about is realism -- talk to me more about where this comes from?}

Coordination & collaboration {these are both rather amorphous and different from each other -- why combine them? how is "collaboration" defined? measured or signaled?}

Flexibility {this seems like a broad word -- how measured? can we be more specific? flexibility about what? on whose part?}

Risk management

Collaboration with client government

Collaboration with other donors

Collaboration within World Bank

Collaboration with local stakeholders {other than client government, other than donors?}

Aid dependence & conditionality {can you talk with me about what these mean?}

Economic conditions {add examples of how this would be measured, e.g. are you thinking of GDP per capita? others?} :

Rule of law (e.g., property rights) {wouldn't property rights be a subset of rule of law?}

Economic management {does this mean macroeconomic management? if so, change the title to that} {a likely question we would have to field is, have any of these sources devised a way to measure the quality of (macro)economic management? If not, should the main branch be just "policy instruments" rather than "quality of policy instruments}

Regulatory environment {similar question here, about the word "quality"}

Programmatic / stand-alone nature of interventions {did you discuss making this part of design? why place this here under "other" rather than as part of design?}

Sector / GP / region / multi-sectoral-specific factors {why not code the AFR one here?}

Preparation time / cost

Incorporation of lessons learned & analytical work

Provision of capacity training {the phrase "capacity training" sounds odd -- what do we mean exactly? perhaps "training in public administration capacity"? "capacity development for improved public administration"?}

Supervision time / cost