Tuesday, October 15, 2013

Country Ownership and its measurement - Part 2

We social scientists would do well to hold back our eagerness to control that world which we so imperfectly understand. The fact of our imperfect understanding should not be allowed to feed our anxiety and so increase the need to control. (Bateson, 1972 cited by Morin).
A- Where we left off
In Part 1, I set the stage for the great interest we currently have in country ownership: a combination of missed opportunities of the past, renewed intentions (global public private partnerships, Paris declaration, Abuja, PEPFAR, PMI, and the GHI for us in the U.S.), and the unattractiveness of being caught admitting to the neo-colonial violation of the principle of country ownership.

I hinted in Part 1, that Country Ownership may have become a "sacred cow" in some global organizations, whereby we don't know why the cow is in the middle of the road, we're not sure what to do with it, we're not entirely certain that it's really sacred (I mean, we have deadlines), and even though we might end up just driving around it and moving on as planned, we want to be sure to pay due respect. Finally, I referenced a currently widespread framework at least in discussions, if not in use, which is the one developed by PEPFAR through McKinsey & Company. (The 2010 GAO Report to Congress provides a measure of how seriously the concept of Country Ownership pervaded USG thinking at all levels in preparation for PEPFAR II.) This framework gives us a starting place, with four dimensions and multiple sub-dimensions of  country ownership:
1- Political will and ownership. [UNAIDS correspondingly identifies robust national strategic plans with smart investment decisions, strong political engagement and inclusive leadership, and given the HIV/AIDS focus, integration of HIV into broader health and development strategies.]
2- Institutional ownership (an earlier version included community ownership as well). [UNAIDS identifies here full engagement of civil society, communities and people living with HIV.]
3-Capacity [UNAIDS refers to: capacity development, high-quality strategic information, and effective coordination.]
4-Mutual accountability [UNAIDS considers strong partnerships with a shared responsibility and mutual accountability.]
B- On to measurement
So now we get to the sticky wicket of 'how do we measure these things?' Based on more than a few years and few projects' worth of experience with this, I'd like to point out some decision points you will have to face if you're serious about this. Let's deal with why, what, how and who of ownership measurement. In the process, we're going to discover that measuring ownership forces us to deal with Edgar Morin's paradigm of complexity. At the risk of distortion, I will borrow a summary of this paradigm as the recognition that "knowledge is a dynamic, unfinished process, and develops by way of self-criticism." When we deal with complex realities and processes, the "objective" perspective in observation and measurement might not be tenable, and ignoring this can lead us to misconstrue reality. The other part of the equation is the inherently incomplete nature of our knowledge about ownership. I don't think that a list of four dimensions of analysis, or eight items, or even 75 variables, is going to provide us with an absolute and comprehensive understanding of anyone's "ownership." This must be part of the "known unknowns" (hum... sorry about that reference).

Why do we want to measure ownership? An old mantra of scientific management is "if you can't measure it, you can't manage it." Since we want to build country ownership, see it thrive, and since ownership is part of our sustainability plan, how can we not want to measure it then? The GAO report congratulated PEPFAR for at least trying to have a baseline. Can't measure it, can't manage it. Makes plenty of sense.

However, it is already questionable whether anyone can actually build someone else's capacity. I mean, we have a pretty good sense that capacity building is an endogenous process, which makes use of opportunities provided through peers in a network, access to expertise, to knowledge, and more importantly applied knowledge in a supportive social system (which may be a project, a team, an office, a health center...). But still, the trainer, the coach, the consultant, the technical adviser might feel with some legitimacy that they built someone's capacity. Arguably.

But ownership? Can I build your ownership? Sure I can help you institutionalize procedures, if you want... I can help translate standing capacity into more supportive routines to support a goal, and you will internalize this, if you care to... I can help you build information systems which feed into accountability processes, which will sustain the pursuit of a shared goal, if you intend to give life to the processes... We see that, even more than capacity, ownership develops endogenously, internally within people and the social system in which they operate and construct their own role.

We consequently need to modify the mantra:
"You can't manage it if you don't measure it. But should you be managing it?"

Asking why we measure ownership sends us back to the dialectic nature of development assistance, or development cooperation:
  • Most likely there are things we can and should measure in how the recipient of assistance is institutionalizing some processes, policies, and building capacity, but...
  • One of the main reasons for measuring ownership should be about what the provider of assistance does. What are our ways of interacting with a national system in all its diversity? How are intentions versus old and bad habits turned into actual behaviors in development practice? How are our actions construed by the recipients of our support, in an emic way, i.e. based on their perspective? 
Did I mention power and money? Or would we rather not go there. And in this case, are we just trying to get around the sacred cow?
If ownership grows or withers from the net result of an interaction, a dialogue, a transfer of resources, an exchange in capabilities, the negotiation of roles in decision-making, then what is the point of ownership measurement if it exclusively focuses on the recipient? If I am the provider of assistance, or the donor, or the policy adviser, does it make sense for me to try and measure the recipient's ownership without questioning my role in this process?

Along these lines, if we measure ownership because we care about it and want to see it grow, and  if the nature of the recipient's ownership is a shifting, and fluid, complex reality, can we assess and measure ownership independently of a process which builds ownership? We're going to get into more of that when we get to the how, but let's consider a counter-example: when I carry out a survey to measure immunization coverage, I do not change the immunization status of children in a population. Can the same be said about ownership? Most often, no. The measurement of ownership is part and parcel of a larger package of intervention and interaction, through which roles and meaning are created by donors, implementers, assistance providers, and recipient. If my assessment process is going to affect ownership anyway, do I want an objective measure (the feasibility of which might be in doubt already) even if it decreases ownership in some way, or do I want a measure, which accepts a more subjective and humble process, but may potentially improve ownership? This has to be part of the continuation of this discussion.

We'll see in dealing with the what, that there might be sub-points of ownership, which can try and avoid this problem, but it will always be there when we deal with the core of the ownership question. There are also differences between assessing ownership as a research endeavor versus a monitoring and evaluation one, but our premise here is management-oriented and the need for monitoring and evaluation.


I promised to keep these blogs at less than 900 words, however, so the what we measure and the how we measure it will have to wait for next week.

The take home message for today is that if we want to measure ownership, we should be clear about why we want to do so. And if we address why, we are brought to consider that we are not the objective external observer ready for an assessment, we are part of a relational and developmental dialectic. At the end of the day, either we accept to be part of the question ourselves, or we are probably asking a pointless question. 

To be continued... Feel free to disagree, agree, comment and enrich by leaving a comment.

Thanks and Cheers,



Eric

PS: We should not be surprised by the tension in objectivity-subjectivity introduced by the paradigm of complexity. Consider something much simpler and more objectively measurable than ownership. Consider billiard balls on a pool table. Our models can almost perfectly predict what a ball will do when hit by another ball at a given speed and angle. It gets however harder when you deal with a number of balls (as complexity increases). To correctly compute the 9th impact you need to take into account the gravitational pull of someone standing next to the table. And to compute the 56th impact every single elementary particle of the universe need to be present in your assumption. (Reference: Taleb in Black Swan, Grey Swan, Sustainability.) Now think about this: there are more than 56 people involved in creating country ownership; and each one tends to be just a little trickier to manage than a billiard ball...

---- Thanks to Reeti Desai for editorial assistance, respectful of my ownership. :) ----

No comments:

Post a Comment