Acumen Blog

measuring

No, its Not Too Much Trouble to Measure Impact

Sasha Dichter is Acumen’s Chief Innovation Officer and writes regularly about impact and philanthropy. Below he discusses why Acumen believes deeply in dedicating resources to measuring impact.

As impact investing goes more mainstream, there is a growing chorus suggesting that impact measurement might be the providence of academics and idealists.

(as in, “…we have spent too much time and too many resources discussing impact measurement and trying to measure outcomes. Is an individual who needs eyeglasses better off if she has access to them? If you are wearing a pair while reading this article, you know the answer. There are myriad basic products and services such as eyeglasses to which the majority of the world’s population does not have access and which, if they did, would allow them to live significantly improved lives. So let’s move on and not overburden those initiatives focused on underserved communities with academic questions. They already face plenty of challenges trying to deliver what they promise.”)

Now, the argument goes, the real investors have arrived, so we can do away with all of that impact measurement mumbo-jumbo.  If companies succeed and grow, if capital is getting deployed and returned, and if more capital is coming in, then we know that we are succeeding.  The rest is just noise.

That argument would make sense if impact measurement is undertaken as an academic, ex post process  in which those on the periphery of the system peer into its beating heart, extract data, and attempt to define whether or not those at the center are creating sufficient impact.   Who are they to judge?

Indeed, let’s avoid a scenario like that at all costs.  In fact let’s avoid any measurement system in which the main goal is to produce data that isn’t, at its core, useful to operating companies in their interactions with end customers.

However, let us also avoid quick, easy caricatures about what measurement is and could be.

To walk through an example, let’s begin with the assertion that any company that qualifies as an impact investment is creating some sort of direct benefit for end customers or other key stakeholders (e.g. creating jobs).

So, we might ask, who wants to know if this hypothetical company is creating impact?

Sure, a wonky social scientist would love to know.  She’d hope to understand if someone who buys a solar light or who hooks up to a mini-grid stops spending money on dirty, dangerous, expensive kerosene.  If she doesn’t, then there’s less impact than one would hope.

The good news is that while the academic would love to have answers to these questions, we wouldn’t and shouldn’t answer these questions primarily for her.  Because the same questions she has are core questions driving the success of the business.  Any company that has an iota of sales and marketing DNA will need to understand answers to a basic set of questions:

  • Are customers buying solar lights as a replacement to kerosene or as a supplement?
  • How much less do customers spend on kerosene as a result of having a new source of light?
  • Are lights are used primarily late at night in homes, for kids to study, or out in the fields?
  • And on and on….

Similarly, a company selling drip irrigation kits has no choice but to find out whether end customers achieve the 2 to 3x yields that the company gets on demonstration plots.  A company selling drinking water needs to understand if customers are contaminating the water before they consume it (which means that a marketing message around better health ultimately won’t deliver).  And of course a company offering vocational training and job placement will definitely need to know how many graduates they place, how graduates’ incomes compare with the money they made before the program, and which training programs have the highest yield on job placement rates and salaries.

All of which is to say that understanding impact is a key driver of business success for any company selling a new product or service to an underserved market.  And the companies that are first to realize this will be best positioned to meet the needs of their customers and deliver products that create the most value.

Put another way, understanding impact starts with questions like:

  • Who are we serving?
  • Why are these customers buying this product? (what problem does it solve for them)
  • How are they using the product?
  • How does this product compare with what they did before?
  • What benefits do they hope to realize when using this product?
  • Are they realizing those benefits?
  • Why or why not?
  • Etc.

If we recognize that conversations about impact start and end with the end customer, we will sort out the way forward.  Whereas we will continue to stumble out of the gate if they we miscast these efforts as pitting investors’ priorities against those of companies.  Companies will increasingly need this data, and, recognizing that this data must and will be collected, we as a sector will miss an opportunity if we don’t agree at the outset to use a common set of standards – so that as the data is collected, it can be aggregated in ways that allow for easy comparison.

The idea that we have the option to opt out of understanding impact is akin to arguing that we can build large-scale, successful new enterprises without understanding our end customers in any real way.   It’s absurd.  Our opportunity is to understand, in a much deeper way, the intersection of a company, its products, and a customers’ well-being.  The better the customers are served, the better the company will do, and the flywheel will start turning.  If we lack data on impact, we’ll never start walking that path.

Comments

Imagining the world as it could be

Christine Gitau is an East Africa Fellow and an enterprise coach at Craft Afrika, which provides business support services to craft entrepreneurs, enabling them build viable and thriving businesses in Kenya. At Acumen we often use the term “Moral Imagination” when talking about leadership. Christine wrote a reflection on how this concept has shifted her thinking. We could not be more proud of what she is building! [Read More]

How two Acumen Fellows are disrupting the education model in India

Whether its running youth soccer programs, providing vocational training services, or transforming the education system in India, Acumen India Fellows are driving real change in their communities.  Abbas Dadla and Abhilasha Sinha are India Fellows who are addressing the teacher shortage in India through the use of technology and peer collaboration. Find out what they are building below.  If you have grit, resilience and a commitment to creating change in your community in India, East Africa or Pakistan, we encourage you to apply for the Regional Fellowship Program! [Read More]

Meet Manjushree Patil, Founder of Aatman Academy

This month saw violent tragedies in Pakistan and Kenya, regions where Acumen works and which five classes of Acumen regional fellows call home. Among them there are dedicated teachers like Acumen India Fellow Manjushree Patil, crusaders against sex trafficking, builders of government, creators of liberating mobile medical technologies, and curators of slum sports programs. The need for strengthening the connections between those who are working for positive change against seemingly impossible odds has never been greater. We at Acumen have never been prouder to be the thread tying together these courageous individuals. Read more about Manjushree and how she is changing her community in India below! [Read More]

No, not silence again!

The Acumen Fellowship’s Cambridge Leadership Associates (CLA) training is notorious for digging deep, breaking Fellows down to reveal their deepest fears, identifying the sources of resilience that will fuel them with the tenacity to continue along the path to social change. Kahabi G. Isangula is an East Africa Regional Fellow living in Tanzania and recently participated in our CLA training. Get an idea of what it is like, below!  [Read More]

Announcing the Class of 2015 Acumen Global Fellows

Acumen Global Fellows are architects for the impact sector. They are innovators, game changers, visionaries, with various professional experiences looking to make substantial change in the world. They have thrived in companies such as Google; they have started their own companies in Sri Lanka, Canada and Malaysia.  They are choosing the challenge of working alongside our portfolio companies and immersing themselves in a rigorous leadership training. [Read More]

Welcoming Ajit Mahadevan as Acumen India Country Director

We are pleased to announce that Ajit Mahadevan will be joining Acumen as India Country Director. Ajit joins Acumen from Ernst & Young, where he has served as Advisory Partner & Leader (Life Sciences) for the past six years.  At EY, he was a strategic advisor to the leadership of some of the leading Indian and global life science and healthcare players with the focus being business transformation and growth.  Prior to his time at E&Y, Ajit was President of Piramal Healthcare, one of the leading pharmaceuticals companies in India, where he built the international business from inception in 2002 to $300M by the end of 2008. Ajit held multiple leadership roles across strategy, M&A and business leadership. During his tenure at Accenture’s Strategic Services practice in UK and India, he led the development of one of the firm’s largest and most successful internal projects – the Offshore Development Centre in 2001, which has now grown to about 100,000 people across multiple cities in India. Ajit has worked in an advisory capacity to Acumen in the past, most recently participating in Regional Fellows selection panels in Mumbai. [Read More]

Why We All Need A ‘Rikki’

Caren Wakoli is an emerging leader in East Africa who has launched a foundation to support the next generation of female leaders for Africa. Caren applied twice for the fellowship and was not accepted, but she did not give up. Her resilience and grit allowed her to persevere, and this year we are proud to have her as an East Africa Fellow. Below she shares her story on why everyone needs a ‘Rikki,’ and failure is never final.  [Read More]

Acumen Joins Beyond the Grid as Founding Partner

Acumen is proud to be a founding partner of Beyond the Grid, an innovative framework under President Obama’s Power Africa initiative to increase energy access for underserved populations across sub-Saharan Africa. Beyond the Grid will leverage partnerships with investors and practitioners committing to invest over $1 billion into off-grid and small scale solutions for this underserved market. [Read More]

Life after Lean

In May 2013, Sabrina Natasha Premji & Afzal Habib participated in +Acumen’s inaugural Lean for Social Change course based on Lean Start-Up principles. Enrollment for the next session of the Lean for Social Change course is open now. If you are working on a social issue in your community, are interested in pursuing your own social venture, or are just interested in creating an impact in this world…Register today! Sabrina & Afzal joined the course with a simple idea and the passion to transform the childcare crisis in East Africa’s informal settlements. Seven weeks later, they had developed a customer-tested business model ready to pilot in Kenya’s densest slums. Read their story below. [Read More]