Amy Klement
Partner
&
Jessica Kiessel
Director, Learning & Impact

Learning by Listening to Those We Serve: Why We Invest in Measuring Social Impact

May 2, 2019

Jessica and I are both parents of young children, and as we go into each day, we do our best to listen to our kids to help guide them to learn and grow. What they are thinking, how they are feeling, and how we interpret that communication back to us goes into how we might modify our behaviors in our role as parents. 

How is this related to our day jobs, you may ask? Deeply listening to others — from our children, to our colleagues, to our investments, to those “customers” our portfolio serves — is something that we believe is a critical skill today, and one we wish was more widely practiced in our field. Listening to our customers and working in collaboration with them to improve and find solutions is something our Education team at Omidyar Network truly values.

Move Fast but Measure Impact

With a “100-year gap” for poor children to catch up to the educational levels of today’s wealthy children (Brookings Institute), Omidyar Network’s Education team approaches our work with a sense of urgency and willingness to take more bold bets when it comes to investing in emerging education innovations. Why? Because taking a chance that a solution might leapfrog current approaches means more students are closer to reaching their potential. However, this also means first and foremost, we want to be able to ensure those innovations are leading to more quality learning.

But how can we get more regular signals that can help us understand if our bets are succeeding — or even failing — to learn if we are on the right track? How can we surface common challenges and promising solutions to learn from and share with others? Like many other impact investors and philanthropic funders, we have limited data at the portfolio-level that can be used to meaningfully track progress toward impact and inform future work. However, we are exploring methods to support our portfolio, gain a deeper understanding for ourselves, and share with our collaborators and the broader field.

Thus, it seemed obvious that beneficiary survey data could provide a terrific opportunity to glean insights into the relative performance of our portfolio. It always starts with listening to the customer. But how could we hear from thousands of customers in 14 countries across four continents in a way that was customized, meaningful, and would give useful results? For this work, we enlisted the help of Acumen’s Lean Data team. Lean Data is an approach that helps social enterprises quickly and easily hear from customers about their behavior, feedback, and social performance.

Our Lean Data Education Sprint

We have a diverse portfolio, even at a sector-level, which makes it challenging to present one survey that would be useful to all. Our Education portfolio includes more than 90 nonprofit and for-profit organizations across the globe who provide a wide set of services to a wide range of ages. We needed to ensure participation in this survey would be seen as beneficial to our investees, and the data collected as useful for their own internal purposes.

As an entrepreneur-first funder, we are very careful not to enforce our standard measures on our portfolio. We were thrilled when 71 percent of our eligible portfolio opted to participate. 

Between July and October 2018, Lean Data conducted projects with 24 Education investees across 14 countries in 11 languages. These surveys, a mix of voice and email, were customized depending on business model (skilling, school, product) and audience (students, teachers, parents), and through them we heard from more than 4,800 students, parents, teachers, and administrators. Our collective teams were all excited to jump into this work to gather rich, comparable social impact data on our Education portfolio for the first time.  

We also measured customer loyalty using NPS scores. Omidyar Network’s Education investees averaged 54, which is above average and considered excellent.

The resulting report provided us with a valuable source of information and we have summarized some of these highlights to share with others outside our portfolio. For example, we gained insight into key value drivers for sub-segments of our portfolio. As expected, we found that freemium products are more inclusive than premium products. That said, we were surprised to learn that freemium products were perceived as having only slightly lower reported value than their paid counterparts. We also generated new insights by combining our own internal data with survey data. For example, the value constituents placed on services validated the high, medium, and low depth definitions that we had used for our retrospective impact analysis of our first 10 years.

Each participating investee received detailed decks, providing customer feedback on where they are strong and where they could improve. This has provided us with an opportunity to engage meaningfully with our investees and support their journey for ever more impact. And what was nice to hear back was that our investees shared this offered them a way to improve engagement and communication with their own staff, donors, and beneficiaries.

Jessica Sager, Chief Executive Officer at All Our Kin, shared how she used the report as a conversation tool:

“We’re using the report as a launching pad for conversations about ways to further strengthen and deepen our work. We shared the report with staff at an organization-wide meeting and broke out into small groups to discuss ways to build on our successes and address the identified challenges. Now, we’re sharing the results with family child care providers, through a series of focus groups, digging in on all the ways in which they’d like to see our programs evolve to meet their needs. Finally, the Lean Data results have been a powerful tool for communicating with funders, many of whom haven’t heard of Net Promoter Scores before. It’s a great way for us to put relationships front and center in our conversations with them.”

Other investees used the data to validate their business plans. Caroline Hu Flexer, CEO and Co-Founder of DuckDuckMoose and Khan Academy Kids, shared:

“It was really helpful to gain direct feedback from customers on how they perceive the app. We learned that parents really value how Khan Academy Kids is both fun and educational. We saw that the most common request was for more challenging content for older children. While this was already on our roadmap, these insights encouraged us to prioritize expanding our content to older ages and levels.”

This first portfolio-level Education survey is just a starting point. We will continue to explore methods to meaningfully assess progress toward our impact objectives so as to support our portfolio, gain a deeper understanding for ourselves, and share with our collaborators and the broader field. We plan to refine these measures and how this information is used over time. We are hungry for these learnings and believe this will help us become increasingly confident in our results. It will also ensure we always stay focused, listening to our investees and to the people we are working to serve, and acting based on insights grounded in data and their voices.

We hope you will find highlights from our learnings from this report helpful and welcome ideas for further improvement. Most importantly, thank you for listening!

BACK TO BLOG
Discussion
blede blede Чистка фильтров скважин Санкт-Петербург at google

Созданная нами предприятие ГК ЛДВЬУ Сосновый Бор выполняет современным способом телеинспекциюинженерных систем, сетей хоз. бытовых, сетей хозяйственно-бытовой, водостоков, канализации, водопроводов и т. д. Видео/телеинспекция любых труб производится спец камерой, которая двигается по трубам и подает вид на монитор и в одно и то же время выполняется видеозвукозапись изображения. Подобная видиодиагностика может дать возможность определить эксплуатационное качество стенок и стыков труб, места нахождения изъянов, свищей и иных дефектов, обнаружить засоры и посторонние предметы, несанкционированные врезки и т.д. Видеоинспекция также имеет возможность быть применена и в случае приёма труб после завершения строительства, ремонтных работ. Самым большим преимуществом системы телеинспекции несомненно является её мобильность, простота доступа к трубам, а кроме того возможность получать видеоизображение увидеть изнутри часть труб за счет видео изображения. Эта организация ОАО АУОАПШ Черногорск функционирует на объектах как частных так и государственных предприятиях. Устранение засоров скважин : Телеметрия скважин

Reply
JasonTaush JasonTaush Познавательная подборка at google

Приветствую всех! Нашел удивительную фотосессию на этом сайте: http://limonos.ru : новости шоу бизнеса россии сегодня год последние новости шоу бизнеса красивый дизайн фото дизайн проект http://limonos.ru/8357-national-geographic-luchshiy-fotograf-prirody-2017.html National Geographic: лучший фотограф природы 2017 15 лучших фотографий 2017 года по версии Flickr 15 лучших фотографий 2017 года по версии Flickr http://limonos.ru/6699-start-rossiyskogo-kosmicheskogo-korablya-soyuz-ms-03.html

Reply
blede blede Замена труб для погружных насосов Сосновый Бор at google

Созданная нами холдинг Ограниченная ответственность ЩАУОА Верхняя Пышма делает новейшим методом телеинспекциюинженерных систем, сетей хоз. бытовых, технологической и ливневой канализации, водостоков, водопроводов, водозаборных скважи, КНС, инженерных систем, ливневой канализации и так далее. Телеинспекция любых труб выполняется особой видео камерой, которая двигается по трубам и подает вид на телемонитор и одновременно ведётся видеозапись труб. Подобная диагностика может определить состояние стенок и стыков трубопроводов, участки нахождения трещин, свищей и иных изъянов, выявить засоры и посторонние элементы, несанкционированные врезки и прочие. Телеинспекция также может быть использована и при приёме труб по окончании выполнения строительных работ, проведения ремонта. Хорошим положительным моментом системы видеоинспекции считается её мобильность, простота доступа к трубам, а также возможность получать изображение внутренних частей труб разного диаметра. Наша предприятие Корпорация ВУВВ Находка работает на предприятиях как индивидуальных так и государственных объектах. телеинспекция скважин - Телеметрия скважин

Reply
Kelprient Kelprient Cialis Sin Receta Foro Kelprient at google

Viagra Generique Fiable Zithromax Capsules 500mg viagra Sildenafil Generique 20 Mg Pharm Support Group Levitra Lower Back Pain

Reply
Alinka94 Alinka94 Скачать клипы mp3 at google

How Snake Pass Works Game Maker's Toolkit - YouTubeThis year’s most inventive game was Snake Pass - a squirmy interactive toy that came together thanks to some smart design decisions, and a dash of good luck....The music of Breath of the Wild GMTK Extra - YouTubeThis is a bonus video, outside the usual realm of Game Maker's Toolkit. Here, I'm talking about the strengths of The Legend of Zelda: Breath of the Wild's so...Into the Breach - Hard Difficulty - Blitzkrieg Squad - Run 3 Part 1 - YouTubeWelcome to Into the Breach gameplay! Into the Breach is an incredible turn-based tactical game from the makers of FTL. You control powerful mechs from the fu...How (and Why) Spelunky Makes its Own Levels Game Maker's Toolkit - YouTubeSpelunky will always keep you guessing, by making a fresh set of 16 levels every time you play. In this episode we look at how creator Derek Yu strikes a bal...107 Yu-Gi-Oh Facts YOU Should Know! - Anime Facts! (107 Facts S6 E21) Channel Frederator - YouTubeIt's time to... w-w-w-watch 107 Facts about Yu-Gi-Oh! The Japanese manga turned card game turned anime that swept the world in the early 2000s, Yu-Gi-Oh! pla...1 Hour of Relaxing Nighttime Animal Crossing Music + Night Ambience Sound - YouTubeClose your eyes and gather around the nighttime campfire with your favorite neighbours and KK Slider's guitar! Enjoy 1 Hour of Relaxing Night Time Animal Cro...StarCraft 2: CHEESE vs CHEESE! - YouTubeI'm starting to really like Battle on the Boardwalk. Subscribe for more videos: http://lowko.tv/youtube The Double Cheese rush: https://goo.gl/dGUuCF An awes...Animal Crossing: WELCOME TO POOPSVIL! - PBG - YouTubeIf you're new, Subscribe! > http://bit.ly/1CaGyoO Watch me play Animal Crossing on PBGGameplay! > https://www.youtube.com/watch/51IduQfyo04 Go subscribe to...10 Best Video Games Made Entirely By One Person - YouTubeIronically this video was made by two people. For more awesome content, check out: http://whatculture.com/gaming Catch us on Facebook at: https://www.faceboo...Roguelikes and the Modular Genre - YouTubeFollow me on Twitter- https://twitter.com/Thefearalcarrot Support The Architect of Games on Patreon- https://www.patreon.com/ArchitectofGames NOTE: As Stunta...Dark vs. ByuN ZvT - Finals - WCS Global Finals 2016 - StarCraft II - YouTubeDark vs. ByuN face off in Finals of the 2016 WCS Global Finals. Follow the whole series on http://www.StarCraft2.com/WCS Check out all the matches from the 2...107 Warcraft III Facts YOU Should KNOW The Leaderboard - YouTubeCheck out MORE Warcraft videos here: https://www.youtube.com/playlist?list=PLJuFxb2ft3ZZqJRJKSZeivCfqLXa31ZXM Which Warcraft character is your favorite? Chec...The Best Games from GMTK Game Jam 2018 - YouTubeLet’s look at my favourite games from the second GMTK Game Jam. Play all the games here - https://itch.io/jam/gmtk-2018/entries Top 20 Games Fresh Merchandis...Top 10 Things I Want in the Next Animal Crossing Game - YouTubeI'll definitely be doing plenty more Animal Crossing-related content in the future. I worked pretty hard on this cause I've never done a top 10 before. What ...16 things you wish you knew earlier in StarCraft 2 - YouTubeLike the title says, 16 things you wish you knew earlier in Starcraft 2! Some tricks and tips you can use in your own game play, enjoy! Twitter: https://twit...107 MORE Animal Crossing Facts that YOU Should Know! The Leaderboard - YouTubeEnter Our Weekly Console Giveaway here: http://www.leaderboard.nyc/giveaway and subscribe to The Leaderboard > http://frdr.us/TLBsubscribe Animal Crossing is...Deconstructing Ori and the Blind Forest's Best Bit Game Maker's Toolkit - YouTubeEveryone who has played Ori and the Blind Forest will remember the Ginso Tree. In this video, I break the level down - beat by beat - to show you why it's so...The Complicated Story of the Homestuck Fandom - The Fandom Files - YouTubeLet me tell you about Homestuck. Go to http://dollarshaveclub.com/rpgmonger and get the Daily Essentials Starter Set for only $5 with free shipping! Twitter:...107 Castlevania: Symphony of The Night Facts YOU Should Know! The Leaderboard - YouTubeEnter Our Weekly Console Giveaway here: http://www.leaderboard.nyc/giveaway and subscribe to The Leaderboard > http://frdr.us/TLBsubscribe Join Brendan and T...107 Little Nightmares Facts You Should Know! The Leaderboard - YouTubeEnter Our Weekly Console Giveaway here: http://www.leaderboard.nyc/giveaway and subscribe to The Leaderboard > http://frdr.us/TLBsubscribe Join Brendan and T...

Reply
Be the first to comment
It looks like there's some information missing
By clicking, you agree to the Terms and Conditions

Research Report

People Power and Technology: The Tech Workers’ View

Doteveryone’s report highlights how critically important values-led leadership, backed by the right culture and processes, has become for tech workers in the UK.

READ ON

Article

Protecting the Identity of Africans in a Common Digital Market

Magdi Amin, investment partner at Omidyar Network discussed protecting the digital identity of Africans in a recent Biz Community article.

READ ON