The Business Case for Good with Lauren Scott artwork

The Business Case for Good with Lauren Scott Neil Callanan on Proving Impact: Consumption Metrics Over Views

Neil Callanan, Founder, LooseGrip

· 57 min

Summary

On The Resilience Report with host Lauren Scott, LooseGrip founder Neil Callanan said most values-led brands put thousands of hours into impact reports and storytelling but rarely check what that work does for the brand.

The fix is to replace views and page views with consumption metrics, such as total engaged time on page or total time spent watching video.

Impact content is best judged by what audiences actually do with it, which a view count cannot show.

Questions answered

How do you know whether an impact report worked?

Most organizations never find out, said Neil Callanan, founder of LooseGrip: they put thousands of hours into an ESG or impact report, feel a collective sense of relief when it ships, and have little incentive to check whether it had the effect they wanted. When success is measured at all, it often comes down to PDF downloads or video views, which are flawed measures. The brands doing this best treat impact as always-on storytelling that evolves through the year and gets repurposed, rather than a once-a-year push that is hard to measure.

There is probably a better metric than whichever one a team uses today, whatever the format, if it is willing to look. A PDF download is a black box, because the reader may never open the file past its cover. Neil would not tell a brand that has produced a big annual report for a decade to drop the format on day one. He would put page views on the board next to a measure of how much time people actually spend reading, and ask the team where it wants each one ranked.

What should you measure instead of views and impressions?

Drop views, page views and video views as primary metrics in favor of consumption metrics, such as total engaged time on page, total time spent watching video, or the total days or weeks of a video that were consumed. Platforms count a fraction of a second and seventeen minutes as the same view, so assuming views say anything about impact is a fallacy. The two most common mistakes Neil sees are too many data points and too many dashboards. If you measure everything, some number will always say you did well.

LooseGrip starts engagements with an analog workshop: the team maps the behaviors it wants, lists ten to fifteen metrics for a category on sticky notes, then is asked to cut the list to three. Then there is the HiPPO problem, the highest paid person's opinion, which favors the biggest number, such as 200 million impressions. The answer is to agree on metrics before reporting begins, with people from entry level to senior involved, so a later report can remind everyone that they chose to rank page views lower.

Does values content help a brand's other marketing?

Values content can lift a brand's other marketing, and the lift can be measured: in a halo effect study for a long-time LooseGrip client, the same product shot, with the same content and posted at the same time of day, got twice the reach when it followed an activism post that had strongly engaged the audience. The client had asked what happens to the more traditional posts that come right after a highly engaging values post, and LooseGrip now tracks it continuously. A client asking questions like that is a sign an engagement has turned a corner, because the team has moved past asking which page got the most page views.

How can impact teams protect their programs when budgets tighten?

Measure the work as if it were not activism: know which platforms, formats, content styles and paid placements work best, so the team can operate like a performance marketing team whose product is its impact. That makes it possible to recommend what to drop, such as turning a hundred-page PDF into a hundred smaller pieces of content. Impact programs are often the first to be seen as a nice-to-have when cuts come, and Neil said ESG teams who insist they are not marketers are approaching it the wrong way. The biggest mistake is assuming good intentions make a program unquestionable.

The pendulum has swung away from brands speaking up, and leadership at larger companies tends to be risk-averse, so impact work needs to be quantified more than ever. Saying it is the right thing to do is often not enough when most executives are paid on profits. The teams navigating this best connect purpose and profit tangibly enough to show an executive how the brand benefits from saying more, and what saying less could cost in sales, followers and long-term engagement.

How do you put a number on impact that feels intangible?

Tie each ask to a concrete outcome. At the IM ABLE Foundation, whose board Neil used to chair, one of his goals was to make support feel quantifiable, and its donation asks now say how many kids a $100 gift gets through a class. The foundation runs inclusive and adaptive fitness programs, mostly for young people with disabilities, who can go on to coach classes themselves. As the adage goes, everybody wants to build a school but nobody wants to hire a teacher: physical projects attract donations more easily than classes, support or programming, so those need stories with a number attached.

Key takeaways

  • Neil Callanan said most ESG and impact reports take thousands of hours, get a collective exhale when they ship, and are almost never checked for whether they worked. The alternative is to treat impact as always-on storytelling that is repurposed through the year.
  • Too many data points and too many dashboards are the two most common measurement mistakes Neil sees. In LooseGrip workshops, teams list ten to fifteen metrics for a category on sticky notes, then are asked to cut them to three.
  • Drop views, page views and video views as primary metrics in favor of consumption metrics, such as total engaged time on page, total time spent watching video, or the total days or weeks of video consumed.
  • The HiPPO problem, the highest paid person's opinion, pulls teams toward big numbers like 200 million impressions. The fix is to agree on metrics up front with people from entry level to senior, so later reports can point back to that decision.
  • In a halo effect study for a long-time LooseGrip client, the same product shot posted twice at the same time of day got twice the reach when it followed a values post that had strongly engaged the audience.
  • The virtue-signaling check is to ask how: if a brand's support for a cause is only words, or a stock photo during a heritage month, it is not a how.
  • When budgets tighten, measure impact work as if it were not activism: know which platforms, formats and paid placements work, so the team can choose what to drop, such as turning a hundred-page PDF into a hundred smaller pieces.

Quotes

Platforms are incentivized to tell you a view is a view is a view, whether you viewed that literally point zero zero one second or seventeen minutes.

Neil Callanan

If we try to measure everything, we'll essentially measure nothing.

Neil Callanan

Well, sure, you're trying to save the world. Tell me which platform works best for you and your world-saving techniques, right?

Neil Callanan

A willingness to look at what the numbers are telling you and don't look away when they start telling you something doesn't really look that great.

Neil Callanan

Frequently asked questions

What are consumption metrics?

Consumption metrics measure how much of a piece of content people actually took in, such as total engaged time on a page or total time spent watching a video. They work better than views and page views, which count a fraction of a second the same as a full watch.

What is the HiPPO problem?

HiPPO stands for the highest paid person's opinion. It pulls teams toward the biggest numbers, such as impressions, so LooseGrip gets teams to agree on their metrics before results come in.

How can a brand check whether it is virtue signaling?

Ask how. A brand that claims to support a cause but cannot describe the actions behind it, beyond saying the words or posting a stock image, is virtue signaling.

What did Neil Callanan discuss on The Resilience Report?

Neil Callanan, founder of LooseGrip, joined host Lauren Scott to discuss how values-led brands can prove the impact of their work. He covered unmeasured ESG reports, consumption metrics, the HiPPO problem and the halo effect of values content.

What career advice did Neil Callanan give students interested in data and impact?

Storytelling with data is the skill that lasts, Neil Callanan said, because AI is taking over manual data work and building dashboards is not a long-term career. He recommended MeasureCamp, a free unconference where anyone can give a talk, and Tableau's Iron Viz data storytelling competition.

About this episode

As we prep Season 2, we're sharing conversations where host Neil Callanan took the guest chair. This episode comes from The Resilience Report, where Neil joins host Lauren Scott to dig into the gap between caring about impact and being able to prove it. He walks through what actually happens to most ESG reports: thousands of hours in, a collective exhale when it ships, and almost no one checking whether it worked—and makes the case for treating impact content as always-on storytelling rather than an annual sprint.

Neil breaks down the two mistakes he sees most (too many data points, too many dashboards), why he pushes clients to demote views and page views in favor of consumption metrics, and how the HiPPO problem quietly pulls teams back toward big meaningless numbers. He also shares the "halo effect" study with a longtime client—tracking what a high-engagement values post does to the traditional post that follows it.