Online Community – Moving Beyond Metrics to ROI

We gave a presentation on building ROI models for online communities at the Online Community Unconference in Mountain View, CA on June 10th. It was added because so many of the participants stated that ROI and calculating the value of their community was the most important issue they faced.  So, we didn’t have time to build a true presentation, but rather lead a workshop for participants to learn more. It was lead by our president, Mike Rowland.

Here are the summary notes taken during the session:

• Have to first identify what is the economic value of the community to the organization offering it: (Don’t confuse traffic or behavior metrics with value)
  • Cost Avoidance
  • Increased subscription rates or lower churn rate
  • More frequent purchase rates
  • Higher purchase level/amts
  • Faster close for large item sales
  • Reduce lead generation cost
• Once you’ve identified your value metrics, break down your metrics into 3 buckets to look at communities:
  • Traffic – PV, visits, visitors, etc.
  • Behavior – What they do when the get there, who they are, download/visit, contribution/member, responses by employees vs. customers
  • Value – can attach an economic value to it. Need $ to get to a true ROI model. See above list.
• You have to build relationships w/ the folks in your company. Need access to other systems. You cannot build ROI from community analytics provided by software vendors or from traffic and behavior metrics alone. 
• ROI Frameworks:
  • Cost Avoidance
    • The person who proposes the question needs to verify the answer. This is a feature needed in the platform.
    • # of community support resolutions X $ complimentary support resolution (1-800 number) = total cost avoidance -> economic value
    • Track over set period of time (e.g. quarterly or yearly)
    • ROI = (total economic value – total costs to set up and run forum) / total costs –> over one period and as a percentage
  • Increased subscription or reduced churn
    • Customer database compared to community database
    • cust. database = Average churn rate (e.g. the number of months the avg user subscribes) X price/subscription = customer value
    • Community database – look at active members and see if the churn rate is better or worse.
    • Price will be the same, so you’ll have to see if the churn rate was more or less. If subscriptions are longer, than you have a higher customer value for community members.
    • Shows you slowed the churn rate down.
  • More frequent purchase or Higher Purchase level/amts
    • Use your eCommerce DB or CRM system
    • What is the avg amt customers spend/purchase?
    • go back to comm DB and parce out active members and compare to ecommerce DB (which ones spend more/purchase?)
    • Do comm members have a higher spend/purchase? active comm users X avg $ they spend = economic value
    • Need to trend this and see how it fluctuates.
    • what is the average number of items in completed shopping activity? (e.g. 1.6 items) Do comm members buy more?
    • Avg cost/item X avg # items = economic value
  • CRM decrease cost
    • Want to find what avg value of customer is
  • Faster close of sale (Good for large purchases like software or hardware systems)
    • How fast are organizations moving through your CRM system to sale?
    • Identify active organizations in community DB to compare them to avg organizations.
    • How long does it take the avg. organization to go through sale stages? What’s the cost/sale? Do active organizations in your community go through more quickly and spend more?
  • Lead generation cost
    • Similar to above, but use cost to generate a lead for average customer versus those which originate in community/social media campaigns
• How can you tell if a user came to your comm and then bought your product through a 3rd party reseller? You can’t unless your resellers provide access to their databases which is next to impossible to get.
• Users of support communities become brand neutral after their issue becomes resolved.
• Hidden costs of community for ROI Analysis, make sure you count these:
  • Servers
  • development costs
  • customizations
  • widgets
  • maintenance
• Make sure that you are amortizing your costs across the same time period as your economic value or you will skew your results.

One point to remember is that the value of communities really is derived from active members, not all members. So define your active members with criteria that meet your behavioral key performance indicators (KPIs). For example, an active member can be someone who posted in a forum, downloaded a featured whitepaper, uploaded content, or viewed a webcast in the past month. For B2B especially, it doesn’t have to be an activity within the past week as most B2B community members average 2-3 visits per month unless they are deep into the sales cycle.

The number one issue to watch out for when building your ROI framework is the use of proxies. If you cannot get the data, don’t guess at a proxy for the value because the more proxies you utilize the bigger the house of cards that you build.

Lastly, value can be a set of different items. For a subscription based community value can be both churn rate differential and purchase levels. ROI is not a single value formula, it is a multiple value formula in most cases as there is marketing value in support communities and vice versa. So make sure that you are at least attempting to capture as much of the value drivers as possible in your analysis.

Want to learn more about online community or social media ROI? Contact us today or leave a comment.

Back to the blog

One Response to “Online Community – Moving Beyond Metrics to ROI”

Walking out the Door with the Twitter Password: A Few Words on Social Media Maturity | Impact Interactions says:

March 1, 2010 at 8:33 pm

[...] written about business goals and determining ROI (including several posts on this blog, including this one), so I won’t delve into it here, other than to say this should be the starting point in any [...]