community analytics 101

The Context Problem

The fundamental underlying principle of analytics, including community analytics, is the idea of comparing...which is also called context. It's essentially what separates analytics from just plain data. Without appropriate context, you don't know whether the data is telling you that you are strong or weak. Figure 1 shows the total industry workforce for Manitoba communities as a percent of population. Note the wide range of data and how the averages for each geographic type varies. It's why our reports provide 3 distinct custom selected comparison community groups. We believe that choosing the comparison community groups is the most important analytic decision because it ultimately determines what you define as a strength and as a weakness. We recommend the first comparison group to be local view of nearby communities, the second view to of similar communities and a third big picture view (i.e. the provincial average). 

image4

  1. No Context: Not everyone values the full power of data. Some organizations value primary data (collected through interviews) above secondary data, which is data typically collected by Statistics Canada or other government sources. The over-valuation of primary data means that community analytics start and end with "stakeholder" interviews. Although interviews can be a great source of local anecdotal information, they fail in providing context...a wider picture comparison of other similar communities. And in the end, they can't provide targets for what a community could look like in the future. We recommend analytic reports that can serve as an additional resource to interviews.
  2. Small Context: The conventional practice of comparing a community on a per capita basis with the provincial average is a case in point. Provincial averages are some of easiest comparable data to gather. But by definition, it's an average of strong and weak communities, which creates average statistics that are meaningless in many cases. It leaves many communities with a false sense of strength because they rank above the provincial average.
  3. Weak Context:  The second easiest comparable data to gather in community analysis is historical data (i.e. the previous Census). This essentially provides a directional trend analysis. And while this type of analysis is helpful, it's still defines weak context because it still gives a distorted view of a community's strength's and weakness'. The ability to compare a community against other similar communities is one of the best ways to find a community's strengths and weaknesses.
  4. Small Data: Analytics require data aggregation...but over-aggregated data can easily hide the real opportunities within a community. For example, industry labour analysis often uses 2-digit data (20 industry segments) to analyze the economic engine of a community. When industry sub-segments include both strong and weak areas, aggregated data will effectively bury the real strengths and weaknesses of a community. The problem is that you don't know until you actually analyze the industry sub-segments. As a result, we use Statistics Canada special run 3 and 4 digit data (427 segments).
  5. The Problem with Averages. Community profile statistics are typically calculated on a per capita basis in order to compare communities of different sizes. Furthermore, when communities are aggregated together as a comparison base, they are often weighted by population. In fact, Statistics Canada provincial community profile data is actually a weighted average of all communities within a province. This means that the comparison of a community to the provincial average is effectively a comparison to its larger communities. We've found that there are often substantial differences between the conclusions drawn with simple and weighted averages. Exceed community reports offers either simple or weighted averages.
  6. Pretty Graphics OR Good Analytics. Not all graphics are created equal and the more data you're trying to display, the higher the degree of difficulty. And since good analytics equals good comparison groups, it effectively also mean more data. The problem is how to tell the analytical story and the unfortunate practical consequence is often a binary decision...good graphics or good analytics. For example, pie charts are pretty, but force the viewer to compare angles which are more difficult for our eyes than a bar chart. What's even worse is trying to compare several pies where the viewer is asked to compare slices located within the pie and between pies. It means that pie charts most often fall into the pretty graphics category. We solve this by prioritizing good analytics...while using the best graphics possible...coloured heat maps and bar charts, which are excellent at showing comparisons.

Big Context: 3 Reports in 1

Exceed Analysis reports compare a community against 3 custom selected community groups. It means our analytics are guaranteed to find a community's strengths and opportunities...insights that are often hidden using conventional analytics.    

See Video