Analytics and reports

Where to start looking at the data: which dashboard answers which question, and in what order to read them.

What it is and what it's for#

The programme leaves a record of everything that happens: who logs in, what they complete, what they redeem, what they answer. Analytics turns that record into two different things, and it is worth keeping them apart because they are fixed in different ways:

  • Is the programme alive? Participation, completed challenges, streaks, use of points. If this goes badly, you fix it with content and communication.
  • Is anything changing in the organisation? Climate, recognition, what people write. This moves slowly and is not fixed with more reminders.

There is no single dashboard that answers everything. There are several, each with a question of its own:

How to set it up#

The metrics calculate themselves: there are no metrics to declare. If you need a figure or a list that no dashboard gives you ready-made, you build it yourself in the Report Editor.

The only part of analytics that you do configure is the pulse question catalogue, because there you decide what gets asked and in which categories. It is in Pulse and sentiment.

What you do decide on almost every dashboard is how you slice the data: the period and, depending on the dashboard, the location and the organisational unit. Some have no filters: the Comments Dashboard always looks at the last 28 days (and 90 for what is still unanswered) and the Login Dashboard, at the whole project.

Nota:

The slice is what makes the figure useful. A global participation rate of 60% does not tell you what to do; 85% at some sites and 20% at others points exactly to where you should go.

Aviso:

Not every dashboard offers the same slices. Before comparing two figures that come from different screens, check that they are looking at the same period and the same set of people. Two similar numbers that do not match are usually two different questions, not a calculation error.

What happens next#

  1. 1

    First check whether the programme is alive

    The engagement dashboard, top to bottom. Without activity, the rest of the metrics mean nothing: a good climate measured on fifteen responses is not a good climate.

  2. 2

    Then, where it gets stuck

    Slice by location and organisational unit, and go down to the breakdown by challenge. The differences between sites say far more than the average.

  3. 3

    Go down to the names

    Almost every metric has a list of specific people behind it. That is where the figure turns into something you can act on: a call, a reminder, a visit.

  4. 4

    Finally, what is changing

    Pulse and surveys, comparing periods. Here one month's figure is worth nothing; the series is.

Frequently asked questions#

Which metric should I look at if I can only look at one?

Active people in the period, sliced by site. Almost every other problem shows up there sooner or later.

What counts as good participation?

It depends on the type of workforce and on whether the programme is voluntary. More important than the absolute number is the trend and the spread between sites: a stable, even 50% is a better sign than a 70% falling month on month.

Why does a journey's completion rate drop if nobody has stopped taking part?

Because you have added challenges. The numerator is unchanged and the denominator has grown. It is normal and it recovers.

Can I export the data?

Yes. On the engagement dashboard, the detail behind each metric downloads as a spreadsheet file, and you can also copy the email addresses of the people on that list in one go. The action follow-up dashboards download with Download CSV, and the results of named questionnaires with Download. Anonymous questionnaires have no download.

Can I see the detail for one specific person?

There is no per-person tracking record. Their actions and their status appear in the Actions Detail Report by searching for their name; their points movements, line by line, on the points-by-user screen explained in Point adjustments and redemptions, and also in the Report Editor filtering by person. Anonymous survey responses, no, by definition.

Two dashboards give me different figures for the same thing. Which do I believe?

Before assuming one of them is wrong, compare the period and the scope. The manager's panel looks only at their team; the engagement one, at the whole project. If they still do not match once period and scope are aligned, say so: that is the kind of discrepancy worth looking into.

Limits and warnings#

  • Inactive people drop out of the lists, except on the dashboards where you switch on Include inactive users. If you deactivate a lot of people, the percentages rise without anything having improved. It is the easiest way to believe in an improvement that does not exist.
  • Points pending approval do not count as issued. A large approval queue distorts the reading of the points economy.
  • Anonymous responses cannot be traced down to the person. They are read in aggregate; that is exactly the deal you made with whoever answers them.
  • Comparing waves requires that the questions have not changed. If you edit them in between, the series breaks and stops being comparable.
  • Data with few responses is not representative. Be sceptical of a category or a site with a handful of responses, however striking the result.
  • Culture metrics need time. Drawing conclusions from a single survey wave, or from two weeks of pulse, leads to the wrong decisions. Always compare against the previous period.