Interpreting survey results & analytics in IMPACT
Watch a quick video guide:
Here you will see the progress of your survey and can analyze results and share them.
Note that you will see here only results you have access to (according to the Survey settings) and after the number of responses passes the anonymity threshold. Learn more about it here.
Tabs like Overview/Heatmap/Trends/Comments/Participation rate have filters (for participants, questions, etc). Changing the filter settings on one page will NOT change the filter settings for other pages (they are independent) .
By default, the last survey round is always set for all tabs.
Using filter choices can help you extract more insights from your surveys and significantly impact how you explore them. The following filters are available for Heatmaps, for example:
- Group by User: Data is grouped based on the individual who gave the feedback. You can view certain information such as Names, Managers, and Teams. However, if the survey's privacy setting was set to Anonymous, all this data will be withheld to uphold privacy.
- Group by Managers: Have data categorized based on the manager level. Profiles of multiples managers can be viewed in respect to their Direct members and Teams.
- Group by Demographics: Objectively assemble the data under profiles such as Team, Location, Gender, or Age
The Heatmap tab significantly streamlines survey analytics. A user-friendly filter lets you customize your data view based on Round, Teams, Direct manager, Users, Locations, Gender, Age groups, Tenure, and Questions facilitated.
The heat map displays eNPS (Employee Net Promoter Score) and Linear scale questions. You can group these answers not only by Users but also by Manager, Team, Location, Gender, and Age. For ease, you can sort all your entries from lowest to highest score. Details about every entry, like a standard deviation, can be obtained by placing the cursor over the "?" icon.
Your Heatmap can be exported to CSV (can be opened by Excel, Google Sheets, etc) for further queries or exported as a PNG to share your results.
Survey trends show the trend for Linear scale questions and eNPS questions over time for rounds.
It’s a great way to monitor how responses change over time.
You can filter by team, location, age, gender, user, etc, to monitor details for a particular group and have a pulse of the changes in your team.
Survey results are automatically available for all people who have access to them. Add/remove specific people to surveys in the “Survey settings” tab.
Your Heatmap, Responses, Comments can be exported to CSV for further exploring your data.
View individual raw responses from each participant for each round.
You can filter by team, location, age, gender, user, etc, to see details for a particular group.
Or export responses to CSV to query your data on your own.
Here will be collected comments that participants leave (for questions that enabled comments). So that you can see all comments in one place.
You can filter by team, location, age, gender, user, etc, to see details for a particular group.
On the “Participation rate” tab, you can view how many participants already submitted their responses for each round and their response statuses for each round.
☝️ Note: if the survey is Anonymous, you won’t be able to see the response status for a particular person, only the aggregate response rate.
You can send reminders to specific people or to all recipients to submit their responses for the last survey round.
The standard deviation is a statistical measure of how spread out numbers are. Low standard deviation indicates that the values tend to be close to the mean, i.e., everyone that answered the question is of a similar opinion. If you, for example, have a standard deviation of 4 and a mean of 6, this means some people may have responded with a 2 and others with a 10, whereas a standard deviation of 1 with a mean of 5 means that all answers were e.g., between 4 and 6.
Therefore finding out which questions had a high standard deviation will show you which topics polarize your employees more. If a question has a very high standard deviation, meaning people are not unanimous about it, you could, e.g., see whether this question received any written comments that help you understand why opinions diverge.
The eNPS is an established metric for measuring satisfaction with a product, service, employer, etc. As with any other metric, you need an understanding of the basic characteristics of the metric (e.g., range) and, if necessary, corresponding comparison groups to know what a certain value means. The eNPS cannot easily be converted into other metrics that are more familiar and easier to understand (e.g., %). Therefore, it's useful to know the basic properties:
* How it's calculated: an eNPS score is calculated by subtracting the percentage of 'detractors' (people giving a rating of 0-6) from 'promoters' (people giving a rating of 9-10). People who give a rating of 7 or 8 are not counted, as they are considered neutral. For example, if 50% of your employees rate a 9 or 10 on a question, 10% rate a 7 or 8, and 40% rate 0-6, you would subtract 40% (the detractors) from 50% (promoters). Meaning your eNPS score would be 10.
* Range: The eNPS can lie between 100 (which would be the case if every individual gave a negative answer) and +100 (which would be the case if every individual gave a positive answer)
* Interpretation: Most companies consider a value >0 to be okay because this means that there are more promoters than critics/detractors. From 50 on, the score can already be considered a very good result.
Surveys overview dashboard
Here you will see the progress of your survey and can analyze results and share them.
Note that you will see here only results you have access to (according to the Survey settings) and after the number of responses passes the anonymity threshold. Learn more about it here.
Filtering survey analytics
Tabs like Overview/Heatmap/Trends/Comments/Participation rate have filters (for participants, questions, etc). Changing the filter settings on one page will NOT change the filter settings for other pages (they are independent) .
By default, the last survey round is always set for all tabs.
Customizing Your View with Filters
Using filter choices can help you extract more insights from your surveys and significantly impact how you explore them. The following filters are available for Heatmaps, for example:
- Group by User: Data is grouped based on the individual who gave the feedback. You can view certain information such as Names, Managers, and Teams. However, if the survey's privacy setting was set to Anonymous, all this data will be withheld to uphold privacy.
- Group by Managers: Have data categorized based on the manager level. Profiles of multiples managers can be viewed in respect to their Direct members and Teams.
- Group by Demographics: Objectively assemble the data under profiles such as Team, Location, Gender, or Age
Understanding Heatmap
The Heatmap tab significantly streamlines survey analytics. A user-friendly filter lets you customize your data view based on Round, Teams, Direct manager, Users, Locations, Gender, Age groups, Tenure, and Questions facilitated.
The heat map displays eNPS (Employee Net Promoter Score) and Linear scale questions. You can group these answers not only by Users but also by Manager, Team, Location, Gender, and Age. For ease, you can sort all your entries from lowest to highest score. Details about every entry, like a standard deviation, can be obtained by placing the cursor over the "?" icon.
Your Heatmap can be exported to CSV (can be opened by Excel, Google Sheets, etc) for further queries or exported as a PNG to share your results.
Survey trends
Survey trends show the trend for Linear scale questions and eNPS questions over time for rounds.
It’s a great way to monitor how responses change over time.
You can filter by team, location, age, gender, user, etc, to monitor details for a particular group and have a pulse of the changes in your team.
Sharing survey results
Survey results are automatically available for all people who have access to them. Add/remove specific people to surveys in the “Survey settings” tab.
Export survey results
Your Heatmap, Responses, Comments can be exported to CSV for further exploring your data.
Reviewing responses
View individual raw responses from each participant for each round.
You can filter by team, location, age, gender, user, etc, to see details for a particular group.
Or export responses to CSV to query your data on your own.
Comments
Here will be collected comments that participants leave (for questions that enabled comments). So that you can see all comments in one place.
You can filter by team, location, age, gender, user, etc, to see details for a particular group.
Participation rate
On the “Participation rate” tab, you can view how many participants already submitted their responses for each round and their response statuses for each round.
☝️ Note: if the survey is Anonymous, you won’t be able to see the response status for a particular person, only the aggregate response rate.
You can send reminders to specific people or to all recipients to submit their responses for the last survey round.
Understanding the standard deviation
The standard deviation is a statistical measure of how spread out numbers are. Low standard deviation indicates that the values tend to be close to the mean, i.e., everyone that answered the question is of a similar opinion. If you, for example, have a standard deviation of 4 and a mean of 6, this means some people may have responded with a 2 and others with a 10, whereas a standard deviation of 1 with a mean of 5 means that all answers were e.g., between 4 and 6.
Therefore finding out which questions had a high standard deviation will show you which topics polarize your employees more. If a question has a very high standard deviation, meaning people are not unanimous about it, you could, e.g., see whether this question received any written comments that help you understand why opinions diverge.
Understanding the eNPS
The eNPS is an established metric for measuring satisfaction with a product, service, employer, etc. As with any other metric, you need an understanding of the basic characteristics of the metric (e.g., range) and, if necessary, corresponding comparison groups to know what a certain value means. The eNPS cannot easily be converted into other metrics that are more familiar and easier to understand (e.g., %). Therefore, it's useful to know the basic properties:
* How it's calculated: an eNPS score is calculated by subtracting the percentage of 'detractors' (people giving a rating of 0-6) from 'promoters' (people giving a rating of 9-10). People who give a rating of 7 or 8 are not counted, as they are considered neutral. For example, if 50% of your employees rate a 9 or 10 on a question, 10% rate a 7 or 8, and 40% rate 0-6, you would subtract 40% (the detractors) from 50% (promoters). Meaning your eNPS score would be 10.
* Range: The eNPS can lie between 100 (which would be the case if every individual gave a negative answer) and +100 (which would be the case if every individual gave a positive answer)
* Interpretation: Most companies consider a value >0 to be okay because this means that there are more promoters than critics/detractors. From 50 on, the score can already be considered a very good result.
Updated on: 21/02/2024
Thank you!