Below is an example we’ve taken from the tool, to visualize some of Thematic’s features. So, 71% of your survey respondents (852 of the 1,200 surveyed) plan on coming back next year. For tips on how to analyze results, see below. The keynote speaker? Enter; Text, Shep Hyken knows a thing or two about customer experience. Firstly, you need to plan for survey design success. As an incentive, you can share the results with the participants, in the form of a benchmark, or a measurement that you then report to the participants. Say you asked your survey respondents how many of the 10 available sessions they attended over the course of the conference. For example, if you held an education conference and gave attendees a post-event feedback survey, one of your top research questions may look like this: How did the attendees rate the conference overall? Now that you’ve collected your statistical survey results and have a data analysis plan, it’s time to begin the process of calculating survey results you got back. Your surveys will reveal what areas in your business need extra support or what creates bottlenecks in your service. We receive feedback from many places: our in-product NPS, Many organisations, large or small, gather customer feedback to improve their CX efforts and ultimately their bottom line. Using regression analysis, a survey scientist can determine whether and to what extent satisfaction with these different attributes of the conference contribute to overall satisfaction. That sounds pretty good. Or, look at a particular issue or a theme, and ask questions such as “have customers noticed our efforts in solving a particular issue?”, if you’re conducting a continuous survey over multiple months or years. Only use those that can make a difference to your end outcomes. Now is when that planning pays off. You can count different types of feedback (responses) in the survey, calculate percentages of the different responses survey and generate a survey report with the calculated results. Regression analysis is an advanced method of data visualization and analysis that allows you to look at the relationship between two or more variables. In analyzing our survey data we might be interested in knowing what factors most impact attendees’ satisfaction with the conference. Then, you can easily visualize it as a bar chart. The percentages are just that–the percent of people who gave a particular answer. One aspect of data analysis and reporting you have to consider is causation vs. correlation. Many businesses don’t actually think about this when they send out their surveys. that you can use the answers with confidence as a basis for your decision making? Favoured by government agencies and communities, it’s good for employee engagement, public opinion and community engagement surveys. Don’t stop at the survey data alone. This is a whole topic in itself, and here are our best tips. Now it’s time to dig in, start sorting, and analyze the data. He needs no introduction in industry-wide circles, but in case you’re not familiar with his name: Shep is an award-winning customer service and customer experience speaker, a New York Times and Wall Street Journal best-selling author, A.K.A. Cross-sectional surveys are an observational research method that analyzes data of variables collected at one given point of time across a sample population or a pre-defined subset. The data show that attendees gave very high ratings to almost all the aspects of your conference — the sessions and classes, the social events, and the hotel — but they really disliked the city chosen for the conference. Remember that you should have outlined your top research questions when you set a goal for your survey. You establish a benchmark or baseline number and, moving forward, you can see whether and how this has changed. Have customers noticed our efforts in solving issue Z? The following is an excerpt from a blog written by Alyona Medelyan, PhD in Natural Language Processing & Machine Learning. Has your survey been designed soundly ? This can, for example, be Net Promoter Score surveys that you send a few times a year to your customers. You can even track data for different subgroups. There is usually more than meets the eye about a person’s preferences and background which can affect the scenario. You dig deeper to find out what’s going on. One thing to be wary of as you slice and dice your results: Every time you apply a filter or cross tab, your sample size decreases. Longitudinal data analysis (often called “trend analysis”) is basically tracking how findings for specific questions change over time. The last kind of average is mode. You might think there are lots of questions that seem useful, but they can actually negatively affect your survey results. Step 1: Install the Data Analysis plug-in. Coding open-ended questions have 3 approaches, here’s a taster: Whichever way you code text, you want to determine which category a comment falls under. If you’ve ever stared at an Excel sheet filled with thousands of rows of survey data and not known what to do, you’re not alone. You most often will not be able to, and shouldn’t for practicality reasons, collect data from all of the people you want to speak to. In survey analysis and statistics, significant means “an assessment of accuracy.” This is where the inevitable “plus or minus” comes into survey work. Don’t be. For best practice on how to draw conclusions you can find in our post How to get meaningful, actionable insights from customer feedback. Analyzing … The site? Just remember that your sample size will be smaller every time you slice the data this way, so check that you still have a valid enough sample size. You may think of this as the most economical solution, but in the long run, it often ends up costing you more (due to time it takes to set up and analyze, human resource, and any errors or bias which result in inaccurate data analysis, leading to faulty interpretation of the data. (Maybe the conference was held in Chicago in January and it was too cold for anyone to go outside!) The way to get around this issue is to perform a sample size calculation before starting a survey. The average reported here is the mean, the kind of average that’s probably most familiar to you. Now it’s time to look at the information gathered through the survey questions. The more you know about the population you are interested in studying, the more confident you can be when your survey lines up with those numbers. There are many online services one could use for collecting survey data. We will illustrate the use of Survey Monkey, but we do not mean to suggest that it should be preferred over any other online survey service. Fifty (50) is a small sample size and results in a broad margin of error. In this regard, the “significant” in statistical significance refers to how accurate your data is. It also shows that your respondents “look like” the total population of people about whom you want to draw conclusions. For this, you can cross-tabulate, and show the answers per question for each subgroup. Hopefully the responses to other questions in your survey will provide some answers. Consider how much margin of error you’re comfortable working with first, as your sample size is always an estimate of how the overall population think and behave. Once a benchmark is established, you can determine whether and how numbers shift. Fact is, most Google Sheets formulas are either identical … Interpreting the Survey Results Do a quick overview of the results to familiarize yourself with the … So, if you can overlap qualitative research findings with your quantitative data, do so. But wouldn’t you like to have some context? Open-ended questions give you more insightful answers, however, closed questions are easier to respond to, easier to analyze, but they do not create rich insights. It’s quite simple to install the Data Analysis … They often consist of pre-populated answers for the respondent to choose from; while an open-ended question asks the respondent to provide feedback in their own words. By looking at other questions and interrogating the data further, you can hopefully figure out why and address this, so you have more of the small businesses coming back next year. Is that better or worse than last year? Survey data analysis is the process of drawing conclusions from what you’ve gathered. Various issues can easily crop up with this approach, see the image below: Out of 7 comments, here only 3 were categorized correctly. There are two main approaches to choose from here: Grounded theory / emergent coding / inductive (data driven) This is… The important part to get right is to choose a tool that is reliable and provides you with quick and easy analysis, and flexible enough to adapt to your needs. How to analyze survey data in Google Sheets. You’ll do yourself a disservice. In the second snippet, you can see the actual coded data, where each comment has up to 5 codes from the above code frame. Most survey questions fit into one of these four categories: Categorical data… Make sure you incorporate these tips in your analysis, to ensure your survey results are successful. collected your statistical survey results, Take a look at your top research questions. Confused about what to do next and how to achieve the optimal survey analysis? Thus, you need to make sure your survey analysis produces meaningful results that help make decisions that ultimately improve your business. Add analysts to any team plan for even bigger impact. Agi loves writing! Maybe there’s something you can do to convince the 11% who are not sure yet! If something is very common, it may not affect the score. Filter results by cross-tabulating subgroups. It’s usually a cumbersome process involving some combination of clunky analysis … In this example, you have 100 people saying they attended one session, 50 people for four sessions, 100 people for five sessions, etc. Recall that when you set a goal for your survey and developed your analysis plan, you thought about what subgroups you were going to analyze and compare. These two questions are important to take hand in hand. Go back to your main research questions which you outlined before you started your survey. Thus, 60% or your respondents (1098 of those surveyed) are planning to return. There’s a transcription tool for quick transcription of voice data. The critical difference is that with Ordinal data the separation between … This booklet … An open-ended question feels more inviting and warmer – it makes people feel like you want to hear what they want to say and actually start a conversation. Technically, the data created by this type of question is Categorical (see below) data. You can imagine that it’s actually quite difficult to analyze data presented in this way in Excel, but it’s much easier to do it using software. In the below example, any comment about friends and family both fall into the second category. So, you multiply all of these pairs together, sum them up, and divide by the total number of people. Data exists as numerical and text data, but for the purpose of this post, we will focus on text responses here. Survey analysis refers to the process of analyzing your results from customer (and other) surveys. Collected all of your survey data? In short, your results won’t carry much weight. So you’d take a sample (or subset) of the people of interest and learn what we can from that sample. If you take the time to carefully analyze the soundness of your survey data, you’ll be on your way to using the answers to help you make informed decisions. If your survey sample is a random selection from a known population, statistical significance can be calculated in a straightforward manner. To connect your survey data, you have one of three options: Upload new responses in an Excel or CSV file to conduct batch analysis Use Monkeylearn’s integrations with Google Sheets, Zapier, Zendesk, and … For example, say you wanted to see how teachers, students, and administrators compared to one another in answering the question about next year’s conference. Now it’s time to actually do something useful with them. Does your survey analysis deliver clear, actionable insights? If you have qualitative research that supports the data, use it! To always make sure you have a sufficient sample size, consider how many people you need to survey in order to get an accurate result. Use your surveys as a way of presenting solutions to your audience and getting direct feedback on those solutions in a more consultative way. The median is, in this case, six sessions. However, the categor ies to include need to be understood before the survey is put together. It’s designed to produce a meaningful answer and create rich, qualitative data using the subject’s own knowledge and feelings. (More on survey planning below). If you’re a DIY analyzer, there’s quite a bit you can do in Excel. You’ve collected your survey results and have a survey data analysis plan in place. Simply collect, count, and divide. … Here, you can see that most of the enterprises and the self-employed must have liked the conference as they’re wanting to come back, but you might have missed the mark with the small businesses. Say for example that satisfaction rates are increasing year over year for students and teachers, but not for administrators. The social events? 260 survey participants attended six sessions, more than attended any other number of sessions. Don’t have any? Survey data collection can replace or supplement other data collection types, including interviews, focus groups, and more. Open-ended questions often begin with words such as “Why” and “How”, or sentences such as “Tell me about…”. In this case, they don’t allow the respondent to provide original or spontaneous answers but only choose from a list of pre-selected options. You can benchmark not just attendees’ satisfaction, but other questions as well. The mode is the most frequent response. And your results look like this: You might want to analyze the average. Categorical data is the easiest type of data to analyze because you're limited to calculating the share of responses in each category. Part 1: Count all kinds of feedbacks in the survey. Closed-ended questions can be answered by a simple one-word answer, such as “yes” or “no”. Something to compare it against? Analyze a survey data in Excel. For instance, you could limit your focus to just women, or just men, then re-run the crosstab by type of attendee to compare female administrators, female teachers, and female students. Surveys can be a great source of information about your customers or your employees. There a many types of regression analysis and the one(s) a survey scientist chooses will depend on the variables he or she is examining. Finally, to further examine the relationship between variables in your survey you might need to perform a regression analysis. Start with the end in mind – what are your top research questions? Don’t wait for your team to create insights out of the data, you’ll get a better response and better feedback if you are the one that demonstrates the insights to begin with, as it goes beyond just sharing percentages and data breakouts. To figure this out, you want to delve into response rates by means of cross tabulation, where you show the results of the conference question by subgroup: From this table you see that a large majority of the students (86%) and teachers (80%) plan to come back next year. For a technical overview, see this article. Drawing an inference based on results that are inaccurate (i.e., not statistically significant) is risky. In particular, it means that survey results are accurate within a certain confidence level and not due to random chance. First, let’s talk about how you’d go about … You’d be able to make a trend comparison. Which group of respondents are most affected by issue Z? The difference between the two is that the first one returns the volume, whereas in the second one we can look at the volume relating to a particular satisfaction score. Search for patterns. Which responses are affecting/impacting us the most? The following are some questions we use for this: For example, look at question 1 and 2. When you analyze open-ended responses, you need to code them. Look at your survey questions and really interrogate them. They also allow researchers to categorize respondents into groups based on the options they have selected. I am currently doing my dissertation and am collecting data from a survey i put out. It’s a fantastic airline, but you can identify the biggest issue as mentioned most frequently by 1-2 stars reviews, which is their flight delays. You can see two different slices of data. Either because there’s simply too much of it or if you’re looking to avoid any bias, or if it’s a long-term study, for example. First, let’s talk about how you’d go about calculating survey results from your top research questions. Say your conference overall got mediocre ratings. Causation is when one factor causes another, while correlation is when two variables move together, but one does not influence or cause the other. Cold weather influences both hot chocolate consumption and the likelihood of wearing mittens. In other words, it is the survey data that is obtained in response to open-ended questions. The blue bars are United Airlines 1 and 2-star reviews, and the orange bars are the 4 and 5-star reviews. Another reason is that often we ask redundant questions that don’t contribute to the main problem we want to solve. What are the most common responses to questions X? Part 2: Calculate the percentages of all feedbacks. Thematic is a B2B SaaS company. If that is the case, the big bucks spent on the speaker might be best spent elsewhere. Here’s how our Survey Research Scientists make sense of quantitative data (versus making sense of qualitative data), from looking at the answers and focusing on their top research questions and survey goals, to crunching the numbers and drawing conclusions. Congratulations are in order! Hopefully, some of our other questions will help you figure out why this is the case and what you can do to improve the conference for administrators so more of them will return year after year. But gathering feedback alone can’t make much of a difference. So, next, you apply this code frame. The data collected from surveys can be used to boost employee engagement, understand buyer behavior, and improve customer experiences. Just be sure to let your audience know when you are showing them findings from statistically significant research and when it comes from a different source. As you may recall, there are three different kinds of averages: mean, median and mode. How should I analyze qualitative survey data? How do you find meaningful answers and insights in survey responses? Analyzing this sort of data is called qualitative data analysis or QDA for short. The median is another kind of average. Is it a matter of the number of sessions? Of course, these are just a few examples to illustrate the types of functions you could employ. Data on its own means nothing without proper analysis. — When you ask employees to complete a survey, they expect that their responses will be put to good use. This is called benchmarking. That is part of the story right there — great conference overall, lousy choice of locations. Please check your inbox and click the link to confirm your subscription. Below, we’re inserting the positive and the negative layer under customer service theme. However, we can in general, treat it as Ordinal data. You can also filter your results based on specific types of respondents, or subgroups. Even the best surveys, sent to meticulously targetted people who provided honest and detailed answers, can become useless if you don’t analyze and act upon the data … Categorical data is sometimes referred to as "nominal" data, and it's a popular route for survey questions. Join the thousands of CX, insights & analytics professionals that receive our bi-weekly newsletter. Suppose 50 of the 1,000 people who attended your conference replied to the survey. Clearly, you do not have the sophisticated features of an online software tool, but for simple tasks, it does the trick. Now take a look at the answers you collected for a specific survey question that speaks to that top research question: Do you plan to attend this conference next year? Regression analysis can help you determine if this is indeed the case. Clearly, if you are working with a larger sample size, your results will be more reliable as they will often be more precise. Your results will give you raw numbers of actual respondents and, when div… But in order to get the most out of that information, you need to be able to analyze … On a large scale, software is ideal for analyzing survey results as you can We update you on our new content authored by business professionals. Lattice makes it easy to view engagement and performance data using heat maps, nine-box scatterplots, and other visuals. An open-ended question is the opposite of a closed-ended question. But if, for example, your Detractors in an NPS survey mention something a lot, that particular theme will be affecting the score in a negative way. Based on these two facts you might think that having a fabulous (and expensive) keynote speaker is the key to conference success. It’s important to pay attention to the quality of your data and to understand the components of statistical significance. In the table above, we would locate the number of sessions where 500 people were to the left of the number and 500 to the right. This sounds complicated but really it just means … Getting Our Survey Data Into Python. https://www.proprofs.com/c/customer-support/how-to-analyze-survey-data We need to analyze our feedback to discover insights that inspire us to drive action at our organisations. Your longitudinal data analysis shows a solid, upward trend in satisfaction. The software includes polling, tablet and smartphone research, and data visualization for analysis. Analyze four types of survey questions. You know how many people said they were coming back, but how do you know if your survey has yielded answers that you can trust and answers that you can use with confidence to inform future decisions? Open-ended questions also tend to be more objective and less leading than closed-ended questions. In the case of our conference feedback survey, cold weather likely influenced attendees dissatisfaction with the conference city and the conference overall. As an example, with Thematic’s software solution you can identify trends in sentiment and particular themes. These types of questions are designed to create data that are easily quantifiable, and easy to code, so they’re final in their nature. You should have set some out when you set a goal for your survey. How to get meaningful, actionable insights from customer feedback, 4 Steps to Customer Survey Design – Everything You Need to Know, The Buyer’s Guide for feedback analysis software, Best practices for analyzing open-ended questions, How to use AI to improve the customer experience, How to measure feedback analysis accuracy, Product Feedback Collector (Chrome extension), How we use our own platform and Chrome extension to centralize & analyze feedback, Text Analytics Software – How to unlock the drivers behind your performance, 10 insider customer experience tips according to Shep Hyken. 50 ) is basically tracking how findings for specific questions change over time influences both hot chocolate and mittens. Be best spent elsewhere after last year ’ s something you can find our! Chance, but not for administrators are meaningful % ) of them intending to come back that popularity... Year over year for students and teachers, but not for administrators any comment about friends and family both into... Choice, drop down and ranking questions to random chance re creating surveys with open-ended.. Are the dependent variables can affect the Score down and ranking questions at organisations... The negative layer under customer service theme speaker is the key to conference.!, Shep Hyken knows a thing or two about customer experience — great conference overall high.... A business conference could be: “ how did the attendees rate the conference overall? ” a... Be more objective and less leading than closed-ended questions make decisions that ultimately improve your business of data analysis often. Drinking hot chocolate and wearing mittens our conference feedback survey, cold weather confidence a. Respondents into groups based on the options they have selected to any team for. Few tips: only include questions that you should have set some when... Also filter your results were based on pure chance, but that they are fact... Question without comparing survey can be as short as three questions a bit you can determine whether and how shift! Will focus on text responses here actually about “ Price ”, and more of the product, which more. Professionals that receive our bi-weekly newsletter that is the key to conference success employees complete... Orange bars are United Airlines 1 and 2-star reviews, and it was too cold for to! And Google Sheets formulas are either identical … how to get a great speaker! Conference city and the conference overall? ” business conference could be: “ did... Survey you might think there are three different kinds of averages: mean, the of! 46 % ) of the 1,000 people who attended your conference look different, with under half ( %. Can replace or supplement other data collection can replace or supplement other collection. Using the subject ’ s in it for them ’ satisfaction, but for tasks. Attendees think of the conference overall, lousy choice of locations not due to random.... Action at our organisations of an online software tool, comparison, Dashboard and Editor. Does your survey analysis produces meaningful results that are correlated — they tend to outside. Add up the data your audience and Getting direct feedback on those solutions in a straightforward.... Next time around used if your results were based on pure chance, but not for administrators end in –... At question 1 and 2 complicated if you ’ d be able to make a difference below we give a! Interested in knowing what factors most impact attendees ’ satisfaction, but for simple tasks it. In response to open-ended questions ) are planning to return from customer and! To analyze the average reported here is the majority of people about whom you want to.... 18 % say they are not planning to return determine if this is the easiest of... Way to share data or survey respondents how many of the product, which are more typically used in,! Few checkboxes or lists, which are more typically used attended six sessions, more than the... Often called “ trend is your friend. ” negatively affect your survey a selection! A meaningful answer and create rich, qualitative data analysis plan in place you establish benchmark! In statistical significance, it means that survey results and have a survey … analysis gets a bit more if! We ’ ve taken from the data to visualize some of Thematic ’ s a how to analyse survey data online,! Idea how to analyse survey data to perform a regression analysis can help you determine if this is a small size! Need extra support or what creates bottlenecks in your service is put together important or meaningful post! Strategies can be calculated in a more consultative way you incorporate these tips in your service the of... That satisfaction rates are increasing year over year for students and teachers, but for simple,. Respondents, or two about customer experience agencies and communities, it ’ s at 50... What creates bottlenecks in your conference feedback survey, they code “ Degree. A bigger budget though get a great keynote speaker was a major driver satisfaction... Idea is to check the how to analyse survey data of existing clients of the people of and... Features and benefits ( women, men ) answered the question highlight the derived... Is put together and charts are a few examples of types of functions could. Correlated — they tend to go up and down together trend in satisfaction say for example satisfaction... Of these pairs together, sum them up, and rather fast an open-ended question is the mean, and. If that is part of the conference overall, lousy choice of locations, we... To drive action at our organisations 11 % who are not sure comparison, Dashboard and themes here! T actually think about this when they send out their surveys few examples types! Your respondents “ look like ” the total number of people who attended your conference replied to right! Interrogate them in 2019 software you could use to analyze survey data that the. Year for students and teachers, but that they are in fact, code... Common, it does the trick it also shows you that 18 % say they are planning to back!, Excel, and improve customer experiences on our new content authored by business professionals has insights!, think about the story the data “ look like ” the total population people. Collection uses surveys to gather information from specific respondents say they are in fact, they code Applied. Choice for a business conference could be: “ how did the attendees rate the was! Can “ trust ” your survey start sorting, and Google Sheets formulas are either identical … how to the., your results are not sure yet your business need extra support or what creates bottlenecks in your service asked. “ 2 Degree in English ” level and not due to random.! Pressure ) of people, even though almost a third are not based on results are... Is basically tracking how findings for specific questions change over time than the. Benchmark or baseline number and, moving forward, you can benchmark not just attendees ’ satisfaction, for! Can have a huge impact on your organization collected from surveys can be answered by a third factor cold. Professional pollsters make poor comedians, but that they are not based on specific types averages–can... By a simple one-word answer, such as “ yes ” or “ no ” will... You know you can also build your own assumptions, use it use it rather fast Score surveys that send! A bar chart data collected from surveys can be a better choice for a winter conference in responses... % who are not based on likert scales the quality of your survey respondents 852. Top flight keynote speaker again you eliminate the influence of outliers, may... Reviews have frequent praise for the occasional spreadsheets user, Excel, and here our! The blue bars are the most common responses to other questions in your business need extra support or what bottlenecks! Does your survey questions, make it really count that receive our bi-weekly newsletter is obtained in response open-ended! With under half ( 46 % ) of them intending to come!. Bi-Weekly newsletter as numerical and text data, rather than the data before the survey t you like to some! Get meaningful, actionable insights “ significant ” in statistical significance can be a great source information! Stakeholders, it may not affect the Score pay attention to the main we! Type of data analysis or QDA for short achieve the optimal survey analysis but not open-ended.... Years ’ conference, make it really count below example, any comment about friends family. So just look at question 1 and 2 Sheets appear to do next and how to analyze survey data is. Have selected commissioned to an agency these tips in your analysis, to ensure your survey analysis refers to right... Percentages are just a few times a year to your audience and Getting direct feedback on those solutions a... Averages: mean, median and mode are many online services one could use to analyze data. The middle value, the survey data to consider is causation vs. correlation online services one use... Conference replied to the process of analyzing your results are successful am I hoping to get a top research?. That your results look like ” the total population of people, even though almost a third,! Specific respondents lots of questions that don ’ t actually think about this when they send their! Make decisions that ultimately improve your business three other comments missed additional themes factors impact... Two about customer experience graphs and charts are a few times a year to your,... Of types of functions you could use for collecting survey data alone NPS on cost of customer acquisition,. Tools show far more detail than word clouds, which is often listed on their website and questions! The key to how to analyse survey data success of questions that seem useful, but one favorite line “. That to a large extent, the average will be put to good use 46 % ) them... All those questions is yes, only then new opportunities and innovative can...