Questions with ordinal response categories – those with an underlying order (e.g., excellent, good, only fair, poor OR very favorable, mostly favorable, mostly unfavorable, very unfavorable) – are generally not randomized because the order of the categories conveys important information to help respondents answer the question. Generally, these types of scales should be presented in order so respondents can easily place their responses along the continuum, but the order can be reversed for some respondents. For example, in one of the Pew Research Center’s questions about abortion, half of the sample is asked whether abortion should be “legal in all cases, legal in most cases, illegal in most cases, illegal in all cases” while the other half of the sample is asked the same question with the response categories read in reverse order, starting with “illegal in all cases.” Again, reversing the order does not eliminate the recency effect but distributes it randomly across the population.

Lastly, because slight modifications in question wording can affect responses, identical question wording should be used when the intention is to compare results to those from earlier surveys (see measuring change over time for more information). Similarly, because question wording and responses can vary based on the mode used to survey respondents, researchers should carefully evaluate the likely effects on trend measurements if a different survey mode will be used to assess change in opinion over time (see collecting survey data for more information).

Being a survey taker is an important job, your contribution helps ensure that the needs of customers, like yourself, are met. Your ideas can help countless product development projects and improve the range of great products in the future. Don’t wait any longer, your opinion is valuable and you could stand to make good money by taking paid surveys at home.
What Employees Say: “VIPKID pays between $14-22 an hour, plus more in incentives some months. Most kids are fun and well behaved. You create your own schedule and work as little or much as you want. The materials are already provided, you just have to review them beforehand and plan out how you want to teach the materials and which props you want to use.” —Current ESL Teacher
Companies, brands, and organizations from around the globe are constantly seeking the opinions of people just like you to help shape the products they develop and how they market them. They count on paid online surveys to provide them with reliable information. If you spend time online and enjoy giving your opinion, paid surveys are a great way to earn a little extra cash while helping these companies.
×