Questions with ordinal response categories – those with an underlying order (e.g., excellent, good, only fair, poor OR very favorable, mostly favorable, mostly unfavorable, very unfavorable) – are generally not randomized because the order of the categories conveys important information to help respondents answer the question. Generally, these types of scales should be presented in order so respondents can easily place their responses along the continuum, but the order can be reversed for some respondents. For example, in one of the Pew Research Center’s questions about abortion, half of the sample is asked whether abortion should be “legal in all cases, legal in most cases, illegal in most cases, illegal in all cases” while the other half of the sample is asked the same question with the response categories read in reverse order, starting with “illegal in all cases.” Again, reversing the order does not eliminate the recency effect but distributes it randomly across the population.
An example of a contrast effect can be seen in a Pew Research Center poll conducted in October 2003 that found that people were more likely to favor allowing gays and lesbians to enter into legal agreements that give them the same rights as married couples when this question was asked after one about whether they favored or opposed allowing gays and lesbians to marry (45% favored legal agreements when asked after the marriage question, but 37% favored legal agreements without the immediate preceding context of a question about gay marriage). Responses to the question about gay marriage, meanwhile, were not significantly affected by its placement before or after the legal agreements question.
The Once a Month Meals team uses Zapier's Google Sheets integration for just that. Whenever their SurveyMonkey applicant survey is filled out with, their Zap copies the survey data into different worksheets in the spreadsheet based on types of meals the applicant can cook. Their team can then find cooks for each type of menu just by opening the correct sheet.
Otherwise, almost every survey app will send you email notifications when your survey is filled out, and you can use those to integrate with other apps. Just use the free Zapier Email Parser, or for more advanced features, try Mailparser.io. Forward your emails to the Zapier Email Parser, or add your Zapier Email Parser address as your notifications email in your survey app. Then, teach the Zapier Email Parser which parts of the emails include important survey information.
Something very important to note before signing up at any site claiming to pay you cash to take surveys is that all legitimate sites offering online surveys that pay do not charge registration fees – they are free to join. Some sites may even offer you bonus as you sign in, to show you they are happy you have become a part of their team and helping them increase their revenue.
Taking paid surveys can become a well paying job if you work hard enough at it but you won’t start bring in buckets of money right from the start. But don’t let that demotivate you to start taking paid surveys. In the beginning you don’t have control over the survey offers you receive, but if you keep at it then after some time your per-survey-rate will go up as you become a more reliable source for paid survey companies. Then you’ll be surprised how much extra money you can make without putting in very much effort at all.
Design and pre-test questionnaires: Designing the questionnaire carefully and then pre-testing it before fielding it to your entire sample is crucial to getting data that are valid and reliable. For example, careful questionnaire design and pre-testing can help reduce the chance that respondents may interpret the meaning of questions differently. Future posts in this series will tackle these important steps in much greater detail.