Questions with ordinal response categories – those with an underlying order (e.g., excellent, good, only fair, poor OR very favorable, mostly favorable, mostly unfavorable, very unfavorable) – are generally not randomized because the order of the categories conveys important information to help respondents answer the question. Generally, these types of scales should be presented in order so respondents can easily place their responses along the continuum, but the order can be reversed for some respondents. For example, in one of the Pew Research Center’s questions about abortion, half of the sample is asked whether abortion should be “legal in all cases, legal in most cases, illegal in most cases, illegal in all cases” while the other half of the sample is asked the same question with the response categories read in reverse order, starting with “illegal in all cases.” Again, reversing the order does not eliminate the recency effect but distributes it randomly across the population.
The site will even allow you to monetise your internet searches, if you swap from Google or Safari to their own search engine. The Swagbucks search engine, which is actually running Yahoo, will pay you Swagbucks every time you search. For games, there are options like Scrabble and Wheel of Fortune, which won’t pay you much, but could be worth a go if you fancied playing a game anyway! Swagbucks TV allows you to watch advertising videos on a range of topics, including news, fitness and entertainment. There’s a snag – your earnings are capped at 150 Swagbucks, but it is worth a look if you’re prone to wasting time watching viral clips.
One other challenge in developing questionnaires is what is called “social desirability bias.” People have a natural tendency to want to be accepted and liked, and this may lead people to provide inaccurate answers to questions that deal with sensitive subjects. Research has shown that respondents understate alcohol and drug use, tax evasion and racial bias; they also may overstate church attendance, charitable contributions and the likelihood that they will vote in an election. Researchers attempt to account for this potential bias in crafting questions about these topics. For instance, when Pew Research Center surveys ask about past voting behavior, it is important to note that circumstances may have prevented the respondent from voting: “In the 2012 presidential election between Barack Obama and Mitt Romney, did things come up that kept you from voting, or did you happen to vote?” The choice of response options can also make it easier for people to be honest; for example, a question about church attendance might include three of six response options that indicate infrequent attendance. Research has also shown that social desirability bias can be greater when an interviewer is present (e.g., telephone and face-to-face surveys) than when respondents complete the survey themselves (e.g., paper and web surveys).
There’s a decent rate of surveys pinged your way as you can expect two or three emails a day inviting you to fill in particular questionnaires. In addition to this, there are freely offered surveys on their cleanly designed website each day which you can look through and decide if they take your fancy. Surveys on CashCrate are often outsourced to third parties though, so you can make more money on the survey side from other websites. Similarly they are known for passing your information on to other people, so to avoid the irritations of endless spam, make sure you set up a dedicated email address for your CashCrate account.
Taking paid surveys can become a well paying job if you work hard enough at it but you won’t start bring in buckets of money right from the start. But don’t let that demotivate you to start taking paid surveys. In the beginning you don’t have control over the survey offers you receive, but if you keep at it then after some time your per-survey-rate will go up as you become a more reliable source for paid survey companies. Then you’ll be surprised how much extra money you can make without putting in very much effort at all.
You build your surveys online, relying on a simple interface that lets you type in your question and then pick the answer type. After you deploy the survey to your team's mobile devices, it's displayed full-screen with beautiful background images and large touch-ready buttons. You can then collect responses directly on your iOS and Android devices, and have them show up automatically in LoopSurvey's web app back in the office.
Kwik Surveys lets you fully export your results in multiple file types, meaning you can analyze your results in Excel or statistics software of choice. Why does this matter? Instead of just seeing your overall results, you can manipulate the data and get useful insights by testing for significance or putting related questions together in crosstabs. Kwik Surveys will clear your data after six months, so exporting is key if you want to keep a record of the surveys you’ve already run.
A questionnaire, like a conversation, should be grouped by topic and unfold in a logical order. It is often helpful to begin the survey with simple questions that respondents will find interesting and engaging to help establish rapport and motivate them to continue to participate in the survey. Throughout the survey, an effort should be made to keep the survey interesting and not overburden respondents with several difficult questions right after one another. Demographic questions such as income, education or age should not be asked near the beginning of a survey unless they are needed to determine eligibility for the survey or for routing respondents through particular sections of the questionnaire. Even then, it is best to precede such items with more interesting and engaging questions.
On the other hand, working with some other products was less pleasant even though they included strong feature sets. These included the powerful Checkbox Survey and the midrange Outside Software eSurveysPro and Toluna QuickSurveys, the latter of which is offered by and integrated with the global survey consumer panel of Toluna. WorldApp KeySurvey, while not as awkward as some of these other products, could do much to modernize its UI. However, it has some redeeming features geared toward enterprise users, such as advanced administrative access control, in-depth and customized panelist management, and a strong focus on reuse.
This is another area where large, often tech-focused, companies are consistently looking to hire remote workers. Like with customer service agents, tech support specialists are focused on answering customer questions and solving their problems. However, tech support is more specialized, so it does require a little knowledge about working with the product.
One kind of order effect can be seen in responses to open-ended questions. Pew Research surveys generally ask open-ended questions about national problems, opinions about leaders and similar topics near the beginning of the questionnaire. If closed-ended questions that relate to the topic are placed before the open-ended question, respondents are much more likely to mention concepts or considerations raised in those earlier questions when responding to the open-ended question.
Design and pre-test questionnaires: Designing the questionnaire carefully and then pre-testing it before fielding it to your entire sample is crucial to getting data that are valid and reliable. For example, careful questionnaire design and pre-testing can help reduce the chance that respondents may interpret the meaning of questions differently. Future posts in this series will tackle these important steps in much greater detail.