One kind of order effect can be seen in responses to open-ended questions. Pew Research surveys generally ask open-ended questions about national problems, opinions about leaders and similar topics near the beginning of the questionnaire. If closed-ended questions that relate to the topic are placed before the open-ended question, respondents are much more likely to mention concepts or considerations raised in those earlier questions when responding to the open-ended question.
For participants, it's important to realize that paid online surveys have become a haven for Internet scam artists. Participants in online surveys should be aware that there are many unscrupulous middlemen out there who purport to sell proprietary lists of online survey companies that will help you "Earn $3000 a month!" while "Working from home!" Many of these middlemen charge a registration fee for accessing their lists, which are in fact freely available through simple a Google search.
Now that you've picked an app to build your survey, and have put together the questions you need answered, there's one more thing you need: automation. Your new survey builder is likely great, with dashboards and notifications and reports and more. But chances are, you'll want something more—better ways to analyze your data, follow up with people who filled out your survey, and automatically send your survey to your new customers.
When asking closed-ended questions, the choice of options provided, how each option is described, the number of response options offered and the order in which options are read can all influence how people respond. One example of the impact of how categories are defined can be found in a Pew Research poll conducted in January 2002: When half of the sample was asked whether it was “more important for President Bush to focus on domestic policy or foreign policy,” 52% chose domestic policy while only 34% said foreign policy. When the category “foreign policy” was narrowed to a specific aspect – “the war on terrorism” – far more people chose it; only 33% chose domestic policy while 52% chose the war on terrorism.
One other challenge in developing questionnaires is what is called “social desirability bias.” People have a natural tendency to want to be accepted and liked, and this may lead people to provide inaccurate answers to questions that deal with sensitive subjects. Research has shown that respondents understate alcohol and drug use, tax evasion and racial bias; they also may overstate church attendance, charitable contributions and the likelihood that they will vote in an election. Researchers attempt to account for this potential bias in crafting questions about these topics. For instance, when Pew Research Center surveys ask about past voting behavior, it is important to note that circumstances may have prevented the respondent from voting: “In the 2012 presidential election between Barack Obama and Mitt Romney, did things come up that kept you from voting, or did you happen to vote?” The choice of response options can also make it easier for people to be honest; for example, a question about church attendance might include three of six response options that indicate infrequent attendance. Research has also shown that social desirability bias can be greater when an interviewer is present (e.g., telephone and face-to-face surveys) than when respondents complete the survey themselves (e.g., paper and web surveys).
First, thank you for providing this extensive list. I wanted to offer a quick follow up. After reading your post I decided to give Survey Junkie a try and I’ve already closed the account. Yes, I can tell it’s well organized and it is definitely a user-friendly platform. The problems I experienced were first that not one of the surveys they emailed me about were available. I did, however, complete several surveys from the site itself and I found them to be lengthy – in itself, not a problem but 3 out of 5 told me I didn’t qualify after I’d already invested 10 – 12 minutes filling out the forms. They got more than enough information from me to be useful which is an old and highly unethical trick in market research – which happens to be my background. All in all a LOT of wasted time.
I also recommend FlexJobs for finding more home data entry jobs. With that site, you can regularly search legitimate work at home jobs for data entry and other industries. Every job lead is guaranteed scam-free, and it's the only membership-based jobs site I currently use and trust. Their listings are updated 5-6 times per week, and they are plentiful. You can currently get 30% off a subscription using promo code AFFILPROMO.
Free to join, the site runs a range of special offers, including awarding prizes at random, giving you daily targets to hit for which you receive bonus points, and posting deals on their social media feeds. They have a great new app and a strong referral scheme. However, like everything, it’s not perfect – it can start to suck up a lot of your time. Swagbucks runs on the premise of incentivising day to day internet use to make both you and them money, so it is worth being aware of this so it doesn’t end up seeping into too much of your life!
I created my first survey in your app in just 15 minutes. I’m a musician and was polling my fans on a selection of songs for my next album. I shared the survey via Facebook and also printed it out to hand out. The Results Section made it simple to summarize all the votes and gave me the demographic info I was looking for as well. I shared the results with my fans and am now busy recording the twelve songs for my next album. Thanks, SurveyPlanet!
Referral program: Referral programs are a common aspect of thousands of websites as they are a great way to get new registered members. As you may already know, some of the biggest e-commerce giants as well as other companies offer rewards and bonuses to users for referring their website to their friends and family. All you have to do is subscribe to their referral program and share a link to your friends.
IOCS is a not-for-profit research organization that conducts studies and experiments on shopping-related behavior – things like how we, as consumers, evaluate products, how we make the buying decisions, etc. Although the focus is mostly on shopping related behavior, some of their experiments and studies include broader areas of marketing, psychology, and economics.
Of course, it’s not always easy to increase your income. Your employer might hate giving raises, for example, or maybe overtime at work has become scarce. If that’s the case, you might need to pick up a part-time job, start a side hustle from home, or look for unorthodox ways to earn money in your spare time. Check out our post on how to become an Uber driver, this is a great side hustle because you can make your own schedule and pick up extra cash when its convenient for you.
When measuring change over time, it is important to use the same question wording and to be sensitive to where the question is asked in the questionnaire to maintain a similar context as when the question was asked previously (see question wording and question order for further information). All of our survey reports include a topline questionnaire that provides the exact question wording and sequencing, along with results from the current poll and previous polls in which the question was asked.