Congratulations go to Panel Place, which gets 2nd place on the Survey Cool list of the best paid survey sites for 2018, but just what makes it so good? Above all else is the fact that it has a very large number of surveys to choose from, so there really is something for everyone. It does this because it includes surveys available from a variety of other top survey providers, including Toluna and Valued Opinions. It’s available to users across the world as well, and payment can be made by way of a gift card or sent securely to a PayPal account. It’s a deserving number one.
Design and pre-test questionnaires: Designing the questionnaire carefully and then pre-testing it before fielding it to your entire sample is crucial to getting data that are valid and reliable. For example, careful questionnaire design and pre-testing can help reduce the chance that respondents may interpret the meaning of questions differently. Future posts in this series will tackle these important steps in much greater detail.

Some products also include display logic, which is the ability to show or hide a question or section of a survey based on conditions that occurred before it. This can require far less upfront planning, although a few products in our review roundup implemented it very poorly, preventing question order from changing after setting it up. On the other hand, some packages that can accommodate particularly long and complex surveys can divide questions into sets or blocks; this can make it much easier to keep track of questions that pertain to a similar subtopic, for example.
And lastly, let's discuss privacy.  In some ways, Pinecone Research gets it right – they use the information to verify you are not a duplicate or in any way defrauding them out of a valuable opinion.  After that, they only use your personal information for developing metrics and usage statistics – not giving it out to every third party that comes along.  More importantly, they take consumer information privacy seriously.  When they compile their reports for their clients, they scrub all data of any identifying information.
Another way survey packages can make it easier to track different groups of respondents is via multiple "collector" links. These are simply different links to the same survey that can be broken out in analysis later. For example, if you wanted to field a survey to both Facebook and Twitter users, then posting different collector links on each network would let you track from which social network different respondents came.
Because of concerns about the effects of category order on responses to closed-ended questions, many sets of response options in Pew Research Center’s surveys are programmed to be randomized (when questions have two or more response options) to ensure that the options are not asked in the same order for each respondent. For instance, in the example discussed above about what issue mattered most in people’s vote, the order of the five issues in the closed-ended version of the question was randomized so that no one issue appeared early or late in the list for all respondents. Randomization of response items does not eliminate order effects, but it does ensure that this type of bias is spread randomly.

This site offers surveys for money, paying out cash rather than points and allowing immediate rewards. Crowdology is a pretty popular website with a decent reputation which works with big brands and television shows, so can have some interesting content to keep you interested while you’re filling in forms. You could be answering questions about everyday topics or issues, such as saving money or online shopping, as well as your opinions about various products.

Another experiment embedded in a December 2008 Pew Research poll also resulted in a contrast effect. When people were asked “All in all, are you satisfied or dissatisfied with the way things are going in this country today?” immediately after having been asked “Do you approve or disapprove of the way George W. Bush is handling his job as president?”; 88% said they were dissatisfied, compared with only 78% without the context of the prior question. Responses to presidential approval remained relatively unchanged whether national satisfaction was asked before or after it. A similar finding occurred in December 2004 when both satisfaction and presidential approval were much higher (57% were dissatisfied when Bush approval was asked first vs. 51% when general satisfaction was asked first).

This is a good option if you’re asking basic questions and only need to use multiple choice, multi-select, and open-answer formats. The answer options can be randomized, making your results more reliable by combating any selection bias that might be hidden in the answer order. The lack of page or question logic, however, makes it harder to ask follow-up questions.

Unlike many sites, Valued Opinions doesn’t offer you the chance to take cash rewards, at the moment limiting users to retail vouchers and gift cards. Electronic vouchers are usually with you within 24 hours but gift cards can take four to six weeks to arrive in the post. Once $10 has been earned, you can claim Amazon vouchers, Macy’s gift cards and Visa promo codes, among many other reward options dependant on your location. Surveys are said to be varied, but the gift card options less so, so check they are for stores you’ll want to shop in before you tot up lots of points.
One of the most common formats used in survey questions is the “agree-disagree” format. In this type of question, respondents are asked whether they agree or disagree with a particular statement. Research has shown that, compared with the better educated and better informed, less educated and less informed respondents have a greater tendency to agree with such statements. This is sometimes called an “acquiescence bias” (since some kinds of respondents are more likely to acquiesce to the assertion than are others). A better practice is to offer respondents a choice between alternative statements. A Pew Research Center experiment with one of its routinely asked values questions illustrates the difference that question format can make. Not only does the forced choice format yield a very different result overall from the agree-disagree format, but the pattern of answers among better- and lesser-educated respondents also tends to be very different.
The site will even allow you to monetise your internet searches, if you swap from Google or Safari to their own search engine. The Swagbucks search engine, which is actually running Yahoo, will pay you Swagbucks every time you search. For games, there are options like Scrabble and Wheel of Fortune, which won’t pay you much, but could be worth a go if you fancied playing a game anyway! Swagbucks TV allows you to watch advertising videos on a range of topics, including news, fitness and entertainment. There’s a snag – your earnings are capped at 150 Swagbucks, but it is worth a look if you’re prone to wasting time watching viral clips.

Design and pre-test questionnaires: Designing the questionnaire carefully and then pre-testing it before fielding it to your entire sample is crucial to getting data that are valid and reliable. For example, careful questionnaire design and pre-testing can help reduce the chance that respondents may interpret the meaning of questions differently. Future posts in this series will tackle these important steps in much greater detail.
×