Similarly, it is important to consider whether certain words may be viewed as biased or potentially offensive to some respondents, as well as the emotional reaction that some words may provoke. For example, in a 2005 Pew Research survey, 51% of respondents said they favored “making it legal for doctors to give terminally ill patients the means to end their lives,” but only 44% said they favored “making it legal for doctors to assist terminally ill patients in committing suicide.” Although both versions of the question are asking about the same thing, the reaction of respondents was different. In another example, respondents have reacted differently to questions using the word “welfare” as opposed to the more generic “assistance to the poor.” Several experiments have shown that there is much greater public support for expanding “assistance to the poor” than for expanding “welfare.”
Want an easy way to keep track of who's taken your survey? If you're sending your survey to your existing contacts, or the leads you've been working with in your CRM, then you'll want to note their survey responses right along with their other contact info. Just connect your survey builder to your CRM app—and make sure your survey asks for an email address—and each person's survey answers can show up on their profile in your CRM automatically.
Indeed, these web apps are available with multiple (typically three) pricing plans and generally offer significant discounts if access is paid for one year in advance. A key feature or even question type that the product supports may not be available in a pricing tier that matches your budget even if the survey package supports it. Unfortunately, some products have feature list comparisons among their pricing tiers that are long enough to induce dizziness, so it's worth a call or email inquiry to the company to ensure that a package meets your requirements at a specific plan spending level.
Paid surveys easy to come by so don’t worry if you don’t qualify for some of the paid surveys you sign up for. In some cases you might qualify for a survey but after answering a few questions you are removed from the paid survey. This happens sometimes because the answers you have provided have determined that you do not fit into the target group that the paid survey is designed for. Not to worry though, because there are plenty of paid surveys out there that you are eligible for. It typically only takes a few seconds to determine if you are eligible for a paid survey or not so it won’t waste too much of your time.
Some products also include display logic, which is the ability to show or hide a question or section of a survey based on conditions that occurred before it. This can require far less upfront planning, although a few products in our review roundup implemented it very poorly, preventing question order from changing after setting it up. On the other hand, some packages that can accommodate particularly long and complex surveys can divide questions into sets or blocks; this can make it much easier to keep track of questions that pertain to a similar subtopic, for example.
Alas, while there are elements of Qualtrics that would be of near-universal benefit, only those individuals creating the most sophisticated surveys can justify its off-the-charts cost. Like a full-frame photo professional's digital single-lens reflex (DSLR) camera, Qualtrics is not the best choice for novice online survey designers. It provides very little hand-holding or wizards like other tools do. And at $1,500 per year for its entry-level tier, Qualtrics' pricing begins at about where our No. 2 choice SurveyGizmo's pricing tops off.
Given that its popularity has ascended to the point where it has become practically a generic name for a survey app, I started my reviews with SurveyMonkey as a baseline package. As it turns out, SurveyMonkey has kept up with the competition pretty well over the years, going far beyond the 80/20 rule one might expect for such a broadly used tool. Both SoGoSurvey and particularly SurveyGizmo—a former Editors' Choice—also represent powerful online survey tools that in many ways exceed what SurveyMonkey offers while preserving much of its look and feel. Any of these would be excellent choices for advanced survey designers. I think SurveyGizmo represents the most capable choice, even though SoGoSurvey has made strong recent improvements in its UI.
Assimilation effects occur when responses to two questions are more consistent or closer together because of their placement in the questionnaire. We found an example of an assimilation effect in a Pew Research poll conducted in November 2008 when we asked whether Republican leaders should work with Obama or stand up to him on important issues and whether Democratic leaders should work with Republican leaders or stand up to them on important issues. People are more likely to say that Republican leaders should work with Obama when the question was preceded by the one asking what Democratic leaders should do in working with Republican leaders (81% vs. 66%). However, when people were first asked about Republican leaders working with Obama, fewer said that Democratic leaders should work with Republican leaders (71% vs. 82%).
Define the research question: This is critically important to the success of a survey research project. Without a clearly defined question, it is difficult to determine the best approach for conducting the survey. For example, based on the research question, are the needed data exploratory, descriptive, or causal? The answer to this basic question has huge implications for the entire research process, yet it is often not directly addressed.