Select a representative sample: Selecting a representative sample from your sampling frame is also important for collecting valid and reliable data about the population of interest. For example, if you are sampling from a large database of customer email addresses and only wanted one response per household, you might want to cross-check each email address against mailing addresses and remove duplicates to avoid some households having a greater probability of selection. Then you would likely draw a random sample from the remaining list of email addresses.
While surveys vary widely in how they are conducted and used, there are a number of components that are common across nearly all surveys. Many of these common features have been studied in extensive detail by survey methodologists, psychologists, statisticians, and many other fields of research. The general process of survey research is outlined in the figure below.
Similarly, it is important to consider whether certain words may be viewed as biased or potentially offensive to some respondents, as well as the emotional reaction that some words may provoke. For example, in a 2005 Pew Research survey, 51% of respondents said they favored “making it legal for doctors to give terminally ill patients the means to end their lives,” but only 44% said they favored “making it legal for doctors to assist terminally ill patients in committing suicide.” Although both versions of the question are asking about the same thing, the reaction of respondents was different. In another example, respondents have reacted differently to questions using the word “welfare” as opposed to the more generic “assistance to the poor.” Several experiments have shown that there is much greater public support for expanding “assistance to the poor” than for expanding “welfare.”
“I participated in an in-home product trial study. A coffee machine company sent me one of the coffee makers along with about 200 coffee pods. I received $7 for completing 3 short surveys. Plus, after the study, the company said I could keep the coffee maker. So, I got like 4 mos of coffee for everyone in my household, a free coffee maker and $7!” - David W.