/*! This file is auto-generated */ .wp-block-button__link{color:#fff;background-color:#32373c;border-radius:9999px;box-shadow:none;text-decoration:none;padding:calc(.667em + 2px) calc(1.333em + 2px);font-size:1.125em}.wp-block-file__button{background:#32373c;color:#fff;text-decoration:none} Problem 47 Wording Survey Questions. Commen... [FREE SOLUTION] | 91Ó°ÊÓ

91Ó°ÊÓ

Wording Survey Questions. Comment on each of the following as a potential sample survey question. Is the question sufficiently clear? Is it slanted toward a desired response? a. "In light of increasing threats from climate change, we should decrease our dependence on fossil fuels. Do you agree or disagree?" b. "Do you agree that a national system of health insurance should be favored because it would provide health insurance for everyone and would reduce administrative costs?" c. "In view of the negative externalities in parent labor force participation and pediatric evidence associating increased group size with morbidity of children in day care, do you support government subsidies for day care programs?"

Short Answer

Expert verified
All questions contain some bias or unclear language and should be revised for clarity and neutrality.

Step by step solution

01

Analyze Sentence Structure

Review the clarity of the question for each survey question. Consider whether any complex language or structure might confuse the respondent.
02

Identify Potential Bias

Examine each question for loaded words or phrases that might influence the respondent to answer in a particular way.
03

Assess for Simplification

Determine if complex terms or ideas could be simplified or rephrased to enhance clarity without sacrificing meaning.
04

Step 1a: Evaluate Clarity of Question A

The question is generally clear but uses the phrase 'increasing threats from climate change,' which might assume all respondents agree that there is a significant and increasing threat.
05

Step 2a: Evaluate Bias in Question A

The phrase 'increasing threats from climate change' could lead respondents to feel there is a pressing need for a response, possibly biasing their answer toward 'agree.'
06

Step 1b: Evaluate Clarity of Question B

This question is somewhat clear but includes a long structure with information that might overwhelm the reader initially.
07

Step 2b: Evaluate Bias in Question B

The reason given ('because it would provide health insurance for everyone and reduce costs') leans toward mostly positive outcomes, potentially encouraging agreement.
08

Step 1c: Evaluate Clarity of Question C

This question is complex and difficult to understand due to technical terms and dense phrasing that may not be easily grasped without prior knowledge.
09

Step 2c: Evaluate Bias in Question C

It presents a negative view of daycare ('negative externalities...increased group size with morbidity'), which could bias the response towards not supporting subsidies.
10

Final Review

Revise each question to ensure clarity without biased language if the goal is to receive unbiased responses from a survey.

Unlock Step-by-Step Solutions & Ace Your Exams!

  • Full Textbook Solutions

    Get detailed explanations and key concepts

  • Unlimited Al creation

    Al flashcards, explanations, exams and more...

  • Ads-free access

    To over 500 millions flashcards

  • Money-back guarantee

    We refund you if you fail your exam.

Over 30 million students worldwide already upgrade their learning with 91Ó°ÊÓ!

Key Concepts

These are the key concepts you need to understand to accurately answer the question.

Question Clarity
Well-designed survey questions need to be clear and straightforward. By doing this, respondents can easily understand and provide accurate answers. Survey questions should avoid complicated language or assumptions about what respondents know.
For instance, technical jargon can confuse respondents, leading to unclear answers. Consider Question C from the original exercise: "In view of the negative externalities in parent labor force participation and pediatric evidence associating increased group size with morbidity of children in day care, do you support government subsidies for day care programs?"
  • This question is cluttered with technical terms and complex structures.
  • Such complexity is likely to be unclear to many respondents.
To improve clarity, simple, direct language should be employed. For example, the question could be rephrased as, "Do you think the government should fund daycare programs?" By stripping unnecessary complexity, we can help ensure respondents fully understand the prompt.
Biased Survey Questions
Biased survey questions often occur when particular words or phrases lead respondents toward a certain answer. This affects the objectivity of the collected data. Words implying urgency or certain emotions can unintentionally lead the audience. Take Question A from the original exercise: "In light of increasing threats from climate change, we should decrease our dependence on fossil fuels. Do you agree or disagree?"
  • The phrase "increasing threats" implies an urgent situation that could sway opinions.
  • This makes respondents more likely to agree, considering the pressure.
To reduce bias, survey questions should be neutral and refrain from nudging respondents toward a particular answer. For example, instead of implying a threat, a more neutral version might be, "What are your views on the use of fossil fuels?" A question like this helps gather opinions without bias.
Survey Question Simplification
Keeping survey questions simple facilitates better comprehension and improves response accuracy. In Question B from the original exercise, "Do you agree that a national system of health insurance should be favored because it would provide health insurance for everyone and would reduce administrative costs?"
  • This is a long and multi-idea sentence.
  • Multiple ideas in one question can overwhelm the respondent.
To simplify, separate the question into simpler parts or remove extraneous details. For instance, ask: "Should there be a national health insurance system?" and "Do you think it would reduce administrative costs?" Operating with clear and specific questions helps respondents focus on one idea at a time.
Survey Respondent Bias
Respondent bias arises when external factors influence the answers given. Awareness of such biases can help in crafting better survey questions. One common form of bias is the influence of social desirability. Respondents often answer in a manner they perceive is socially acceptable. In some cases, respondents might alter their answers based on the question's framing or perceived intention of the survey. An overly technical or strongly worded question could elicit answers fitting what respondents think the surveyor wants.
  • Be wary of leading language.
  • Use neutral wording to avoid influencing.).
Gathering impartial information involves ensuring that questions are neutral in tone, encourage honest responses, and are free from emotional language or complex assumptions. This helps capture true respondent perspectives.

One App. One Place for Learning.

All the tools & learning materials you need for study success - in one app.

Get started for free

Most popular questions from this chapter

How A ccurate Is the Poll? A Pew Research Center survey called Teens, Social Media \& Technology in the spring of 2018 included 743 teens, of which 355 were White, nonHispanic; 129 were Black, non-Hispanic; 202 were Hispanic; and 57 were other races or ethnic groups. Each teen sampled was asked about technology usage, including access to mobile devices, online platform usage, views on social media, and video game playing. The margin of error (we will give more detail in later chapters) was reported as \(\pm 5.0 \%\) for the entire sample. When considering technology usage of only the Hispanic teens, the margin of error was reported as \(\pm 9.5 \% .4\) What do you think explains the fact that estimates for Hispanic teens were less precise than for the entire sample?

SurveyMonkey. In 2019, the New York Times conducted an }}\( online poll using SurveyMonkey to determine how people felt about their financial situation. SurveyMonkey is a free online survey development service and also provides a "pro" option with fees based on additional features. The survey was conducted October 7-13, and one question was "Now looking ahead - do you think that a year from now you and your family will be better off financially, worse off financially, or just about the same as now?" A total of 2701 people answered the survey, and \)85 \%$ answered the same or better. a. Here is what the New York Times says about the survey methodology: "This SurveyMonkey online poll was conducted October 7 through 13, 2019 among a national sample of 2701 adults. Respondents for this survey were selected from the more than 2 million people who take surveys on the SurveyMonkey platform each day. Data were weighted for age, race, sex, education, and geography using the Census Bureau's American Community Survey to reflect the demographic composition of the United States." 18 What concerns do you have about whether the results of this survey represent the opinions of all U.S. adults? b. What groups of U.S. adults are likely to be underrepresented by this survey?

Ring-no-answer. A common form of nonresponse in telephone surveys is "ring-no- answer." That is, a call is made to an active number, but no one answers. The Italian National Stat istical Institute looked at nonresponse to a government survey of households in Italy during the periods January 1 to Easter and July 1 to August 31 . All calls were made between 7 and 10 P. M., but \(21.4 \%\) gave "ring-no-answer" in one period versus \(41.5 \%\) "ring-no-answer" in the other period. 30 Which period do you think had the higher rate of no answers? Why? Explain why a high rate of nonresponse makes sample results less reliable.

The National Health and Nutrition Examination Study (NHANES) had a random sample of 9317 participants recall their diet over the past 24 hours. The information in this sample was used in a recent study that found that, on average, \(57.9 \%\) of the calories eaten by participants were obtained from ultra-processed foods that include substances not used in culinary preparations, such as flavors, colors, sweeteners, emulsifiers, and other additives. One of the limitations of the study reported by the authors was the dependence on the dietary recall of individuals. \(\underline{20}\) The authors were concerned with a. response bias. b. undercoverage. c. overstratification.

More on Random Digit Dialing. By mid-2017, about \(53.9 \%\) of adults lived in households with a cell phone and no landline phone. Among adults aged 25-29, this percentage was about \(73.3 \%\), while among adults over 65 , the percentage was only \(23.9 \% .\) a. Write a survey question for which the opinions of adults with landline phones only are likely to differ from the opinions of adults with cell phones only. Give the direction of the difference of opinion. b. For the survey question in part (a), suppose a survey were conducted using random digit dialing of landline phones only. Would the results be biased? What would be the direction of bias? c. Most surveys now supplement the landline sample contacted by RDD with a second sample of respondents reached through random dialing of cell phone numbers. The landline respondents are weighted to take account of household size and number of telephone lines into the residence, whereas the cell phone respondents are weighted according to whether they were reachable only by cell phone or also by landline. Explain why it is important to include both a landline sample and a cell phone sample. Why is the number of telephone lines into the residence important? (Hint: How does the number of telephone lines into the residence affect the chance of the household being included in the RDD sample?)

See all solutions

Recommended explanations on Math Textbooks

View all explanations

What do you think about this solution?

We value your feedback to improve our textbook solutions.

Study anywhere. Anytime. Across all devices.