91Ó°ÊÓ

The paper "The Effect of Multitasking on the Grade Performance of Business Students" (Research in Higher Education Journal [2010]: 1-10) describes an experiment in which 62 undergraduate business students were randomly assigned to one of two experimental groups. Students in one group were asked to listen to a lecture but were told that they were permitted to use cell phones to send text messages during the lecture. Students in the second group listened to the same lecture but were not permitted to send text messages during the lecture. Afterwards, students in both groups took a quiz on material covered in the lecture. The researchers reported that the mean quiz score for students in the texting group was significantly lower than the mean quiz score for students in the no-texting group. In the context of this experiment, explain what it means to say that the texting group mean was significantly lower than the no-text group mean. (Hint: See discussion on page 578 )

Step by step solution

01

Understanding the Experiment

In the experiment, 62 undergraduate business students were split into two groups. One group was allowed to text during the lecture, while the other wasn't. After the lecture, all students took a quiz, and it was reported that the texting group scored 'significantly lower' than the no-texting group.

02

Meaning of 'Significantly Lower'

In a statistical context, 'significantly lower' doesn't just mean that the scores were lower. It implies that given the framework of the study, the probability of observing such a difference if there actually was no difference (i.e., if texting had no impact on quiz scores) is very small. This concept is known as the p-value.

03

Explanation of Significance

For the mean quiz score of the texting group to be significantly lower than the no-texting group, the p-value of this outcome would need to be less than a pre-defined level, usually 0.05 (5%). If the p-value is less than this threshold, the result is deemed statistically significant, and we reject the possibility that there was no effect. In this experiment, that would mean we reject the idea that texting has no impact on students' quiz scores. Instead, we would conclude that texting during the lecture does lead to lower quiz scores.

Unlock Step-by-Step Solutions & Ace Your Exams!

• Full Textbook Solutions

  Get detailed explanations and key concepts

• Unlimited Al creation

  Al flashcards, explanations, exams and more...

• Ads-free access

  To over 500 millions flashcards

• Money-back guarantee

  We refund you if you fail your exam.

Over 30 million students worldwide already upgrade their learning with 91Ó°ÊÓ!

Key Concepts

These are the key concepts you need to understand to accurately answer the question.

Statistical Significance

Understanding statistical significance is crucial when interpreting the results of an educational experiment, such as the one where texting's influence on student performance was studied. When researchers say there is a statistically significant difference between two groups (like texters and non-texters), they mean that the observed difference in outcomes – such as quiz scores – is unlikely to have occurred by random chance alone. Typically, we set a benchmark called alpha, often 0.05, which represents a 5% probability threshold. If our test results show a likelihood greater than this threshold, we conclude there's no significant difference. In the context of the texting experiment, statistical significance means the lower quiz scores of students who texted are unlikely to be purely due to chance. Instead, it suggests a real effect of texting behavior on academic performance.

p-value

The concept of a p-value is integral to understanding statistical significance. In simple terms, a p-value helps us determine how likely it is to see the observed results – or anything more extreme – if the null hypothesis were true. In this experiment, the null hypothesis might state that texting during the lecture has no effect on quiz scores. If the resulting p-value from our calculations is less than 0.05, it signals strong evidence against this hypothesis. So, in the study, when researchers report a significantly lower mean score for students who texted, they are saying that with a p-value, possibly less than 0.05, it's improbable the observed score difference happened by chance. This encourages rejection of the null hypothesis, indicating texting does indeed impact performance.

Random Assignment

Random assignment is a foundational principle in experimental design, ensuring unbiased distribution of participants across different groups. When participants are randomly assigned, it strengthens the experiment's power by making each group comparable, minimizing the effects of confounding variables. For instance, in the texting experiment, random assignment helped create two groups that were similar in all aspects but one – permission to text. This ensures that any differences in quiz scores can be more confidently attributed to texting during lectures and not some other factor like prior knowledge or motivation. By employing random assignment, researchers can avoid systemic biases, ensuring that the observed effect on quiz performance truly reflects the variable being studied: the action of texting itself.