In 500-600 words for each article (1,000-1,200-words total), interrogate each of your articles from Topic 4, using the four big validities. For each article, work through the four big validities in turn, indicating whether the article dopic 4es a good or bad job on each front. As you write, keep in mind that you are demonstrating your mastery of this material! Show that you know how to ask questions about each of the four validities, show that you know what the answers to these questions mean. Finally, show that you understand what it means to prioritize validities as you interrogate a study.

 

 

Examine each of your articles using the four big validities. For each article, work through the four big validities in turn, indicating whether the article does a good or bad job on each front. As you write, keep in mind that you are demonstrating your mastery of this material! Demonstrate that you know how to ask questions about each of the four validities and that you know what the answers to these questions mean. Finally, demonstrate that you understand what it means to prioritize validities as you interrogate a study. 

Details:

Construct validity: Evaluate the measures and manipulations

Restate each variable and how it was operationalized. (“They operationalized ___ by doing _____”). After you describe each measure or manipulation, indicate any reliability and validity information provided in the article (take a look at Figure 5.7). Do they give Cronbach’s alphas; if so, what are they? Are they good or bad? Do they give interrater reliabilities; if so, what are they? Do they give any evidence for predictive or concurrent validity, perhaps to referring to how the measure has been used in past research? Using this information, give your assessment—is each measure reliable and valid? If such information is not included, then evaluate that—what would you like to see?

For manipulated variables, are the manipulations construct valid, in your opinion? (See Chapter 10). If it’s a manipulated variable, do they do any manipulation checks to show you that their manipulation did what they intended it to do? Does the manipulation have face validity?

Statistical validity: Evaluate how strongly the results support their argument.

For each major result, evaluate its effect size to the best of your ability. State the effect size if it’s given in terms you understand (e.g., r or d). If it’s a beta in a regression table, how big is the beta for the main variable of interest, compared to the others on the table? Are the major effects statistically significant? What does this mean?

As you evaluate statistical validity, discuss how strongly and how well the results pattern supported the authors’ hypotheses. See if you can evaluate how strong the result is in some “real world” terms, like an increase in IQ points or a weight loss of some number of pounds, or a reaction time in seconds.

Internal validity: Can the study support a causal claim? Does it intend to?

First, state what specific causal claim the researchers wish to make (if it’s an experiment) or might wish to make (if it’s a correlational study).

If it’s an experiment, apply the causal rules, including the internal validity threats in Table 11.1. Do any apply to your article? If not, what is your overall evaluation? Can they make a causal statement?

Articles: 

Facial-Attractiveness Choices Are Predicted by Divisive Normalization. Authors:Furl, Nicholas

Driven to Distraction: Dual-Task Studies of Simulated Driving and Conversing on a Cellular Telephone.

Authors:

Strayer, David L.

Johnston, William A.