Reply to Moore et al.: Manipulation adherence and baseline AI attitudes as moderators of the effect of God salience on algorithm aversion

2024

Full text Open access: Hybrid Metadata (CSL-JSON)
DOI 10.1073/pnas.2407917121
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

We found that God salience leads to lower algorithm aversion in several preregistered experiments, supplemented by secondary data (1).Moore et al. (2), however, found weaker results when replicating our online studies.While the results were significant in one study, they were merely directional in others and opposite of predictions in one.We compared our findings to those of Moore et al. and identified two areas for discussion and future research.First, as noted by Moore et al. (3), the effect of the manipulation on the God salience manipulation check was smaller in their direct replication of study 1, sparking questions regarding participants' adherence to the manipulations.In a reanalysis of Moore et al.'s study 1, we found a marginally significant interaction of God salience by God salience manipulation check responses (β = -1.65,P < 0.06); when participants in the God salient condition actually reported lower levels of thinking about God, they were significantly less positive (M = 52.12)toward AI-based recommendations than those who reported higher levels of thinking about God (M = 55.98;β = -1.52,P = 0.006).This dampened the means in the God condition but is broadly consistent with our hypothesis regarding God salience.The same pattern holds in our study 1, wherein the effect within God condition is weaker among those who reported lower (M = 51.54), as opposed to higher (M = 48.10),levels of God salience (β = -1.67,P = 0.03).Even in Moore et al.'s conceptual replication of study 1 (where the overall effect was in the opposite direction of predictions), the pattern is in the predicted direction among participants who reported thinking about God to a larger extent (M control = 55.22,M God = 51.42;β = -3.80,P = 0.08).Unfortunately, we do not have similar manipulation checks in the remaining studies to further explore this pattern.Furthermore, this does not explain why adherence to the