Replications in Experimental Philosophy
Replications are listed in order by the first author of the paper being replicated. Unless otherwise noted, ratings are based on a scale from 1 to 7. In some cases the data presented below does not appear in that exact form in the original paper.
Much of the research in experimental philosophy -- as in every science -- has built on previous work by replicating and extending earlier results. However, these replications have often been buried inside footnotes or more complicated experiments. This website aims to collect and organize these results, and to serve as a resource to researchers in the field.
The more information this website contains, the more useful it will be, so please send in any data you are willing to share. Some of the studies below are labelled 'Non-Replication' or 'Non-Replication with modified material.' The point of these labels is not to pass judgment on whether the effect is real -- obviously, even real effects sometimes fail to replicate. Rather, we hope that these labels will make it easier to use this site to see the state of the research in various areas.
Please write to Christian Mott if you know of a replication that should be included on this page, if you would like to suggest corrections to the information already available here, or if you have suggestions about how to improve the site. Unpublished data are welcome.
Much of the research in experimental philosophy -- as in every science -- has built on previous work by replicating and extending earlier results. However, these replications have often been buried inside footnotes or more complicated experiments. This website aims to collect and organize these results, and to serve as a resource to researchers in the field.
The more information this website contains, the more useful it will be, so please send in any data you are willing to share. Some of the studies below are labelled 'Non-Replication' or 'Non-Replication with modified material.' The point of these labels is not to pass judgment on whether the effect is real -- obviously, even real effects sometimes fail to replicate. Rather, we hope that these labels will make it easier to use this site to see the state of the research in various areas.
Please write to Christian Mott if you know of a replication that should be included on this page, if you would like to suggest corrections to the information already available here, or if you have suggestions about how to improve the site. Unpublished data are welcome.
-
Beebe, J.R. & Buckwalter, W. (2010). The Epistemic Side-Effect Effect. Mind and Language 25, 474-498.
Mean ratings: harm condition = 2.25; help condition = 0.91 (on a -3 to 3 scale) (N = 749).
- Beebe, J.R. & Jensen, M. (2012). Surprising connections between knowledge and action: The robustness of the epistemic side-effect effect. Philosophical Psychology 25, 689-715.
- Experiment 1: Mean ratings: harm condition = 6.37; help condition = 3.35 (N = 98).
- Turri, J. The Problem of ESEE Knowledge. Unpublished ms.
- Mean ratings: harm condition = 4.76; help condition = 3.77 (N = ~49).
- Beebe, J.R. & Jensen, M. (2012). Surprising connections between knowledge and action: The robustness of the epistemic side-effect effect. Philosophical Psychology 25, 689-715.
-
Buckwalter, W. (2010). Knowledge Isn't Closed on
Saturday: A Study in Ordinary Language. Review of Philosophy
and Psychology, 1, 395-406.
74.3% of participants ascribed knowledge in the case with low stakes and no salient alternative; 68.5% ascribed knowledge in the high stakes case (N = 544); 66.1% ascribed knowledge in the salient alternative case.
- Feltz, A. & Zarpentine, C. (2010). Do You Know
More When It Matters Less? Philosophical Psychology, 23,
683-706.
- Mean ratings: low stakes = 3.68; high stakes = 4.26 (N = 152) (Performed independently and not intended as a replication)
- May, J., Sinnott-Armstrong, W., Hull, J. G. & Zimmerman,
A. (2010). Practical Interests, Relevant Alternatives,
and Knowledge Attributions: An Empirical Study. Review of
Philosophy and Psychology, 1, 265-273.
- Mean ratings: low stakes/no alternative = 5.33; low stakes/alternative = 5.30; high stakes/no alternative = 5.07; high
stakes/alternative = 4.60 (N = 241) (Performed independently and not intended as a replication)
- Buckwalter, W. (forthcoming). The Mystery of
Stakes and Error in Ascriber Intuitions. In James Beebe (ed.),
Advances in Experimental Epistemology. Continuum.
- Mean ratings: low stakes/no alternative = 4.70; high stakes/no alternative = 4.48; low stakes/alternative = 4.05; high stakes/alternative = 4.33.(N = ~107).
- Feltz, A. & Zarpentine, C. (2010). Do You Know
More When It Matters Less? Philosophical Psychology, 23,
683-706.
-
Buckwalter, W. (forthcoming). Gettier Made ESEE. Philosophical Psychology.
Experiment 2
Mean ratings: harm condition = 6.05; help condition = 4.11 (N = 78).- Beebe, J.R. & Shea, J. Gettierized Knobe Effects. Unpublished ms.
- Experiment 1: WATER case: Mean ratings: harm condition = 4.35; help condition = 3.43 (N = ~94) (Study completed independently and not intended as a replication).
- Turri, J. The Problem of ESEE Knowledge. Unpublished ms.
- Mean ratings: harm condition = 4.24; help condition= 3.74 (N = ~49).
- Beebe, J.R. & Shea, J. Gettierized Knobe Effects. Unpublished ms.
-
Buckwalter, W. & Stich, S. (2013). Gender and Philosophical Intuition, in Experimental Philosophy: Volume 2, J. Knobe & S. Nichols, eds., Oxford University Press.
Watch Gettier Case, (Sec. 3.1)
71% of women (N = 56) attributed knowledge; 41% of men (N = 84)attributed knowledge. (Data from Starmans & Friedman, unpublished ms.)- Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
- [Non-Replication] 57.1% of women (N = 84) attributed knowledge; 44.2% of men (N = 52) attributed knowledge.
Compatibilism Question, (Sec. 3.2)
63% of women (N = 90) attributed free will; 35% of men (N = 102) attributed free will. (Data from Holtzman, in preparation)- Seyedsayamdost, Hamid. (2012) On Gender and Philosophical Intuition: Failure of Replication and Other Negative Results. Unpublished ms.
- [Non-Replication] SurveyMonkey sample: 45% of women attributed free will (N = 50); 35% of men attributed free will (N = 42).
- Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
- [Non-Replication] 35.7% of women (N = 84) attributed free will; 34.6% of men (N = 52) attributed free will.
Physicalism Question, (Sec. 3.2)
17% of women said he could know what an apple tastes like (N = 93); 39% of men said he could know what an apple tastes like (N = 102).- Seyedsayamdost, Hamid. (2012) On Gender and Philosophical Intuition: Failure of Replication and Other Negative Results. Unpublished ms.
- [Non-Replication] SurveyMonkey sample: ~8% of women said he could know what an apple tastes like (N = 52); ~11% of men said he could know what an apple tastes like (N = 49). (Exact percentages not reported; numbers read off figure.)
Dualism Question, (Sec. 3.2)
62% of women (N = 87) attributed love to a robot; 79% of men (N = 98) attributed love to a robot. (Data from Holtzman, in preparation)- Seyedsayamdost, Hamid. (2012) On Gender and Philosophical Intuition: Failure of Replication and Other Negative Results. Unpublished ms.
- [Non-Replication] SurveyMonkey sample: ~38% of women attributed love to a robot (N = 72); ~40% of men attributed love to a robot (N = 65). (Exact percentages not reported; numbers read off figure.)
- Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
- [Non-Replication] 51.7% of women (N = 87) attributed love to a robot; 47.9% of men (N = 71) attributed love to a robot.
Violinist Case, (Sec. 3.3)
Women’s mean response was 3.86 (N = 122); men’s mean response was 4.32 (N = 176). (Data from Cushman & Young)- Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
- [Non-Replication] Women’s mean response was 3.99 (N = 84); men’s mean response was 4.01 (N = 52).
Magistrate and the Mob Case
Women’s mean response was 4.15 (N = 149); men’s mean response was 4.4 (N = 380). (Converted to 1 to 5 scale.) (Data from Cushman & Young)- Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
- [Non-Replication] Women’s mean response was 4.13 (N = 87); men’s mean response was 4.18 (N = 71). (1 to 5 scale.)
Trolley Case, (Sec. 3.4)
Women’s mean response was 4.21; men’s mean response was 4.95. (N not reported.) (Data from Zamzow & Nichols, 2009)- Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
- [Non-Replication] Women’s mean response was 5.97 (N = 84); men’s mean response was 5.67 (N = 52).
Causal Deviance Cases, (Sec. 3.5)
Mean scores: For women: Negative Deviant = 2.67, Negative Normal = 3.17; Positive Normal = 2.93, Positive Deviant = 3.10.
For men: Negative Deviant = 2.58, Negative Normal = 2.86; Positive Normal = 2.94, Positive Deviant = 2.39. (N not reported.) (Data from Pizarro, Uhlmann & Bloom)- Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
- Mean scores: For women: Negative Deviant = 1.77 (N = 84), Negative Normal = 2.02 (N = 87), Positive Normal = 2.77 (N = 84), Positive Deviant = 3.09 (N = 87).
For men: Negative Deviant = 1.65 (N = 52), Negative Normal = 1.60 (N = 71), Positive Normal = 2.56 (N = 52), Positive Deviant = 3.03 (N = 71).
Brain in a Vat Case, (Sec. 3.7)
Women’s mean response was 6.72 (N = 39); men’s mean response was 5.62 (N = 24).- Seyedsayamdost, Hamid. (2012) On Gender and Philosophical Intuition: Failure of Replication and Other Negative Results. Unpublished ms.
- Mturk sample: women’s mean response was 5.86 (N = 58); men’s mean response was 5.25 (N = 56).
[Non-Replication] SurveyMonkey sample: women’s mean response was 5.61 (N = 49); men’s mean response was 5.78 (N = 51). - Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
- [Non-Replication] Women’s mean response was 5.22 (N = 87); men’s mean response was 4.17 (N = 71).
Twin Earth Case, (Sec. 3.7)
Women’s mean response was 4.49 (N = 49); men’s mean response was 5.63 (N = 35).- Seyedsayamdost, Hamid. (2012) On Gender and Philosophical Intuition: Failure of Replication and Other Negative Results. Unpublished ms.
- [Non-Replication] Mturk sample: women’s mean response was 5.46 (N = 52); men’s mean response was 5.22 (N = 65).
SurveyMonkey sample: women’s mean response was 5.22 (N = 45); men’s mean response was 5.88 (N = 40). - Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
- [Non-Replication] Women’s mean response was 5.31 (N = 84); men’s mean response was 5.04 (N = 52).
Chinese Room Case, (Sec. 3.7)
Women’s mean response was 3.25 (N = 73); men’s mean response was 4.13 (N = 54).- Seyedsayamdost, Hamid. (2012) On Gender and Philosophical Intuition: Failure of Replication and Other Negative Results. Unpublished ms.
- [Non-Replication] Mturk sample: women’s mean response was 3.31 (N = 55); men’s mean response was 3.31 (N = 48).
[Non-Replication] SurveyMonkey sample: women’s mean response was 3.82 (N = 45); men’s mean response was 3.66 (N = 35). - Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
- [Non-Replication] Women’s mean response was 3.98 (N = 87); men’s mean response was 3.54 (N = 71).
Plank of Carneades Case, (Sec. 3.7)
Women’s mean response was 5.64 (N = 73); men’s mean response was 4.95 (N = 37).- Seyedsayamdost, Hamid. (2012) On Gender and Philosophical Intuition: Failure of Replication and Other Negative Results. Unpublished ms.
- Mturk Sample: women’s mean response was 5.51 (N = 86); men’s mean response was 5.20 (N = 70).
[Non-Replication] SurveyMonkey Sample: women’s mean response was 5.62 (N = 50); men’s mean response was 5.85 (N = 48). - Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
- [Non-Replication] Women’s mean response was 4.94 (N = 87); men’s mean response was 4.89 (N = 71).
- Adleberg, T., Thompson, M. & Nahmias, E. (forthcoming). Do Men and Women Have Different Philosophical Intuitions? Further Data. Philosophical Psychology.
-
Colaço, D., Buckwalter, W., Stich, S., & Machery, E. (2014). Epistemic intuitions in fake-barn thought experiments. Episteme, 11, 199-212.
Overall mean ratings
Mean rating in high defeater fake barn case: 4.51 (N = approximately 59 in high defeater fake barn condition)
- Turri, J. (2014). Unpublished data.
- Mean rating: 4.92 (N = 300)
- Knobe, J. (2014). Unpublished data.
- Mean rating: 4.66 (N = 203)
Age predicted knowledge ratings in fake barn conditions, β = −0.32 (N = approximately 117 in fake barn conditions)- Turri, J. (2014). Unpublished data.
- [Non-replication]
- Turri, J. (2014). Unpublished data.
- Knobe, J. (2014). Unpublished data.
- [Non-replication]
-
Feltz, A. & Cokely, E. (2007). An Anomaly in
Intentional Action Ascription: More Evidence of Folk
Diversity. In Proceedings of the 29th Annual Cognitive Science
Society.
Ratings are higher for descriptions of bad side effects that are presented before good side effects. The order effect was only significant for women (N = 67).
- Cokely, E. & Feltz, A. (2008). Individual
Differences, Judgment Biases, and Theory-of-Mind: Deconstructing
the Intentional Action Side Effect Asymmetry. Journal of
Research in Personality 43:18-24.
- Mean ratings: When Help was presented
first, Help = 2; Harm = 4.2. When Help was presented second Help =
2; Harm = 5.8 (N = 95). An identifiable
sub-group, namely women, were primarily responsible for the order
effect.
- Cokely, E. & Feltz, A. (2008). Individual
Differences, Judgment Biases, and Theory-of-Mind: Deconstructing
the Intentional Action Side Effect Asymmetry. Journal of
Research in Personality 43:18-24.
-
Feltz, A. & Zarpentine, C. (2010). Do You Know
More When It Matters Less? Philosophical Psychology, 23,
683-706.
Mean ratings: low stakes = 3.68; high stakes = 4.26 (N = 152)
- Buckwalter, W. (2010). Knowledge Isn't Closed on
Saturday: A Study in Ordinary Language. Review of Philosophy
and Psychology, 1, 395-406.
- 74.3% of participants ascribed knowledge in the case with low
stakes and no salient alternative; 68.5% ascribed
knowledge in the high stakes case (N = 544); 66.1% ascribed knowledge in the salient alternative case. (Performed independently and not intended as a replication).
- May, J., Sinnott-Armstrong, W., Hull, J. G. & Zimmerman,
A. (2010). Practical Interests, Relevant Alternatives,
and Knowledge Attributions: An Empirical Study. Review of
Philosophy and Psychology, 1, 265-273.
- Mean ratings: low stakes/no alternative = 5.33; low stakes/alternative = 5.30; high stakes/no alternative = 5.07; high
stakes/alternative = 4.60 (N = 241) (Performed independently and not intended as a replication)
- Buckwalter, W. (forthcoming). The Mystery of
Stakes and Error in Ascriber Intuitions. In James Beebe (ed.),
Advances in Experimental Epistemology. Continuum.
- Mean ratings: low stakes/no alternative = 4.70; high stakes/no alternative = 4.48; low stakes/alternative = 4.05; high stakes/alternative = 4.33.(N = ~107).
- Buckwalter, W. (2010). Knowledge Isn't Closed on
Saturday: A Study in Ordinary Language. Review of Philosophy
and Psychology, 1, 395-406.
-
Knobe, J. (2003). Intentional action and side effects in ordinary language. Analysis, 63, 190-193.
Experiment 1
82% of participants in Harm condition said that the agent brought about the side-effect intentionally; 23% in the Help condition said that the agent brought about the side-effect intentionally (N = 78).- McCann, H. J. (2005). Intentional Action and Intending: Recent Empirical Studies. Philosophical Psychology, 18
(6):737-748.
- 63% of participants in the Harm condition say the
side-effect is intentional (N = ~53).
- Young, L., Cushman, F., Adolphs, R., Tranel, D. & Hauser, M. (2006). Does Emotion Mediate the Effect of an Action's Moral Status on its Intentional Status? Neuropsychological Evidence. Journal of Cognition and Culture 6, 291-304.
- Among neurotypical participants: 80.2% judged that the chairman
intentionally harmed the environment; 9.4% judged that the chairman intentionally
helped the environment (N = 936). Among participants with VMPFC
lesions, 100% judged that the chairman intentionally harmed the
environment; 29% judged that the
chairman intentionally helped the environment.
- Nichols, S. & Ulatowski, J. (2007). Intuitions and Individual Differences: The Knobe Effect Revisited. Mind and Language 22, 346-365.
- 68.2% of participants judged that the chairman intentionally harmed the environment; 31.8% of participants judged that the chairman intentionally helped the environment (N = 44).
- Wright, J. & Bengson, J. (2009). Asymmetries in Judgments of Responsibility and Intentional Action. Mind and Language 24, 24-50.
- 64.8% of participants judged that the chairperson harmed the environment intentionally; 4.1% of participants judged that the chairperson helped the environment intentionally (N = 122). (Methodology differed slightly from the original study).
- Sripada, C. & Konrath, S. (2011). Telling More Than We Can Know About Intentional Action. Mind and Language, 26, 353-380.
- Study replicated, but detailed findings are not reported.
- Pinillos, Á., Smith, N., Nair, G. S., Mun, C. & Marchetto, P. (2011). Philosophy's New Challenge: Experiments and Intentional Action. Mind and Language, 26, 115-139.
- Among participants who scored 0 on CRT, 79% said harm was
intentional, 14% said help was intentional (N = 107).
Among participants who scored greater than 1 on CRT, 65% said harm was intentional, 18% said help was intentional (N = 92). (Methodology differed from original study.) - Sloman, S., Fernbach, P. & Ewing, S. (2012). A Causal Model of Intentionality Judgment. Mind and Language, 27, 154-180.
- Mean ratings: Harm = 7.6; Help = 3.0 (on 11-point scale) (N = 98) (Methodology differed from original study).
- McCann, H. J. (2005). Intentional Action and Intending: Recent Empirical Studies. Philosophical Psychology, 18
(6):737-748.
-
Knobe, J. (2003). Intentional action in folk psychology: An experimental
investigation. Philosophical Psychology, 16, 309–324.
Experiment 1
76% of participants in the immoral/no skill condition judged killing the aunt to be intentional; 28% in the achievement/no skill condition judged hitting the bull's-eye to be intentional (N = ~40).- Guglielmo, S. & Malle, B. (2010). Enough Skill to Kill: Intentionality Judgments and the Moral Valence of Action. Cognition, 117, 139-150.
- Study 1: In a condition that is identical to the
immoral/no-skill condition in the original paper, 93% of
participants said the act of killing was intentional (N = ~75).
- Study 5: 98% of participants in the low-skill negative
condition judged killing the aunt to be intentional (N = ~59), and
38% of participants in the low-skill neutral condition judged
hitting the bull's-eye to be intentional (N = ~59).
- Guglielmo, S. & Malle, B. (2010). Enough Skill to Kill: Intentionality Judgments and the Moral Valence of Action. Cognition, 117, 139-150.
-
Knobe, J. & Fraser, B. (2008). Causal
Judgment and Moral Judgment: Two Experiments. Analysis, In Walter Sinnott-Armstrong (ed.), Moral Psychology. MIT Press.
Experiment 1
Mean ratings: professor caused = 2.2; administrative assistant caused = -1.2 (on a scale from -3 to 3).
- Sytsma, J., Livengood, J. & Rose, D. (forthcoming). Two types of typicality: Rethinking the role of statistical
typicality in ordinary causal attributions. Studies in History
and Philosophy of Science.
- Study 1: Mean ratings: professor caused = 4.41; administrative assistant caused = 2.98 (N = 51).
- Knobe, J. & Szabo, Z. Modals with a
taste of the deontic. (forthcoming). Semantics and Pragmatics.
-
Mean ratings: professor cause = 5.4; administrative assistant caused = 2.3 (N = 80).
- Sytsma, J., Livengood, J. & Rose, D. (forthcoming). Two types of typicality: Rethinking the role of statistical
typicality in ordinary causal attributions. Studies in History
and Philosophy of Science.
-
Knobe, J. & Kelly, S. D. (2009). Can one act for a reason without acting intentionally?
In Constantine Sandis (ed.), New Essays on the Explanation of
Action. Palgrave Macmillan.
Mean ratings: terrorist performed the action intentionally = -0.5; terrorist performed the action in order to save his son = 1.8 (on a scale from -3 to 3) (N = 62)
- McGuire, J. M. (2012). Side-effect actions, acting
for a reason, and acting intentionally. Philosophical
Explorations. 15, 317-333.
- 40% of participants said that the act terrorist performed the action intentionally.
90.8% of participants said that terrorist performed the action in order to save his son. (Methodology differs from original study)
- McGuire, J. M. (2012). Side-effect actions, acting
for a reason, and acting intentionally. Philosophical
Explorations. 15, 317-333.
-
Machery, E. (2006). The Folk Concept of Intentional Action: Philosophical and Experimental Issues. Mind and Language, 23 (2):165–189.
95% of participants in the extra-dollar case judged the action to be intentional; 45% in the free-cup case judged the action to be intentional (N = 126).
- Sloman, S., Fernbach, P. & Ewing, S. (2012). A Causal Model of Intentionality Judgment. Mind and Language, 27, 154-180.
- Mean ratings: extra-dollar = 6.95; free-cup = 4.26 (on an
11-point scale). (N = 87) (Methodology differed from original study).
- Sloman, S., Fernbach, P. & Ewing, S. (2012). A Causal Model of Intentionality Judgment. Mind and Language, 27, 154-180.
-
Machery, E., Mallon, R., Nichols, S. & Stich,
S. P. (2004). Semantics, Cross-Cultural Style. Cognition, 92 (3).
Gödel cases (Percentages for the separate cases reported in Beebe & Undercoffer, infra.)
58% of Western participants (N = 31) said that 'Gödel' referred to the person who claimed credit for the work; 29% of participants in Hong Kong (N = 41) said that 'Gödel' referred to the person who claimed credit for the work.
55% of Western participants (N = 31) said that 'Tsu Ch'ung Chih' referred to the person who claimed credit for the work; 32% of participants in Hong Kong (N = 41) said that 'Tsu Ch'ung Chih' referred to the person who claimed credit for the work.- Beebe, J. & Undercoffer, R. Individual and Cross-Cultrual Differences in Semantic Intuitions: New Experimental Findings. Unpublished.
- Study 1a: 56% of Western participants (N = 257) said that ‘Gödel’ referred to the person who claimed credit for the work; 43% of East Asian participants (N = 149) said that ‘Gödel’ referred to the person who claimed credit for the work.
- Study 1c: 63% of Western participants (N = 257) said that ‘Tsu Ch'ung Chih’ referred to the person who claimed credit for the work; 48% of East Asian participants (N = 149) said that ‘Tsu Ch'ung Chih’ referred to the person who claimed credit for the work. (Methodology differed from the original study.)
- Study 2a: 58% of Western participants (N = 161) said that ‘Gödel’ referred to the person who claimed credit for the work; 37% of East Asian participants (N = 46) said that ‘Gödel’ referred to the person who claimed credit for the work. (Methodology differed from the original study.)
- Study 2a: 67% of Western participants (N = 161) said that ‘Tsu Ch'ung Chih’ referred to the person who claimed credit for the work; 43% of East Asian participants (N = 46) said that ‘Tsu Ch'ung Chih’ referred to the person who claimed credit for the work. (Methodology differed from the original study.)
- Lam, B. (2010). Are Cantonese Speakers Really Descriptivists? Revisiting Cross-Cultural Semantics. Cognition 115:320-32.
- [Non-Replication with modified materials] 87% of Cantonese speakers (N = 38) and 65% of English speakers
(N = 31) said 'Shakespeare' refers to the person who claimed credit
for the work (Methodology differed from original study).
- Machery, E., Deutsch, M., Mallon, R., Nichols, S., Sytsma, J. & S. Stich. (2010). Semantic intuitions: Reply to Lam. Cognition, 117, 361-366.
- 39% of participants in Hong Kong (N = 71) reading a Chinese translation of the vignette from Machery et al. (2009) said that ‘Gödel’ referred to the person who claimed credit for the work. (Methodology differed from the original study.)
- Machery, E., Olivola, C.Y. & de Blanc M. (2009). Linguistic and metalinguistic intuitions in the philosophy of language. Analysis, 69, 689-694.
- 58% of Indian participants (N = 83), 48% of French participants (N = 66), and 56% of Mongolian participants (N = 78) said that ‘Tsu Ch'ung Chih’ referred to the person who claimed credit for the work.
- Sytsma, J. & Livengood, J. (2011). A
New Perspective Concerning Experiments on Semantic
Intuitions. Australasian Journal of Philosophy 89
(2):315-332.
- [Non-Replication] 39.4% of American participants
said 'Gödel' refers to the person who claimed credit for the work (N = 71).
Jonah cases
In 61% of responses, Western participants (N = 31) said that 'Attila' or 'Chan Wai Man' referred to the real person; in 66% of responses, participants in Hong Kong (N = 41) said that 'Attila' or 'Chan Wai Man' referred to the real person.
- Beebe, J. & Undercoffer, R. Individual and Cross-Cultrual Differences in Semantic Intuitions: New Experimental Findings. Unpublished.
- Study 1a: 39% of Western participants (N = 257) said that 'Attila' referred to the real person; 26% of East Asian participants (N = 149) said that 'Attila' referred to the real person.
- Study 1a: 39% of Western participants (N = 257) said that 'Chan Wai Man' referred to the real person; 25% of East Asian participants (N = 149) said that 'Chan Wai Man' referred to the real person.
- Beebe, J. & Undercoffer, R. Individual and Cross-Cultrual Differences in Semantic Intuitions: New Experimental Findings. Unpublished.
-
Mallon, R.(2008). Knobe Vs Machery: Testing the Trade-Off Hypothesis. Mind and Language, 23, 247-255.
92% of participants judged that the terrorist killed Australians intentionally; 12% judged that the terrorist helped the orphanage intentionally (N = 52).
- Sloman, S., Fernbach, P. & Ewing, S. (2012). A Causal Model of Intentionality Judgment. Mind and Language, 27, 154-180.
- Mean ratings: killing Australians = 8.97; helping the orphanage
= 3.08 (on an 11-point scale). (N = 84) (Methodology differed from original study).
- Sloman, S., Fernbach, P. & Ewing, S. (2012). A Causal Model of Intentionality Judgment. Mind and Language, 27, 154-180.
-
May, J., Sinnott-Armstrong, W., Hull, J. G. & Zimmerman,
A. (2010). Practical Interests, Relevant Alternatives,
and Knowledge Attributions: An Empirical Study. Review of
Philosophy and Psychology, 1, 265-273.
Mean ratings: low stakes/no alternative = 5.33; low stakes/alternative = 5.30; high stakes/no alternative = 5.07; high stakes/alternative = 4.60 (N = 241)
- Feltz, A. & Zarpentine, C. (2010). Do You Know
More When It Matters Less? Philosophical Psychology, 23,
683-706.
- Mean ratings: low stakes = 3.68; high stakes = 4.26 (N = 152) (Performed independently and not intended as a replication)
- Buckwalter, W. (2010). Knowledge Isn't Closed on
Saturday: A Study in Ordinary Language. Review of Philosophy
and Psychology, 1, 395-406.
- 74.3% of participants ascribed knowledge in the case with low
stakes and no salient alternative; 68.5% ascribed
knowledge in the high stakes case (N = 544); 66.1% ascribed knowledge in the salient alternative case. (Performed independently and not intended as a replication).
- Buckwalter, W. (forthcoming). The Mystery of
Stakes and Error in Ascriber Intuitions. In James Beebe (ed.),
Advances in Experimental Epistemology. Continuum.
- Mean ratings: low stakes/no alternative = 4.70; high stakes/no alternative = 4.48; low stakes/alternative = 4.05; high stakes/alternative = 4.33.(N = ~107).
- Feltz, A. & Zarpentine, C. (2010). Do You Know
More When It Matters Less? Philosophical Psychology, 23,
683-706.
-
Nahmias, E., Coates, D. J. & Kvaran, T. (2007). Free Will, Moral Responsibility, and Mechanism: Experiments on Folk Intuitions. Midwest Studies in Philosophy 31 (1):214-242.
In concrete/bad Ertan psych condition, 81.1% of participants responded that the agent was morally responsible for his actions (N = 111)
- Feltz, A. & Cokely, E. T. (2009). Do Judgments About Freedom and Responsibility Depend on Who You Are? Personality Differences in Intuitions About Compatibilism and Incompatibilism. Consciousness and Cognition 18 (1):342-350.
- In concrete/bad psych condition, 76% of participants
responded that the agent was morally responsible for his
actions, 22% said he was not, 2% were neutral (N = 58) (Methodology differs from original study).
- Nadelhoffer, T., Kvaran, T. & Nahmias, E. (2009). Temperament and Intuition: A Commentary on Feltz and Cokely. Consciousness and Cognition 18 (1):351-355.
- Detailed results not reported, but same case used.
- Feltz, A. & Cokely, E. T. (2009). Do Judgments About Freedom and Responsibility Depend on Who You Are? Personality Differences in Intuitions About Compatibilism and Incompatibilism. Consciousness and Cognition 18 (1):342-350.
-
Nichols, S. (2004). After objectivity: An empirical study of moral judgment. Philosophical Psychology, 17 (1).
Experiment 1
42.5% of participants gave nonobjectivist responses to the moral case (N = 40).
- Feltz, A. & Cokely, E. T. (2008). The fragmented folk: More evidence of stable individual differences in moral judgments and folk intuitions. In B.C. Love, K. McRae & V.M. Sloutsky (Eds.), Proceedings of the 30th Annual Conference of the Cognitive Science Society (pp. 1771-1776). Austin ,TX: Cognitive Science Society.
- Experiment 1: 69% of participants gave a non-objectivist answer to the moral scenario (N = 115).
- Feltz, A. & Cokely, E. T. (2008). The fragmented folk: More evidence of stable individual differences in moral judgments and folk intuitions. In B.C. Love, K. McRae & V.M. Sloutsky (Eds.), Proceedings of the 30th Annual Conference of the Cognitive Science Society (pp. 1771-1776). Austin ,TX: Cognitive Science Society.
-
Nichols, S. & Knobe, J. (2007). Moral Responsibility and Determinism: The Cognitive Science of Folk Intuitions. Nous, 41, 663-685.
Experiment 1
In concrete condition, 72% of participants gave compatibilist responses; in abstract condition, 86% gave incompatibilist responses (N not reported).
- Nahmias, E., Coates, D. J. & Kvaran, T.(2007). Free Will, Moral Responsibility, and Mechanism: Experiments on Folk Intuitions Midwest Studies in Philosophy 31 (1):214-242.
- In abstract condition, 63.1% of participants (across Psych and Neuro conditions) responded that human beings in a deterministic world could be morally responsible for their actions (N = 152) (Methodology differs from original study).
- In abstract condition, 61.6% of participants (across Psych
and Neuro conditions) responded that beings (Ertans) in a deterministic world could be morally responsible for their actions (N = 155) (Methodology differs from original study).
- In the concrete-bad condition, 80.2% of participants (across Psych and Neuro conditions) responded that beings (Ertans) in a deterministic world could be morally responsible for their actions (N = 219) (Methodology differs from original study).
- Feltz, A., Cokely, E. & Nadelhoffer, T. (2009). Natural Compatibilism Versus Natural Incompatibilism: Back
to the Drawing Board. Mind and Language 24 (1):1-23.
- Experiment 1: 67% of participants gave incompatibilist
answers when presented with both abstract and concrete scenarios,
even when concrete scenarios were presented first (N = 52)
- Cova, F., Bertoux, M., Bourgeois-Gironde, S. & Dubois,
B. (2012). Judgments
About Moral Responsibility and Determinism in Patients with
Behavioural Variant of Frontotemporal Dementia: Still
Compatibilists. Consciousness and Cognition 21
(2):851-864.
- Among participants with bvFTD, mean ratings on first-presented case: high-affect case =
6.2; low-affect case = 3.8 (N=20). (Methodology differed from
original study.)
- Sarkissian, H., Chatterjee, A., De Brigard, F., Knobe, J., Nichols, S. & Sirker, S. (2010). Is Belief in Free Will a Cultural Universal? Mind & Language, 25, 346-35.
- 82% of subjects in the United States sample, 85% in the India sample, 65% in the Hong Kong sample, and 77% in the Colombia sample responded that our universe is not deterministic (total N = 229).
- 75% of subjects in the United States sample, 72% in the India sample, 63% in the Hong Kong sample, and 68% in the Colombia sample responded that moral responsibility is not compatible with determinism (total N = 226).
Experiment 2
Percentage of participants saying agent fully morally responsible: low affect, determinist universe: 23%; low affect, indeterminist universe: 89%; high affect, determinist universe: 64%; high affect, indeterminist universe: 95% (N = 90).
- Feltz, A., & Cova, F. (2014). Moral responsibility and free will: A meta-analysis. Consciousness and Cognition, 30, 234-246.
- [Meta-Analysis] A meta-analysis of 30 studies comparing low to high affect shows an overall effect of d=.15, p < .001.
- Cova, Florian. (2012). Unpublished results.
- [Non-Replication] Experiment 1: Percentage of participants saying agent fully morally responsible: determinist universe, ketchup case: 30%; determinist universe, tax case: 30%; determinist universe, rape case: 37%; determinist universe, murder case: 37% (N = 120).
- [Non-Replication] Experiment 2: Percentage of participants saying agent fully morally responsible: low affect, determinist universe: 37%; low affect, indeterminist universe: 77%; high affect, determinist universe: 40%; high affect, indeterminist universe: 87% (N = 120).
- [Non-Replication] Experiment 3: Percentage of participants saying agent fully morally responsible: low affect, determinist universe: 27%; high affect, determinist universe: 33% (N = 60).
- [Non-Replication] Experiment 4: Mean agreement with statement that agent fully morally responsible: low affect, determinist universe: -1.2; low affect, indeterminist universe: 2.47; high affect, determinist universe: -0.55; high affect, indeterminist universe: 2.03 (-3 to 3 scale) (N = 120).
- [Non-Replication] Experiment 5: Percentage of participants saying agent fully morally responsible: determinist universe, ketchup case: 63%; determinist universe, tax case: 77%; determinist universe, rape case: 90%; determinist universe, murder case: 53% (N = 120).
- Nahmias, E., Coates, D. J. & Kvaran, T.(2007). Free Will, Moral Responsibility, and Mechanism: Experiments on Folk Intuitions Midwest Studies in Philosophy 31 (1):214-242.
-
Phillips, J. & Knobe, J. (2009). Moral Judgments and Intuitions about Freedom. Psychological Inquiry, 2, 30-36.
Experiment 1
Mean ratings: captain forced to throw cargo overboard = 4.6; captain forced to throw wife overboard = 1.9 (N = 52).- Young, L. & Phillips, J. (2011). The Paradox of Moral Focus. Cognition, 119, 166-178.
- Experiment 1: participants judged that the sailor was forced less to throw the passengers overboard than the cargo (t(49)=2.15, p=0.037) (Methodology differed slightly from original study).
Mean ratings: doctor forced to save patient = 4.9; doctor forced to kill patient = 2.9 (N = 56).- Young, L. & Phillips, J. (2011). The Paradox of Moral Focus. Cognition, 119, 166-178.
- Experiment 3: participants judged that the doctor was forced less to kill than to save (t(58)=1.93, p=0.058) (Methodology differed slightly from original study).
- Young, L. & Phillips, J. (2011). The Paradox of Moral Focus. Cognition, 119, 166-178.
-
Pinillos, N. Angel. (2012) Knowledge, Experiments and Practical Interests. in Jessica Brown & Mikkel Gerken (eds.), New Essays On Knowledge Ascriptions. Oxford University Press.
Median ratings: typo low stakes = 2; typo high stakes = 5 (N = 144).- Buckwalter, W. (forthcoming). The Mystery of Stakes and Error in Ascriber Intuitions, in James Beebe (ed.), Advances in Experimental Epistemology. Continuum.
- Mean ratings: typo low stakes knowledge = 2.61; typo high stakes knowledge = 5.12 (N = ~45).
- Buckwalter, W. & Schaffer, J. Knowledge, Stakes, and Mistakes".
- Mean ratings: typo low stakes knowledge = 2.11; typo high stakes knowledge = 4.61 (N = ~93) (Methodology differed from original study -- authors used a shortened version of the high stakes vignette).
- Buckwalter, W. (forthcoming). The Mystery of Stakes and Error in Ascriber Intuitions, in James Beebe (ed.), Advances in Experimental Epistemology. Continuum.
-
Roxborough, C. & Cumby, J. (2009). Folk
Psychological Concepts: Causation. Philosophical
Psychology, 22, 205-213.
Mean ratings: professor caused = 0.90; administrative assistant caused = -0.98 (on scale from -3 to 3) (N = 118).- Sytsma, J., Livengood, J. & Rose, D. (forthcoming). Two types of typicality: Rethinking the role of statistical
typicality in ordinary causal attributions. Studies in History
and Philosophy of Science.
- Study 1: Mean ratings: professor caused = 4.41; administrative assistant caused = 2.98 (N = 51).
- Sytsma, J., Livengood, J. & Rose, D. (forthcoming). Two types of typicality: Rethinking the role of statistical
typicality in ordinary causal attributions. Studies in History
and Philosophy of Science.
-
Sytsma, J. & Livengood, J. (2011). A New Perspective Concerning Experiments on Semantic Intuitions. Australasian Journal of Philosophy, 89, 315-332.
Study 2: Clarified Narrator's Perspective
74% of non-philosophers (N = 84) said that 'Gödel' referred to the person who claimed credit for the work; 76% of philosophers (N = 58) said that 'Gödel' referred to the person who claimed credit for the work.- Beebe, J. & Undercoffer, R. Individual and Cross-Cultrual Differences in Semantic Intuitions: New Experimental Findings. Unpublished.
- [Non-Replication with modified materials] Study 1c: 63% of Western participants (N = 257) said that ‘Tsu Ch'ung Chih’ referred to the person who claimed credit for the work; 48% of East Asian participants (N = 149) said that ‘Tsu Ch'ung Chih’ referred to the person who claimed credit for the work. (Methodology differed from the original study.)
- Beebe, J. & Undercoffer, R. Individual and Cross-Cultrual Differences in Semantic Intuitions: New Experimental Findings. Unpublished.
-
Webber, J. & Scaife, R. (forthcoming). Intentional Side-Effects of
Action. Journal of Moral Philosophy.
Experiment 1
45.2% of participants said chairman intentionally increased pollution (N = 42); 72.7% said chairman intentionally made factory less safe (N = 44).- Cova, F. (forthcoming). Unconsidered
intentional actions: An assessment of Scaife and Webber's
'Consideration Hypothesis'. Journal of Moral Philosophy.
- [Non-Replication] 58%
of subjects in the case with two side effects said the harmful side
effect was intentional (N = 50).
66.3% of participants said parent had intentionally inflicted pain (N = 83)- Cova, F. (forthcoming). Unconsidered
intentional actions: An assessment of Scaife and Webber's
'Consideration Hypothesis'. Journal of Moral Philosophy.
- [Non-Replication] 73%
of subjects gave the parents the lowest possible intentionality rating (N = 60).
- Cova, F. (forthcoming). Unconsidered
intentional actions: An assessment of Scaife and Webber's
'Consideration Hypothesis'. Journal of Moral Philosophy.
-
Weinberg, J.M., Nichols, S. & Stich, S. (2001).
Normativity and Epistemic Intuitions. Philosophical Topics, 29, 429-460.
Individualistic Truetemp Cases
32% of Westerners (N=189) say he really knows; 12% of East Asians (N=25) say he really knows.- Seyedsayamdost, H. (2013).
On Normativity and Epistemic Intuitions: Failure of Replication. Unpublished.
- [Non-Replication] Data Set 2: 24% of Westerners (N=29) say he really knows; 17% of East Asians (N=30) say he really knows. (In addition, 24% of people from the Indian sub-continent (N=25) say he really knows.)
- [Non-Replication] Data Set 3: 29% of Westerners (N=75) say he really knows; 28% of East Asians (N=36) say he really knows.
Gettier Cases
26% of Westerners (N=66) say he really knows; 56% of East Asians (N=23) say he really knows; 61% of people from the Indian sub-continent (N=23) say he really knows.- Nagel, J., San Juan, V. & Mar, R. (2013). Lay denial of knowledge for justified true beliefs. Cognition, 129, 652-661.
- [Non-Replication with modified materials] 32% of White participants (N=63) said he really knows; 29% of East Asian participants (N=21) said he really knows. (Methodology differed from original study.)
- Seyedsayamdost, H. (2013).
On Normativity and Epistemic Intuitions: Failure of Replication. Unpublished.
- [Non-Replication] Data Set 1: 14% of Westerners (N=83) say he really knows; 26% of East Asians (N=42) say he really knows; 15% of people from the Indian sub-continent (N=34) say he really knows.
- [Non-Replication] Data Set 3: 23% of Westerners (N=75) say he really knows; 22% of East Asians (N=36) say he really knows.
- [Non-Replication] Data Set 4: 16% of Westerners (N=198) say he really knows; 12% of East Asians (N=25) say he really knows; 38% of people from the Indian sub-continent (N=16) say he really knows.
- Kim, M.J. & Yuan, Y. (forthcoming) No Cross-Cultural Differences in Gettier Car Case Intuition: A Replication Study of Weinberg et al. 2001. Episteme.
- [Non-Replication] 13.8% of caucasian participants (N = 58) said that he really knows; 14.6% of East Asian participants (N = 82) said that he really knows.
Cancer Conspriacy Case
10% of Westerners (N=66) say he really knows; 30% of people from the Indian sub-continent (N=23) say he really knows.- Seyedsayamdost, H. (2013).
On Normativity and Epistemic Intuitions: Failure of Replication. Unpublished.
- [Non-Replication] Data Set 2: 14% of Westerners (N=35) say he really knows; 12% of people from the Indian sub-continent (N=34) say he really knows. (In addition, 26% of East Asians (N=42) say he really knows.)
Epistemic Intuitions and Socioeconomic Status - Cancer Conspiracy Case
50% of low SES participants (N=24) say he really knows; 17% of high SES participants (N=35) say he really knows.- Seyedsayamdost, H. (2013).
On Normativity and Epistemic Intuitions: Failure of Replication. Unpublished.
- [Non-Replication] Template 1: 18% of low SES participants (N=38) say he really knows; 16% of high SES participants (N=69) say he really knows.
- [Non-Replication] Template 2: 18% of low SES participants (N=45) say he really knows; 22% of high SES participants (N=87) say he really knows.
Epistemic Intuitions and Socioeconomic Status - Zebra Case
33% of low SES participants (N=24) say he really knows; 12% of high SES participants (N=34) say he really knows.- Seyedsayamdost, H. (2013).
On Normativity and Epistemic Intuitions: Failure of Replication. Unpublished.
- [Non-Replication] Template 1: 32% of low SES participants (N=38) say he really knows; 28% of high SES participants (N=68) say he really knows.
- [Non-Replication] Template 2: 28% of low SES participants (N=47) say he really knows; 23% of high SES participants (N=87) say he really knows.
- Seyedsayamdost, H. (2013).
On Normativity and Epistemic Intuitions: Failure of Replication. Unpublished.