Dear colleagues and friends,
I hope you're all keeping safe and healthy in these very challenging times. For us in Hong Kong it's been hectic for quite some time, affecting all of our teaching and research activities.
Lots has happened since the last update in October, and so an update is long overdue. Despite all that's happened in Hong Kong and around the world, we were able to keeping moving forward with quite a few exciting things for us to report to you about.
[Mailing list explanation: I started using an email mailing list to keep those who work with me, know me, and/or attend my activities updated about all that we're doing in my lab at HKU. I am hoping to help you in your research activities and slowly build a community interested in open-science to promote the "credibility revolution". I add those who have asked me or corresponded with me about my research or activities. If you're not interested in further updates, links to unsubscribe available at the bottom. If others want to join/previous emails: https://tinyurl.com/giladmailinglist ]
Reviewers needed: 15 guided thesis students doing replications and extensions
15 guided thesis students now completing pre-registrations (using our RR templates: manuscript / supplementary) with Qualtrics experiments and data analysis plan with JAMOVI / R code on simulated randomized dataset.
These pre-registrations go through peer-review by other students, external open review, & my review. We are seeking reviewers to help us improve, to go over pre-registration documents, the Qualtrics experimental design, and the data analysis plan and code.
If you're interested, please email me at giladfel@gmail.com
This is part of our Judgment and Decision Making (JDM) mass replications and extensions project:
Why join?
- Gain experience in doing open-science and running replications.
- Learn about JDM research.
- Contribute to the field.
(optional with sufficient contribution): Once student completes thesis with manuscript, you're invited to join as a coauthor in journal submission. See details about collaborations and co-authorship on our guide.
Status update: JDM mass replication project
So where are we with this project?
In the two years I ran this project we've completed 57 replications, and with the planned guided-thesis projects in the previous section above and others in the works we're expecting to wrap up 80 replications and extensions by the end of the year.
This is the poster I created as a summary (PDF):
How well did the students do last semester? Remarkably well.
I can say with confidence that last semester's projects are the best we've done so far. Every semester bring new improvements. What did we improve last semester?
We ran the 11 replications with two teams of two students, each team running on a different sample, one sample is American participants on Amazon Mechanical Turk (/Turkprime-CloudResearch) and the other typically British participants on Prolific Academic. MTurk and Prolific results converged 8 out of 8 times, demonstrating the reliability of these platforms. Each team also added atleast one extension.
You're welcome to check out the wonderful students' reports.
If you're interested in taking the lead on any of those projects to submit this to journals, please do get in touch, some are still available. With two highly powered replications and two extensions per each replication target, I trust that these will go much smoother when submitted to journals.
Update: New publications
It has taken a while, but during this time a few of the students' replication and extensions projects we submitted to journals have finally been accepted for publication.
Replications started in Maastricht:
- Jamison, Yay, & Feldman (2020). Action-inaction asymmetries in moral scenarios: Replication of the omission bias examining morality and blame with extensions linking to causality, intent, and regret. Journal of Experimental Social Psychology.
- Ziano, I., Yao, J., Gao, Y., & Feldman, G. (2020).Impact of ownership on liking and value: Replications and extensions of three ownership effect experiments. Journal of Experimental Social Psychology.
Replications from our HKU mass replication project
- Chen, J., Hui, L.S., Yu, T., & Feldman, G., et al. (2020) Foregone opportunities and choosing not to act: Replications of Inaction Inertia effect. Social Psychological and Personality Science.
- Ziano, Wang, Sany, Feldman, Ngai, Lau, Bhattal, Keung, Wong, Tong, Cheng, & Chan (2020). Perceived morality of direct versus indirect harm: Replications of the preference for indirect harm effect. Meta Psychology. DOI: 10.31234/osf.io/bs7jf
Other related publications:
- Feldman, G., Kutscher, L., & Yay, T. (2020). Omission and commission in judgment and decision making: Linking action-inaction effects using the concept of normality. Social and Personality Psychology Compass.
- Feldman, G. (2020). What is normal? Dimensions of action-inaction normality and their impact on regret in the action-effect. Cognition and Emotion.
.
Update: New pre-prints
There are now quite a few pre-prints in various stages of the review life-cycle.
We'd appreciate feedback on any of those
- Agency and self-other asymmetries in perceived bias and shortcomings: Replications of the Bias Blind Spot and extensions linking to free will beliefs.
- Frequency estimation and semantic ambiguity do not eliminate conjunction bias, when it occurs: Replication and extension of Mellers, Hertwig, and Kahneman (2001).
- Revisiting Disjunction Effect: Replication and extension of Tversky and Shafir (1992) comparing between and within subject designs.
- Misprediction of affective outcomes due to different evaluation modes: Replication and extension of two distinction bias experiments by Hsee and Zhang (2004).
- Accentuation and compatibility: Replication and extensions of Shafir (1993) to rethink Choosing versus Rejecting paradigms
- Revisiting the decoy effect: Replication and extension of Ariely and Wallsten (1995) and Connolly, Reb, and Kausel (2013). [Stage 1 Registered Report]
- Revisiting "Money Illusion": Replication and extension of Shafir et al. (1997)
- Revisiting status quo bias: Replication of Samuelson and Zeckhauser (1988)
- Revisiting Global Self-Evaluation: Replication and Extension of Alicke (1985)
- Risky therefore not beneficial: Replication and extension of Finucane et al. (2000)'s Affect Heuristic experiment
Other pre-prints not from the replications project:
- Fillon, Lantian, Feldman, & N'gbala. Exceptionality Effect in Agency: Exceptional Choices Attributed Higher Free Will Than Routine.
- Lim & ^Feldman.Values and the dark side: Meta-analysis of links between Dark Triad traits and personal values [Registered Report Stage 1]
Prediction markets
If you recall, in December I invited you to join paid prediction markets to place bets on our replication outcomes. After those closed, I also ran those on Twitter. There was surprising convergence between the two.
Thanks to all those who took part!
Summary of results on Twitter:
Talks and workshops
Since October I visited and presented or ran workshops at the following:
- Taiwan: NCKU and NTU
- Australia: UNSW
- Israel: Technion and OpenU
- Brazil: Mackenzie Presbyterian University and Sao Paulo University.
The last most updated presentation is the one I gave in Brazil.
Book by students: Replication Crisis - Taking stock of the credibility revolution
If you recall, in November, I asked for your help in reviewing a book the students wrote as part of the PSYC2020 Fundamentals of Social Psychology course.
We have a first preprint that you're welcome to read and/or use in any way you like.
If you'd like to comment and/or add content, check out the Google Doc.
==
Feel free to share any of these with others. Happy to answer questions.
If you want to talk more about implementing open-science, pre-registered replications, meta-analyses, etc. in your department and/or university, please do get in touch, I'm very happy to help.
Best regards,
--
Gilad Feldman (Fili)
Department of Psychology
University of Hong Kong
Website | Researchgate | Google Scholar | Twitter
|
