Copy

Invitation to open peer-review Replications (and Extensions) Stage 1 Registered Reports [Deadline: November 20th]

Dear colleagues and friends,


This is an open invitation to join us to open peer-review our students'  Replication and Extension Registered Reports (RRR) Stage 1. This semester we are targeting 13 classics in social cognition and judgment and decision-making. The students submitted their 1st stage Registered Report, which are now undergoing review until November 20th, and then they will have a chance to revise. After the semester is over, we will be submitting those to journals as Registered Reports for review. At that stage, there would be the potential for you as reviewers to join us in taking lead and/or collaborate on the RRR Stage 1 journal submissions.

More details on all that below.

This is part of our mass pre-registered replications project at University of Hong Kong, which will pass 100 replications by the end of the year

[Mailing list explanation: I started using an email mailing list to keep those who work with me, know me, and/or attend my activities updated about all that we're doing in my lab at HKU. I am hoping to help you in your research activities and slowly build a community interested in open-science to promote the "credibility revolution". I add those who have asked me or corresponded with me about my research or activities. If you're not interested in further updates, links to unsubscribe available at the bottom. If others want to join/previous emails: https://tinyurl.com/giladmailinglist ]
 

Our process

Students analyzed the replication targets in detail, thought up extensions, designed a Qualtrics experiment, generated random datasets, and prepared data analysis plan using the random dataset. Then wrote pre-registrations in a Registered Report Stage 1 format (see course syllabus for PSYC3052 and PSYC2071):



=

If this intrigues you and you think you might be interested in joining and open peer reviewing our replications and extensions, send me back an email with the targets you'd like to review.

Materials and information
The Airtable with all projects, with info and links to Google Docs/materials:

Advanced Social Psychology PSYC3052: https://airtable.com/shrjhXd3WiofhA70w

Judgment and Decision making PSYC2071: https://airtable.com/shrnkj6wo0gJC6Ygb

 
All the projects are also available on the Dropbox: 
https://mgto.org/hku2020reviewbox 

If there’s something you can’t find, please let me know.

The replications we are doing this semester:
  • Advanced Social Psychology:
    • Ames, Flynn, & Weber (2004)
    • Carter & Gilovich (2010)
    • Epley, Akalis, Waytz, & Cacioppo (2008)
    • Kasser & Ryan (1993)
    • Koehler & Gershoff (2003)
    • Monin & Miller (2001)
    • Norton, Frost, & Ariely (2007)
    • Van Boven & Gilovich (2003)
    • Watkins, Scheer, Ovnicek, & Kolts (2006)
    • Waytz, Morewedge, Epley, Monteleone, Gao, & Cacioppo (2010)
  • Judgment and Decision Making:
    • Hardisty, Johnson, & Weber (2010)
    • McKenzie, Liersch, & Finkelstein (2006)
    • Rottenstreich & Hsee (2001)

Please note:
  1. For each replication target, we have two groups of two students working independently.
    They have separate reports, and we ask that you go through both. If you can only go through one, then please indicate back to me which that was.
    You are the external reviewers, but during this time these groups are also peer-reviewing one another.
  2. For each group, the Airtable includes:
    1. A link to the original article.
    2. A link to the RRR main manuscript (based on our main manuscript template)
    3. A link to a comprehensive open-science RRR supplementary materials (based on our supplementary template)
    4. A link to a Dropbox with the:
      1. Qualtrics files (.QSF and exported .DOCX)
      2. A randomly generated response dataset from Qualtrics.
      3. Sample data analysis of the randomly generated dataset, using either JAMOVI or R/Rmarkdown. This is to be pre-registered together with the pre-registrations. Students needed to write their results sections based on that to be later replaced with results from the real data collection.
  3. Keep in mind: this is ==before== data collection. All analyses are on the simulated dataset, which will be replaced after pre-registration and data collection.
  4. Deadline RRR peer-review is set for November 20th. We are on a tight semester schedule, but if you find you need longer or cannot meet this task at all, please let me know.


Your review
Not a must, 100% up to you, feel free to use whatever format you’d like for your review, yet if you want - we generally encourage you check our peer review template/guide:
http://mgto.org/peerreviewtemplate
 
Notes:
  1. Feel free to comment on the students’ documents in-text.
  2. Please use our template for your overall summary. It details what kind of review the students need to submit for each other. You don’t have to do all of it, but it will give you a list of things to cover in case you’re not sure what to review or how.
  3. If you do decide to use the peer review template:
    1. Please make a duplicate of our peer review Google Doc, name it clearly, and work on that. It’s meant to help you, not restrict you, so add/change/remove anything you’d like.
    2. Please reply with a link of your peer review Google Doc back to me before deadline.
 
Keep in mind:
  1. These are undergraduate students doing their first ever real science project. Up to this course they have had very limited training in statistics or methods, and no training about open-science.
  2. Please be very gentle, positive, supporting, encouraging, and constructive.
  3. Students reports should read like an APA manuscript with specific content. Our replication guide had a section called “Submissions: When to submit what?” and the stage you’re reviewing is “Registered Report Stage 1: Full pre-registration [Part 2]”.
 
If you have specific questions about a specific review or replication target, please let me know.

==
 

Feel free to share any of these with others in your labs/departments. Happy to answer questions.

If you want to talk more about implementing open-science, pre-registered replications, meta-analyses, etc. in your department and/or university, please do get in touch, I'm very happy to help.



Best regards,
 
--
Gilad Feldman (Fili)
Department of Psychology
University of Hong Kong
 
Google Scholar | Website | Researchgate

About this mailing list.

Want to change how you receive these emails?
You can update your preferences or unsubscribe from this list.






This email was sent to <<Email Address>>
why did I get this?    unsubscribe from this list    update subscription preferences
Gilad Feldman (HKU) · 6/22, Department of Psychology, University of Hong Kong · Pok Fu Lam road, HK island · Hong Kong · Hong Kong

Email Marketing Powered by Mailchimp