Assignment 2 – Pure replication and completion plan
Fast Fact:
Reproduce and discuss descriptive statistics and main results of your OP
Main result = main table or figure (Yes, you have to use your own judgment as to what the “main” table or figure is!
Discuss issues you have run into thus far
Outline steps for completion, including your planned extension
Word count: 1,200 words
Weight: 25%
Total marks: 100
Learning by Replicating
1. Introduction
Briefly state (in 2-3 paragraphs) why the paper is interesting (both generally and as it relates to the economics literature), the key research question(s), the empirical approach, and the main findings. You can repeat some of the things you included in your presentation, but hopefully by now you have also built on that knowledge and gained a deeper understanding of the literature and paper itself.
Outline what you will discuss in the subsequent sections of your paper.
2. Data
Describe the replication data and code provided.
3. Pure replication-3.1 Reproduction & discussion
Reproduce the summary statistics from OP. Discuss any discrepancies (examine the number of observations, for example, to make sure that you are working with the same sample).
Identify a table or figure that constitutes (in your opinion) the most important or most interesting result in the paper. Note that there may be some overlap here with your presentation materials; that is fine, so long as you are rephrasing your statements in written language (a.o.t. presentation bullet points or spoken language).
Reproduce this main table / figure and discuss. You should aim to discuss both (i) the main findings and their interpretation as it relates to the hypothesis of the OP, and (ii) anything you learned / noticed / struggled with in replicating it.
3.2 Code and challenges
Describe any issues that you faced with the code that the authors provided. Describe any challenges you have faced so far, and how you approached solving them. Reflect on what you’ve learned from the exercise thus far.
If you are unable to reproduce one or more of the OP tables / figures…
…describe the reasons why you are submitting your assignment without having reproduced the main results. Is it due to software access? Coding issues (for example, the code is too complicated or there is a substantive coding error that you have been unable to solve)? Mismatch of software version? Whatever your challenges, discuss what steps you have taken to overcome them and what the outcome has been. Give yourself a pat on the shoulder for persisting with this difficult task and reflect on what remains to be done.
If you have successfully reproduced relevant tables / figures…
…comment on your experience in general (after you give yourself a little high five!). Has it been a smooth process, or did you face issues along the way? If so, how did you go about addressing them?
4. Roadmap
Review our lecture on the typology of replications and explain your planned approach. Using the terminology of Clemens (2017), how do you plan to extend the OP’s work?
4.1 Innovation
Why is your proposed extension meaningful or interesting? What value does the proposed extension or re-analysis add to OP or to this literature? How are you advancing knowledge? Ideally, cite a high-quality reference from the literature in support of your plan.
4.2 Approach
If you plan to do a re-analysis, how do you propose to alter the OP’s specifications? You should write the OP’s original estimating equation as well as your planned modification and explain what you are doing differently.
OR
“I plan to extend OP’s analysis, which covers the years 2015-2017, by analysing more recent data sourced from Gallup World Poll surveys, 2018-21.”
Discuss any logistical issues you anticipate you might face, such as issues in accessing data, software etc.? In general, briefly discuss any problem you might be anticipating in implementing your plan and mention a Plan B if your Plan A fails.
