Policy Impacts are in the Eye of the Beholder: Experimental Evidence from Structural Reforms in Italy

Value of the Information & Strength of the Argument

The value of the information is high, as it provides novel experimental evidence on belief updating in the context of structural reforms, a topic with significant policy relevance. The argumentation is solid: the study uses a well-designed survey experiment with random assignment, real scientific evidence, and non-deceptive treatments. The theoretical framework of Bayesian updating is clearly presented and motivates the empirical analysis. The results are presented with appropriate nuance, acknowledging variations across policies and the lack of source effects. The authors contribute to the literature on misperceptions about policy effects and on the role of media credibility in belief formation. The presentation is persuasive, though some limitations (e.g., reliance on self-reported political orientation, potential demand effects) are not deeply discussed.

Scientific Rigor, Source Quality, Title Accuracy

The scientific rigor is high: the study uses a representative sample, random assignment, and real scientific evidence from published papers. The sources are credible, including studies published in top journals (e.g., the American Economic Review). The title accurately reflects the content, focusing on how policy impacts are perceived and how belief updating depends on the source’s political alignment. The presentation does not overstate the findings and acknowledges limitations. The use of real news outlets (La Repubblica and Il Giornale) adds ecological validity. Overall, the sources and methodology are of high quality, and the title is appropriate.

The title accurately reflects the core research question about how policy impacts are perceived and how belief updating depends on the political alignment of information sources.

8/10

The presentation is based on a rigorous survey experiment with a large representative sample, using non-deceptive treatments and real scientific evidence. The methodology is clearly described, and the results are presented with appropriate caution. However, the presentation is a seminar talk, not a peer-reviewed publication, and some details (e.g., exact sample sizes, statistical precision) are not fully disclosed.

Markers derived by PSI from the transcript: the creator did not define chapters.

• 02:00Introduction to the seminar and the paper's topic on structural reforms and belief updating.
• 05:00Overview of the research questions and the contribution to the literature.
• 10:00Description of the theoretical framework of Bayesian belief updating.
• 15:00Introduction to the Italian Survey of Consumer Expectations (ISA) and its methodology.
• 20:00Presentation of the four policies studied and their media salience.
• 25:00Explanation of the experimental design and treatment conditions.
• 30:00Example of the evidence provided to respondents for the migrant regularization policy.
• 35:00Description of the outcome measures: beliefs about policy impacts and accuracy.
• 40:00Presentation of the main results: belief updating across policies.
• 45:00Discussion of the role of political alignment of the source and conclusion.

• Pinotti, P. (2017). 'Clicking on Heaven's Door: The Effect of Immigrant Legalization on Crime.' American Economic Review, 107(1), 138-68. — Cited as the scientific evidence on the effect of migrant regularization on crime.

• Pinotti, P. (2017). 'Clicking on Heaven's Door: The Effect of Immigrant Legalization on Crime.' American Economic Review. — The scientific evidence used for the migrant regularization policy.