06 Survey and Instrument Development

06 Survey and Instrument Development

by Jerome Cleofas

Humanities, Social Sciences & Thought Science — General & History GPSResearch methodsGPSBEmpirical research methods
🎙 Jerome Cleofas 👥 2K 📅 June 14, 2026 ⏱ 63 min 👁 156 📄 tutorial 🧭 2026-08-16
Available in: English (current) Français

Keywords

surveyinstrumentreliabilityvaliditypsychometrics

Summary

This lecture provides a comprehensive overview of survey and instrument development in quantitative social science research. It begins by situating surveys as a primary data collection method for self-report data, contrasting them with observation and archival research. The speaker emphasizes the importance of aligning theoretical concepts with empirical measurement through a clear conceptual spine. He explains the hierarchy from concepts to constructs to variables to operational definitions and finally to survey items, using personality and extraversion as an example. The lecture distinguishes between standardized, researcher-made, and modified questionnaires, advocating for the use of psychometrically validated instruments whenever possible. It covers the process of selecting existing scales, including considerations of cultural and linguistic validation, and mentions resources like APA PsycTests and reference mining. The speaker discusses different types of survey items, such as closed-ended, open-ended, Likert scales, semantic differentials, and attention checks. He also addresses practical issues like pre-testing, pilot studies, intellectual property, and ethical approval. The importance of reliability and validity is stressed, with a brief mention of factor analysis. The lecture concludes with advice on ensuring instrument fit and alignment with research questions.

184 words

Critical Evaluation

Value of the Information & Strength of the Argument

The lecture provides valuable, practical guidance for students and researchers designing surveys. It offers a clear framework for moving from abstract concepts to measurable items, and emphasizes the importance of using validated instruments. The argumentation is coherent and well-structured, building logically from foundational concepts to practical considerations. The speaker supports his points with examples and personal recommendations, but does not provide empirical evidence or citations to specific studies, which somewhat limits the depth of the argumentation.

Scientific Rigor, Source Quality, Title Accuracy

The lecture demonstrates a solid understanding of survey methodology, but it lacks explicit citations to specific sources during the talk. The speaker mentions established scales (e.g., Maslach Burnout Inventory, Rosenberg Self-Esteem Scale) and databases (e.g., APA PsycTests) but does not provide direct references. The title accurately reflects the content. The description provides a brief outline but no additional sources. Overall, the scientific rigor is moderate: the content is accurate and well-informed, but the lack of explicit citations reduces its verifiability.

171 words

Title / Content Match

The title accurately reflects the content, which focuses on survey and instrument development.

Quality & Reliability

7/10

The content is a structured academic lecture covering survey design, reliability, validity, and instrument selection. It is based on established methodological principles, but lacks explicit citations to specific sources during the talk. The speaker demonstrates expertise but does not provide direct references, limiting verifiability.

Key Moments

Markers derived by PSI from the transcript: the creator did not define chapters.

Cited Sources

  • APA PsycTests — Mentioned as a database for finding validated questionnaires.
  • Maslach Burnout Inventory — Mentioned as a proprietary scale for measuring burnout.
  • Rosenberg Self-Esteem Scale — Mentioned as a well-established scale for self-esteem.
  • Satisfaction with Life Scale — Mentioned as a staple scale for life satisfaction.

Concurring Sources

  • APA PsycTests — Database for finding validated questionnaires.
  • Maslach Burnout Inventory — Proprietary scale for burnout.
  • Rosenberg Self-Esteem Scale — Well-established scale for self-esteem.
  • Satisfaction with Life Scale — Staple scale for life satisfaction.

Contribution & Novelties

The lecture provides a clear, structured guide to survey development, emphasizing the importance of using validated instruments and aligning them with the conceptual framework. It offers practical advice on selecting, modifying, and pre-testing surveys, and highlights resources for finding existing scales. The discussion of cultural and linguistic validation is particularly useful for researchers working in non-Western contexts.

Pour aller plus loin :

103 words

Radar Profile

The radar profile shows high scores in quantity of information and reliability, with moderate scores in quality and technical level. This indicates a comprehensive and trustworthy lecture, though it may not delve deeply into advanced statistical techniques or provide extensive empirical evidence.

Reliability 7/10