Are Computer-Administered Web Surveys Leading to Lower Survey Representativeness in Population Research? The Case of the Generations and Gender Survey

Alexander Kortinkboada , NIDI
Nursel Alkoç, Netherlands Interdisciplinary Demographic Institute

Surveys are widely used to gain information on thoughts, behaviors, and attitudes of participants. While they were traditionally administered via face-to-face settings or over the telephone, there has been a shift to a self-completed web mode (CAWI) for various reasons. This shift is exemplified in the Generations and Gender Survey (GGS) rounds I and II, with an increasing number of countries adopting a fully CAWI or a mixed modes approach in round II. A key issue is ensuring that this shift to CAWI does not adversely affect the representativeness of the sample. For this reason, the present study examines whether the shift to CAWI has decreased the data representativeness in the GGS-II. We analyze data from seven countries (Austria, Estonia, the Netherlands, Czechia, France, Germany and Sweden) who participated in both GGS rounds, and we compare their samples to (relatively) objective demographic data from trusted sources to assess underrepresentation. We hypothesize the following: since CAWI may require a higher degree of technical access and confidence, we expect that its adoption will lead to a larger underrepresentation of individuals who are older or have a lower education level. Additionally, the level of language proficiency required may be higher for CAWI, leading to underrepresentation of individuals with a migration background. The results of the study are discussed and recommendations for future practice are provided.

See extended abstract

 Presented in Session 112. Survey Mode Effects and Measurement Challenges in Demographic Research