Interviewer effects in food acquisition surveys

• Published in: Public health nutrition Vol. 21; no. 10; pp. 1781 - 1793
• Main Authors: Ong, Ai Rene, Hu, Mengyao, West, Brady T, Kirlin, John A
• Format: Journal Article
• Language: English
• Published: Cambridge, UK Cambridge University Press 01.07.2018
• Subjects: Accounting; Agricultural management; Agriculture; Assessment and Methodology; Childrens health; Consent; Data acquisition; Data collection; demographic statistics; Demographics; Demography; Diaries; Federal agencies; Food; Food security; Food selection; Food stamps; Health care; Households; Income; Interviews; Nutrition; Nutrition research; Polls & surveys; Research Papers; School lunches; socioeconomic status; Socioeconomics; Studies; Supplemental Nutrition Assistance Program; surveys; United States; USDA; Variance; United States > US; United States; Food acquisition surveys; Multilevel modeling; Survey methodology; Interviewer effects; FoodAPS
• ISSN: 1368-9800; 1475-2727; 1475-2727
• DOI: 10.1017/S1368980018000137

To understand the effects of interviewers on the responses they collect for measures of food security, income and selected survey quality measures (i.e. discrepancy between reported Supplemental Nutrition Assistance Program (SNAP) status and administrative data, length of time between initial and final interview, and missing income data) in the US Department of Agriculture's National Household Food Acquisition and Purchase Survey (FoodAPS). Using data from FoodAPS, multilevel models with random interviewer effects were fitted to estimate the variance in each outcome measure arising from effects of the interviewers. Covariates describing each household's socio-economic status, demographics and experience in taking the survey, and interviewer-level experience were included as fixed effects. The variance components in the outcomes due to interviewers were estimated. Outlier interviewers were profiled. Non-institutionalized households in the continental USA (April 2012-January 2013). Individuals (n 14 317) in 4826 households who responded to FoodAPS. There was a substantial amount of variability in the distributions of the outcomes examined (i.e. time between initial and final interview, reported values for food security, individual income, missing income) among the FoodAPS interviewers, even after accounting for the fixed effects of the household- and interviewer-level covariates and removing extreme outlier interviewers. Interviewers may introduce error in food acquisition survey data when they are asked to interact with the respondents. Managers of future surveys with similarly complex data collection procedures could consider using multilevel models to adaptively identify and retrain interviewers who have extreme effects on data collection outcomes.