Public Health Nutrition

Part E. New statistical approaches to dealing with bias associated with dietary data

Bias in dietary-report instruments and its implications for nutritional epidemiology

Victor Kipnisa1 c1, Douglas Midthunea1, Laurence Freedmana2, Sheila Binghama3, Nicholas E Daya4, Elio Ribolia5, Pietro Ferraria5 and Raymond J Carrolla6

a1 Biometry Research Group, Division of Cancer Prevention, National Cancer Institute, Bethesda, MD 20892-7354, USA

a2 Bar Ilan University, Ramat Gan, Israel and Gertner Institute for Epidemiology and Health Policy Research, Tel Hashomer, Israel

a3 Medical Research Council, Dunn Human Nutrition Unit, Cambridge, UK

a4 Strangeways Research Laboratory, University of Cambridge, Cambridge, UK

a5 Unit of Nutrition and Cancer, International Agency for Research on Cancer, Lyon, France

a6 Department of Statistics, Texas A&M University, College Station, TX, USA


Objective: To evaluate measurement error structure in dietary assessment instruments and to investigate its implications for nutritional studies, using urinary nitrogen excretion as a reference biomarker for protein intake.

Design: The dietary assessment methods included different food-frequency questionnaires (FFQs) and such conventional dietary-report reference instruments as a series of 24-hour recalls, 4-day weighed food records or 7-day diaries.

Setting: Six original pilot validation studies within the European Prospective Investigation of Cancer (EPIC), and two validation studies conducted by the British Medical Research Council (MRC) within the Norfolk cohort that later joined as a collaborative component cohort of EPIC.

Subjects: A sample of approximately 100 to 200 women and men, aged 35–74 years, from each of eight validation studies.

Results: In assessing protein intake, all conventional dietary-report reference methods violated the critical requirements for a valid reference instrument for evaluating, and adjusting for, dietary measurement error in an FFQ. They displayed systematic bias that depended partly on true intake and partly was person-specific, correlated with person-specific bias in the FFQ. Using the dietary-report methods as reference instruments produced substantial overestimation (up to 230%) of the FFQ correlation with true usual intake and serious underestimation (up to 240%) of the degree of attenuation of FFQ-based log relative risks.

Conclusion: The impact of measurement error in dietary assessment instruments on the design, analysis and interpretation of nutritional studies may be much greater than has been previously estimated, at least regarding protein intake.


c1 *Corresponding author: Email