B
 
   
  Dissertation Fellowships
  Primary Topics
  Other Topics
    BAC Studies
    Fear Appeals
    Focus Groups
    High Schools
    Self-Reports
  Articles
  Bibliographies
 
Other Topics - Self-Report Data

Given the relative ease and low cost with which they are gathered, self-report data have become the predominant way of measuring and describing the prevalence of many behaviors, including alcohol consumption and tobacco use.

However, the validity of self-report data is sometimes called into question. Do self-reports provide accurate data? A review of the literature reveals that, generally speaking, they do. (Babor et al., 2000; Patrick et al., 1994; Frier et al., 1991; Midanik, 1988; Cooper et al., 1981).

It has been noted that much of the skepticism about the accuracy of self-reports—especially in regard to alcohol consumption—stems from the identification of the denial of problem drinking as key feature of alcoholism (Babor and Del Boca, 1992). Babor and Del Boca (1992, p.5) have summarized many of the factors that can cause variability in the accuracy of self-reports; they include:

  • "The sensitivity of the information sought (e.g. demographic vs arrest records)
  • The specificity of the validation criteria (e.g., archival records, breath alcohol readings, urine tests, informant's reports)
  • The personal characteristics of the respondents (e.g., sober vs intoxicated)
  • The time window of the report (e.g., lifetime vs recent) and
  • The demand characteristics of the task situation (e.g., clinical interview vs research evaluation)."

As Midanik has argued (Midanik, 1989), the question that needs to be addressed is not "are self-reports…valid," but rather "under what conditions do self-reports vary? "

A recent review of the empirical literature of adolescent self-reports essentially arrives at the same conclusion (Brener, Billy, and Grady, 2003). This review assessed the cognitive and situational factors that may affect the validity of adolescents' self-reports of six different health-risk behaviors. Cognitive factors can compromise validity and yield inaccurate data as a result of things such as respondents' poor comprehension or faulty recall, whereas situational factors can compromise validity as a result of things such as the method of survey administration (e.g., confidential vs. anonymous) or social desirability bias. As the Brener et al. review makes clear, cognitive and situational factors do not affect the validity of each type of self-reported behavior equally. For example, unless they are athletes, youngsters are not in general very sensitive about behaviors related to physical activity. Given that, one would expect situational factors to have a neglible impact on self-reported data about such activities. By contrast, tobacco use engenders a good deal of social disapproval and is, moreover, illicit for those under 18 years of age. Thus, an interviewer-administered questionnaire (IAD) about adolescent physical activity is less likely to yield inaccurate self-report data than an IAD about adolescent tobacco use. Given that the effective assessment of health-risk behaviors necessitates the continued use of self-report data, Brener et al. conclude that "researchers should familiarize themselves with the threats to validity inherent in this type of assessment and design research that minimizes these threats as much as possible (op. cit., 436)."

References

Babor, T.F., Steinberg, K., Anton. R. & Del Boca, F. K. (2000). Talk is cheap: Measuring drinking outcomes in clinical trials. Journal of Studies on Alcohol, 61 (1), 55-63.

Babor, T.F. & Del Boca, F.K. (1992). Just the facts: Enhancing measurements of alcohol consumption using self-report methods. In R. Litten & J. Allen (Eds.), Measuring alcohol consumption: Psychosocial and biochemical methods. (pp.3-19). Totawa, NJ: Humana Press.

Brener, N.D., Billy, J.O., & Grady, W.R. (2003). Assessment of factors affecting the validity of self-reported health-risk behavior among adolescents: Evidence from the scientific literature. Journal of Adolescent Health 33, 436-457.

Cooper, A.M., Sobell, M.B., Sobell, L.C. & Maisto, S.A. (1981). Validity of alcoholics' self-reports: Duration data. International Journal of Addiction 16, 401-406.

Freier, M.C., Bell, R.M. & Ellickson, P. (1991). Do teens tell the truth? The validity of self-reported tobacco use by adolescents. Santa Monica, CA: The Rand Corporation.

Midanik, L. (1989). Perspectives on the validity of self-report alcohol use. British Journal of Addictions 84, 1419-1423.

Midanik, L. (1988). Validity of self-report alcohol use: A literature review and assessment. British Journal of Addictions 83, 1019-1030.

Patrick, D.L., Cheadle, A., Thompson, D.C., Diehr, P., Koepsell, T. & Kinne, S. (1994). The validity of self-reported smoking: A review and meta-analysis. American Journal of Public Health 84 (7), 1086-1093.