Survey modes comparison in contingent valuation

internet panels and mail surveys

Mandy Ryan* (Corresponding Author), Emmanouil Mentzakis, Catriona Matheson, Christine Bond

*Corresponding author for this work

Research output: Contribution to journalArticle

Abstract

Stated preferences methods are extensively applied in health economics to elicit preferences. Whilst mailed surveys were commonly used to collect data, internet panel (IP) surveys are being increasingly used. This raises questions about the validity of responses and estimated willingness-to-pay (WTP) values generated from IP surveys. We conduct the first study in health to compare a contingent valuation (CV) internet panel survey with a mailed survey using the Electoral Roll. Our IP has a higher response rate and lower item missing response rate. The difference is reduced but remains when restricting comparisons to valid WTPs. Sample characteristics differ, with significant differences between modes for gender, age, income, and attitudes and knowledge. Whilst difference in WTP values exist, with the IP resulting in higher values, we find limited evidence that such differences are statistically significant. The mail survey has lower initial cost per response; however, once restricting samples to valid WTP responses with non-missing respondent information the cost per response across modes is similar. Our results, suggesting that internet panels generate valid and cost-effective values, are encouraging as researchers move increasingly to IPs to collect preference data.
Original languageEnglish
JournalHealth Economics
Publication statusAccepted/In press - 19 Nov 2019

Fingerprint

Postal Service
Internet
Costs and Cost Analysis
Health
Surveys and Questionnaires
Economics
Research Personnel

Cite this

@article{ec63b5253aa242d9bb38b5d88481ccb6,
title = "Survey modes comparison in contingent valuation: internet panels and mail surveys",
abstract = "Stated preferences methods are extensively applied in health economics to elicit preferences. Whilst mailed surveys were commonly used to collect data, internet panel (IP) surveys are being increasingly used. This raises questions about the validity of responses and estimated willingness-to-pay (WTP) values generated from IP surveys. We conduct the first study in health to compare a contingent valuation (CV) internet panel survey with a mailed survey using the Electoral Roll. Our IP has a higher response rate and lower item missing response rate. The difference is reduced but remains when restricting comparisons to valid WTPs. Sample characteristics differ, with significant differences between modes for gender, age, income, and attitudes and knowledge. Whilst difference in WTP values exist, with the IP resulting in higher values, we find limited evidence that such differences are statistically significant. The mail survey has lower initial cost per response; however, once restricting samples to valid WTP responses with non-missing respondent information the cost per response across modes is similar. Our results, suggesting that internet panels generate valid and cost-effective values, are encouraging as researchers move increasingly to IPs to collect preference data.",
author = "Mandy Ryan and Emmanouil Mentzakis and Catriona Matheson and Christine Bond",
year = "2019",
month = "11",
day = "19",
language = "English",
journal = "Health Economics",
issn = "1057-9230",
publisher = "John Wiley and Sons Ltd",

}

TY - JOUR

T1 - Survey modes comparison in contingent valuation

T2 - internet panels and mail surveys

AU - Ryan, Mandy

AU - Mentzakis, Emmanouil

AU - Matheson, Catriona

AU - Bond, Christine

PY - 2019/11/19

Y1 - 2019/11/19

N2 - Stated preferences methods are extensively applied in health economics to elicit preferences. Whilst mailed surveys were commonly used to collect data, internet panel (IP) surveys are being increasingly used. This raises questions about the validity of responses and estimated willingness-to-pay (WTP) values generated from IP surveys. We conduct the first study in health to compare a contingent valuation (CV) internet panel survey with a mailed survey using the Electoral Roll. Our IP has a higher response rate and lower item missing response rate. The difference is reduced but remains when restricting comparisons to valid WTPs. Sample characteristics differ, with significant differences between modes for gender, age, income, and attitudes and knowledge. Whilst difference in WTP values exist, with the IP resulting in higher values, we find limited evidence that such differences are statistically significant. The mail survey has lower initial cost per response; however, once restricting samples to valid WTP responses with non-missing respondent information the cost per response across modes is similar. Our results, suggesting that internet panels generate valid and cost-effective values, are encouraging as researchers move increasingly to IPs to collect preference data.

AB - Stated preferences methods are extensively applied in health economics to elicit preferences. Whilst mailed surveys were commonly used to collect data, internet panel (IP) surveys are being increasingly used. This raises questions about the validity of responses and estimated willingness-to-pay (WTP) values generated from IP surveys. We conduct the first study in health to compare a contingent valuation (CV) internet panel survey with a mailed survey using the Electoral Roll. Our IP has a higher response rate and lower item missing response rate. The difference is reduced but remains when restricting comparisons to valid WTPs. Sample characteristics differ, with significant differences between modes for gender, age, income, and attitudes and knowledge. Whilst difference in WTP values exist, with the IP resulting in higher values, we find limited evidence that such differences are statistically significant. The mail survey has lower initial cost per response; however, once restricting samples to valid WTP responses with non-missing respondent information the cost per response across modes is similar. Our results, suggesting that internet panels generate valid and cost-effective values, are encouraging as researchers move increasingly to IPs to collect preference data.

M3 - Article

JO - Health Economics

JF - Health Economics

SN - 1057-9230

ER -