This article has Open Peer Review reports available.
Physical activity screening to recruit inactive randomized controlled trial participants: how much is too much?
© Vandelanotte et al. 2015
Received: 17 May 2015
Accepted: 25 September 2015
Published: 8 October 2015
Screening physical activity levels is common in trials to increase physical activity in inactive populations. Commonly applied single-item screening tools might not always be effective in identifying those who are inactive. We applied the more extensive Active Australia Survey to identify inactive people among those who had initially been misclassified as too active using a single-item measure. Those enrolled after the Active Australia Survey screening had significantly higher physical activity levels at subsequent baseline assessment. Thus, more extensive screening measures might result in the inclusion of participants who would otherwise be excluded, possibly introducing unwanted bias.
Australian New Zealand Clinical Trials Registry, ACTRN12611000157976.
Long-term physical inactivity is associated with increased levels of chronic disease and reduced quality of life . The majority of the population, however, does not engage in enough physical activity to gain optimum health benefits . Randomized controlled trials are being conducted, to examine the effectiveness of interventions to increase physical activity. Many of these trials screen physical activity levels of potential study participants with the aim of only recruiting participants who are low-active .
Pre-randomization screening to enroll low-active participants might increase intervention effect sizes; which might necessitate a smaller study sample to demonstrate between-group differences . People already meeting physical activity recommendations are often attracted to physical activity interventions, though they are typically not the target audience for these kinds of intervention, as there are fewer public health benefits in increasing activity in active people, especially when resources are limited . Participants with low activity levels also have a greater capacity to increase activity levels and ceiling effects are less likely to occur; thus, the likelihood that the intervention will be successful in demonstrating its effectiveness is greater . Finally, active people are known to be responsive to physical activity messages, even in the absence of an intervention to help them become more active. Therefore, to decrease the probability of the control group becoming more active (which would undermine study outcomes) recruiting a sample that is resistant to change in the absence of an intervention (i.e., inactive people) is beneficial .
Waters et al.  indicated that 18 out of 23 trials that they evaluated implemented some sort of physical activity screening, but that the methods applied and the physical activity cut-off points used to determine eligibility varied greatly. The majority of studies have used single-item physical activity screening tools, mainly to ensure that participant recruitment is efficient and of little burden to those wanting to participate . Although some studies have demonstrated acceptable validity for single-item measures , it has also been commonly reported that large proportions of participants still meet physical activity guidelines at the trial baseline assessment when more rigorous physical activity measures are applied, such as full-length questionnaires or objective accelerometer-based measures .
In this study, we examined the effectiveness of a two-stage physical activity screening process as part of a three-arm randomized controlled trial (‘Walk 2.0’) . The Walk 2.0 trial investigated the effectiveness of two web-based physical activity interventions (a traditional web 1.0 intervention and an intervention including online social networking and other web 2.0 components) compared with a print-based intervention . A total of 1244 people completed the initial screening questionnaire and 504 people were randomized into one of three groups. People were excluded based on a number of screening criteria (e.g., under 18 years of age, no internet access, medical condition that prevents increased activity), although the numbers presented here only relate to the outcomes of the physical activity screening. A full overview of why and at what stage participants were excluded from the trial will be presented elsewhere.
Physical activity screening was applied in two steps. The first step included application of a commonly used single-item physical activity measure: ‘As a rule, do you engage in at least half an hour of moderate or vigorous exercise (such as walking or a sport) on five or more days of the week (yes/no)?’ . This measure has demonstrated good concurrent validity, identifying 77 % of those who were physically inactive according to a more extensive assessment of physical activity . Those who answered ‘no’ to this single-item measure were deemed eligible to participate; however, those who answered ‘yes’ underwent a second step of telephone-administered screening, using the Active Australia Survey . This survey includes items to assess the duration and frequency of walking, and of moderate and vigorous physical activity in the previous week and has demonstrated acceptable reliability and validity . Participants were only eligible to participate when reporting less than 150 min/week of physical activity using this survey. This two-step protocol was applied to minimize participant burden (for those who were eligible after the first step), and maximize the use of resources allocated to recruitment (to ensure that eligible participants were not excluded if the initial assessment was inaccurate).
A total of 418 people answered ‘no’ to the single-item measure and were accepted into the trial, whereas the 370 people who answered ‘yes’ underwent further screening using the Active Australia Survey. Of these, 284 (76.8 %) reported more than 150 min/week of physical activity and were excluded as too active to participate in the trial. The average level of physical activity of those excluded was 306 ± 217 min/week. The 86 (23.2 %) people who were included reported an average of 80 ± 48 min/week of physical activity at the time of screening.
Baseline physical activity for participants screened with a single-item only (first step) and for those screened more extensively (second step)
Baseline physical activity outcomes
First step screening, (n = 418)
Second step screening (n = 86)
t or χ2 test
Active Australia Survey:
119 ± 149
162 ± 168
Moderate intensity (min/week)
38 ± 97
27 ± 63
Vigorous intensity (min/week)
46 ± 95
44 ± 85
Walking + moderate + vigorous intensity (min/week)
204 ± 247
234 ± 216
Achieves 150 min/week of moderate + vigorous intensity (%)
7057 ± 2314
8166 ± 2727
Moderate intensity (min/week)
157 ± 118
190 ± 140
Vigorous intensity (min/week)
4.9 ± 21.3
2.3 ± 7.3
Moderate + vigorous intensity (min/week)
162 ± 141
192 ± 141
Achieves 150 min/week of moderate + vigorous intensity (%)
An important point to note is that neither screening approach (single-step or dual-step) was particularly effective in preventing people who were too active from being enrolled in the study; and that screening using objective measures (accelerometry)—despite being burdensome, time intensively, and costly—may thus be preferable, as fewer active participants would subsequently be enrolled. Further, it is challenging to explain the counterintuitive differences with regards of single- and dual-step screening outcomes. One plausible explanation may be related to social desirability bias . That is, some participants may have sensed their likelihood of inclusion in the randomized controlled trial would be higher if reporting a lower level of physical activity on the subsequent screening measure. Another explanation may be that the more extensive screening increased physical activity awareness , resulting in more efforts to be active prior to the baseline assessment. These findings highlight that recruitment procedures need to be designed carefully, as they might introduce potentially unwanted and unexpected biases.
This trial was funded by the National Health and Medical Research Council (Project Grant number 589903). The funder did not have any role in the study other than to provide funding. MJD (ID 100029) and CV (ID 100427) are supported by a Future Leader Fellowship from the National Heart Foundation of Australia.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Warburton DER, Nical CW, Bredin SSD. Health benefits of physical activity: the evidence. Can Med Assoc J. 2006;174:801–9.View ArticleGoogle Scholar
- Sisson SB, Katzmarzyk PT. International prevalence of physical activity in youth and adults. Obesity Rev. 2008;9:606–14.View ArticleGoogle Scholar
- Waters LA, Winkler EA, Reeves MM, Fjeldsoe BS, Eakin EG. The impact of behavioural screening on intervention outcomes in a randomised controlled multiple behaviour intervention trial. IJBNPA. 2011;8:24.PubMedPubMed CentralGoogle Scholar
- Prochaska JJ, Sallis JF, Long B. A physical activity screening measure for use with adolescents in primary care. Arch Ped Adolesc Med. 2001;155:554–9.View ArticleGoogle Scholar
- Snyder CD, Sloane R, Haines PS, Mille P, Clipp EC, Morey MC, et al. The Diet Quality Index-revised: a tool to promote and evaluate dietary change among older cancer survivors enrolled in a home-based intervention trial. J Am Diet Assoc. 2007;107:1519–29.View ArticleGoogle Scholar
- van Stralen MM, Lecher L, Mudde AN, de Vries H, Bolman C. Determinants of awareness, initiation and maintenance of physical activity among the over fifties: a Delphi study. Health Edu Res. 2010;25:233–47.View ArticleGoogle Scholar
- Milton K, Bull FC, Bauman A. Reliability and validity testing of a single-item physical activity measure. Brit J Sport Med. 2011;45:203–8.View ArticleGoogle Scholar
- Jennings CA, Vandelanotte C, Caperchione CM, Mummer WK. Effectiveness of a web-based physical activity intervention for adults with Type 2 diabetes—a randomised controlled trial. Prev Med. 2014;60:33–40.View ArticlePubMedGoogle Scholar
- Kolt GS, Rosenkranz RR, Savages TN, Maeder AJ, Vandelanotte C, Duncan MJ, et al. Walk 2.0—using Web 2.0 applications to promote health-related physical activity: a randomised controlled trial protocol. BMC Pub Health. 2013;13:436.View ArticleGoogle Scholar
- Elley C, Kerse N, Arroll B, Robinson E. Effectiveness of counselling patients on physical activity in general practice: cluster randomised controlled trial. Brit Med J. 2003;362:793–8.View ArticleGoogle Scholar
- Rose SB, Elley CR, Lawton BA, Dowell AC. A single question reliably identifies physical inactive women in primary care. NZ Med J. 2008;121:40–6.Google Scholar
- Australian Institute of Health and Welfare. The Active Australia Survey; a guide and manual for implementation analysis and reporting. Canberra: Australian Institute of Health and Welfare; 2003.Google Scholar
- Brown W, Bauman A, Chey T, Trost S, Mummery K. Comparison of surveys used to measure physical activity. Aust NZ J Public Health. 2004;28:128–34.View ArticleGoogle Scholar
- Brenner PS, DeLamater JD. Social desirability bias in self-reports of physical activity: is an exercise identity the culprit? Soc Indic Res. 2014;117(2):489–504.View ArticleGoogle Scholar