Reproducibility of 20-min Time-trial Performance on a Virtual Cycling Platform

Abstract

This study aimed to analyse the reproducibility of mean power output during 20-min cycling time-trials, in a remote home-based setting, using the virtual-reality cycling software, Zwift. Forty-four cyclists (11 women, 33 men; 37±8 years old, 180±8 cm, 80.1±13.2 kg) performed 3×20-min time-trials on Zwift, using their own setup. Intra-class correlation coefficient (ICC), coefficient of variation (CV) and typical error (TE) were calculated for the overall sample, split into 4 performance groups based on mean relative power output (25% quartiles) and sex. Mean ICC, TE and CV of mean power output between time-trials were 0.97 [0.95–0.98], 9.4 W [8.0–11.3 W], and 3.7% [3.2–4.5], respectively. Women and men had similar outcomes (ICC: 0.96 [0.89–0.99] vs. 0.96 [0.92–0.98]; TE: 8.3 W [6.3–13.1] vs. 9.7 W [8.2–12.2]; CV: 3.8% [2.9–6.1] vs. 3.7% [3.1–4.7], respectively), although cyclists from the first quartile showed a lower CV in comparison to the overall sample (Q1: 2.6% [1.9–4.1] vs. overall: 3.7% [3.2–4.5]). Our results indicate that power output during 20-min cycling time-trials on Zwift are reproducible and provide sports scientists, coaches and athletes, benchmark values for future interventions in a virtual-reality environment.

Key words

reliability - virtual training - remote exercise - exercise testing - test-retest

Publication History

Received: 02 February 2022

Accepted: 10 May 2022

Accepted Manuscript online:
10 May 2022

Article published online:
11 August 2022

• References

• 1 de Boer DR, Hoekstra F, Huetink KI. et al. Physical activity, sedentary behavior and well-being of adults with physical disabilities and/or chronic diseases during the first wave of the covid-19 pandemic: a rapid review. Int J Environ Res Public Health 2021; 18: 6342 DOI: 10.3390/ijerph18126342.
• 2 McIlroy B, Passfield L, Holmberg H-C. et al. Virtual training of endurance cycling – a summary of strengths, weaknesses, opportunities and threats. Front Sports Act Living 2021; 3: 631101 DOI: 10.3389/fspor.2021.631101.
• 3 Forbes / Reed R. Do you even Zwift? The indoor cycling platform is having a moment (Feb 17, 2021) In Internet https://www.forbes.com/sites/robreed/2021/02/17/do-you-even-zwift-the-indoor-cycling-platform-is-having-a-moment/?sh=644014073f86 Accessed Jun 1, 2021
• 4 Hopkins WG, Schabort EJ, Hawley JA. Reliability of power in physical performance tests. Sports Med 2001; 31: 211-234 DOI: 10.2165/00007256-200131030-00005.
• 5 Nimmerichter A, Williams C, Bachl N. et al. Evaluation of a field test to assess performance in elite cyclists. Int J Sports Med 2010; 31: 160-166 DOI: 10.1055/s-0029-1243222.
• 6 MacInnis MJ, Thomas AC, Phillips SM. The reliability of 4-min and 20-min time trials and their relationships to functional threshold power in trained cyclists. Int J Sports Physiol Perform 2018; 29: 1-27 DOI: 10.1123/ijspp.2018-0100.
• 7 Currell K, Jeukendrup AE. Validity, reliability and sensitivity of measures of sporting performance. Sports Med 2008; 38: 297-316 DOI: 10.2165/00007256-200838040-00003.
• 8 Zavorsky G, Murias J, Gow J. et al. Laboratory 20-km cycle time trial reproducibility. Int J Sports Med 2007; 28: 743-748 DOI: 10.1055/s-2007-964969.
• 9 Laursen P, Shing C, Jenkins D. Reproducibility of a laboratory-based 40-km cycle time-trial on a stationary wind-trainer in highly trained cyclists. Int J Sports Med 2003; 24: 481-485 DOI: 10.1055/s-2003-42012.
• 10 Bishop D. Reliability of a 1-h endurance performance test in trained female cyclists. Med Sci Sports Exerc 1997; 29: 554-559 DOI: 10.1097/00005768-199704000-00019.
• 11 Wainwright B, Cooke CB, O’Hara JP. The validity and reliability of a sample of 10 Wattbike cycle ergometers. J Sports Sci 2017; 35: 1451-1458 DOI: 10.1080/02640414.2016.1215495.
• 12 Hopker J, Myers S, Jobson S. et al. Validity and reliability of the Wattbike cycle ergometer. Int J Sports Med 2010; 31: 731-736 DOI: 10.1055/s-0030-1261968.
• 13 Zadow EK, Kitic CM, Wu SS. et al. Validity of power settings of the Wahoo KICKR Power Trainer. Int J Sports Physiol Perform 2016; 11: 1115-1117 DOI: 10.1123/ijspp.2015-0733.
• 14 Zadow EK, Kitic CM, Wu SS. et al. Reliability of power settings of the Wahoo KICKR power trainer after 60 hours of use. Int J Sports Physiol Perform 2018; 13: 119-121 DOI: 10.1123/ijspp.2016-0732.
• 15 Hopkins WG. Spreadsheets for analysis of validity and reliability. Sportscience 2015; 19: 36-42 Available at https://www.sportsci.org/2015/ValidRely.htm
• 16 Cohen J. Statistical Power Analysis for the Behavioral. Sciences Hillsdale (NJ): Lawrence Erlbaum Associates 1988; 18-74 DOI: 10.4324/9780203771587.
• 17 Stone MR, Thomas K, Wilkinson M. et al. Consistency of perceptual and metabolic responses to a laboratory-based simulated 4,000-m cycling time trial. Eur J Appl Physiol 2011; 111: 1807-1813 DOI: 10.1007/s00421-010-1818-7.
• 18 Hopkins WG, Hewson DJ. Variability of competitive performance of distance runners. Med Sci Sports Exerc 2001; 33: 1588-1592 DOI: 10.1097/00005768-200109000-00023.
• 19 Hopkins WG. Measures of reliability in sports medicine and science. Sports Med 2000; 30: 1-15 DOI: 10.2165/00007256-200030010-00001.
• 20 Jeukendrup A, Saris WH, Brouns F. et al. A new validated endurance performance test. Med Sci Sports Exerc 1996; 28: 266-270 DOI: 10.1097/00005768-199602000-00017.
• 21 Cowley ES, Olenick AA, McNulty KL. et al. “Invisible sportswomen”: the sex data gap in sport and exercise science research. Women Sport Phys Act J 2021; 29: 146-151 DOI: 10.1123/wspaj.2021-0028.
• 22 Bird JM, Karageorghis CI, Baker SJ. et al. Ready Exerciser One: Effects of music and virtual reality on cycle ergometer exercise. Br J Health Psychol 2021; 26: 15-32 DOI: 10.1111/bjhp.12445.
• 23 Washif JA, Farooq A, Krug I. et al. Training during the COVID-19 lockdown: knowledge, beliefs, and practices of 12,526 athletes from 142 countries and six continents. Sports Med 2022; 52: 933-948 DOI: 10.1007/s40279-021-01573-z.
• 24 Hettinga FJ, Konings MJ, Pepping G-J. The science of racing against opponents: affordance competition and the regulation of exercise intensity in head-to-head competition. Front Physiol 2017; 8: 118 DOI: 10.3389/fphys.2017.00118.
• 25 Bouillod A, Soto-Romero G, Grappe F. et al. Caveats and recommendations to assess the validity and reliability of cycling power meters: a systematic scoping review. Sensors (Basel) 2022; 22: 386 DOI: 10.3390/s22010386.
• 26 Passfield L, Hopker JG, Jobson S. et al. Knowledge is power: Issues of measuring training and performance in cycling. J Sports Sci 2017; 35: 1426-1434 DOI: 10.1080/02640414.2016.1215504.
• 27 Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med 1998; 26: 217-238 DOI: 10.2165/00007256-199826040-00002.