Concurrent validity and accuracy of arm-wearable devices to detect heart rate during exercise: A systematic review
Keywords:
psychometric property, reliability, follow-up tool, aerobic exerciseAbstract
This study was systematically conducted to review research article regarding the accuracy and validity of commercial wearables in measuring heart rate during exercise. Studies published between 2014 - 2021 were searched in several databases, including ScienceDirect, PubMed, Scopus and the Web of science. Relevant studies with full text published in Thai and English were retrieved. The COSMIN and QUADAS were then used to assess the quality and risk of bias of each study. Later, data from selected studies were extracted, analyzed, and synthesized. The outcomes were divided into two categories (acceptable, unacceptable) and three (high, moderate, low) groups for accuracy and validity, respectively. There were 33 publications with Level 2, and based on the OCEBM examining 15 brands and 41 different arm-wearable devices. The data included studies illustrated that several arm-wearable devices were accurate (CCC = 0.86 - 0.96; MAPE < 5) and valid at a moderate to high level (r = 0.59 - 0.99) in measuring heart rate during both aerobic and resistance exercises. Thus, athletes, researchers, or those who were interested could apply this information on choosing a heart rate monitor for tracking heart rate while exercising. However, the study suggested that devices are consistently being developed and redesigned resulting in lower prices and using more accurate and valid technology, suggesting the need for more current reviews and further research.
References
Fuller D, Colwell E, Low J, et al. Reliability
and validity of commercially available
wearable devices for measuring Steps,
energy expenditure, and heart rate:
Systematic review. JMIR Mhealth Uhealth
; 8:e18694.
WHO guidelines approved by the
guidelines review committee. In: WHO
guidelines on physical activity and
sedentary behaviour. World Health
Organization© World Health Organization
: Geneva, 2020.
Lambrick DM, Faulkner JA, Rowlands AV,
et al. Prediction of maximal oxygen
uptake from submaximal ratings of
perceived exertion and heart rate during
a continuous exercise test: the efficacy of
RPE 13. Eur J Appl Physiol 2009;107:1-9.
Kritsana B, Ubon P, Peanchai K.
Cardiovascular response and energy
expenditure of a novel heart rate
maximizer test in healthy volunteers. Bull
Chiang Mai Assoc Med Sci 2016;49:263 -
Pasadyn SR, Soudan M, Gillinov M, et al.
Accuracy of commercially available heart
rate monitors in athletes: a prospective
study. Cardiovasc Diagn Ther 2019;9:379-
Sartor F, Gelissen J, van Dinther R, et al.
Wrist-worn optical and chest strap heart
rate comparison in A heterogeneous
sample of healthy individuals and in
coronary artery disease patients. BMC
Sports Sci Med Rehabil 2018; 10: 10.
Moher D, Shamseer L, Clarke M, et al.
Preferred reporting items for systematic
review and meta-analysis protocols
(PRISMA-P) 2015 statement. Syst Rev 2015;
: 1.
Mokkink LB, Terwee CB, Patrick DL, et al.
The COSMIN checklist for assessing the
methodological quality of studies on
measurement properties of health status
measurement instruments: an
international Delphi study. Qual Life Res
; 19: 539-49.
Kaizik MA, Garcia AN, Hancock MJ, et al.
Measurement properties of quality
assessment tools for studies of diagnostic
accuracy. Braz J Phys Ther 2020; 24: 177-84.
Swinscow T, Campbell M. Statistics at
Square One, BMJ Books: Oxford, 2009.
Altman D. Practical statistics for medical
research. , Chapman and Hall: London, 1991.
Swanson D. On the relationship among
values of the same summary measure of
error when it is used across multiple
characteristics at the same point in time:
An examination of MALPE and MAPE 1.
review of economics and finance 2015;
: 1-14.
Baek S, Ha Y, Park HW. Accuracy of
wearable devices for measuring heart rate
during conventional and Nordic walking.
Pm r 2021;13:379-86.
Bai Y, Hibbing P, Mantis C, et al. Comparative
evaluation of heart rate-based monitors:
Apple watch vs Fitbit charge HR. J Sports
Sci 2018; 36: 1734-41.
Benedetto S, Caldato C, Bazzan E, et al.
Assessment of the fitbit charge 2 for
monitoring heart rate. PLoS One
;13:e0192691.
Boudreaux BD, Hebert EP, Hollander DB,
et al. Validity of wearable activity monitors
during cycling and resistance exercise.
Med Sci Sports Exerc 2018; 50: 624-33.
Powierza CS, Clark MD, Hughes JM, et al.
Validation of a self-monitoring tool for
use in exercise therapy. Pm r 2017; 9:
-84.
Chow HW, Yang CC. Accuracy of optical
heart rate sensing technology in wearable
fitness trackers for young and older
Adults: Validation and comparison study.
JMIR Mhealth Uhealth 2020; 8: e14707.
Claes J, Buys R, Avila A, et al. Validity of
heart rate measurements by the Garmin
Forerunner 225 at different walking
intensities. J Med Eng Technol 2017;41:480-5.
Damasceno V, Costa A, Campello M, et al.
Criterion validity and accuracy of a heart
rate monitor. Hum Mov 2022;23:60-8.
Dooley EE, Golaszewski NM, Bartholomew
JB. Estimating accuracy at exercise
intensities: A comparative study of selfmonitoring heart rate and physical activity
wearable devices. JMIR Mhealth Uhealth
; 5:e34.
Düking P, Giessing L, Frenkel MO, et al.
Wrist-Worn wearables for monitoring heart
rate and energy expenditure while Sitting
or performing light-to-vigorous physical
activity: Validation study. JMIR Mhealth
Uhealth 2020;8:e16716.
Gillinov S, Etiwy M, Wang R, et al. Variable
accuracy of wearable heart rate monitors
during aerobic exercise. Med Sci Sports
Exerc 2017;49:1697-703.
Hettiarachchi IT, Hanoun S, Nahavandi D,
et al. Validation of polar OH1 optical heart
rate sensor for moderate and high
intensity physical activities. PLoS One
;14:e0217288.
Horton JF, Stergiou P, Fung TS, et al.
Comparison of polar M600 optical heart
rate and ECG heart rate during exercise.
Med Sci Sports Exerc 2017;49:2600-7.
Khushhal A, Nichols S, Evans W, et al.
Validity and eeliability of the Apple watch
for measuring heart rate during exercise.
Sports Med Int Open 2017;1:e206-e11.
Muggeridge DJ, Hickson K, Davies AV, et
al. Measurement of heart rate using the
polar OH1 and fitbit Charge 3 wearable
devices in healthy adults during light,
moderate, vigorous, and sprint-based
exercise: Validation study. JMIR Mhealth
Uhealth 2021;9:e25313.
Müller AM, Wang NX, Yao J, et al. Heart
rate measures from wrist-worn activity
trackers in a laboratory and free-living
setting: Validation study. JMIR Mhealth
Uhealth 2019;7:e14120.
Navalta JW, Montes J, Bodell NG, et al.
Concurrent heart rate validity of wearable
technology devices during trail running.
PLoS One 2020;15:e0238569.
O’Driscoll R, Turicchi J, Hopkins M, et al.
The validity of two widely used commercial
and research-grade activity monitors,
during resting, household and activity
behaviours. health and technology 2020;
:637-48.
Olstad BH, Zinner C. Validation of the
Polar OH1 and M600 optical heart rate
sensors during front crawl swim training.
PLoS One 2020;15:e0231522.
Parak J, Korhonen I. Evaluation of wearable
consumer heart rate monitors based on
photopletysmography. Annu Int Conf IEEE
Eng Med Biol Soc 2014;2014:3670-3.
Parak J, Uuskoski M, Machek J, et al.
Estimating heart rate, energy expenditure,
and physical performance with a wrist
photoplethysmographic device during
running. JMIR Mhealth Uhealth 2017;5:e97.
Reddy RK, Pooni R, Zaharieva DP, et al.
Accuracy of wrist-worn activity monitors
during common daily physical activities
and types of structured exercise:
evaluation study. JMIR Mhealth Uhealth
;6: e10338.
Reece JD, Bunn JA, Choi M, et al. Assessing
heart rate using consumer technology
association standards. Technologies
;9:46.
Ruiz-Malagón E, Ruiz-Alias S, García-Pinillos
F, et al. Comparison between
photoplethysmographic heart rate
monitor from Polar vantage M and Polar
V800 with H10 chest strap while running
on a treadmill: Validation of the polar
precision prime TM photoplestimographic
system. Proc Inst Mech Eng P J Sport Eng
Technol 2021;235:212-8.
Shcherbina A, Mattsson CM, Waggott D,
et al. Accuracy in wrist-worn, sensor-based
measurements of heart rate and energy
expenditure in a diverse cohort. J Pers
Med 2017;24(2):3.
Shumate T, Link M, Furness J, et al. Validity
of the Polar Vantage M watch when
measuring heart rate at different exercise
intensities. PeerJ 2021;9:e10893.
Stahl SE, An HS, Dinkel DM, et al. How
accurate are the wrist-based heart rate
monitors during walking and running
activities? Are they accurate enough? BMJ
Open Sport Exerc Med 2016;2:e000106.
Støve MP, Holm RS, Kjaersgaard AS, et al.
Measurement latency significantly
contributes to reduced heart rate
measurement accuracy in wearable devices.
J Med Eng Technol 2020;44:125-32.
Sun J, Liu Y. Using smart bracelets to
assess heart rate among students during
physical education lessons: feasibility,
reliability, and Validity study. JMIR
Mhealth Uhealth 2020;8:e17699.
Thiebaud RS, Funk MD, Patton JC, et al.
Validity of wrist-worn consumer products
to measure heart rate and energy
expenditure. Digit Health 2018;4:
Thomson EA, Nuss K, Comstock A, et al.
Heart rate measures from the Apple watch,
fitbit charge HR 2, and electrocardiogram
across different exercise intensities. J
Sports Sci 2019;37:1411-9.
Wallen MP, Gomersall SR, Keating SE, et
al. Accuracy of heart rate watches:
Implications for weight management.
PLoS One 2016;11:e0154420.
Winkelmann RR, Kim GK, Del Rosso JQ.
Treatment of cutaneous lupus
erythematosus: Review and assessment
of treatment benefits based on oxford
centre for evidence-based medicine
criteria. J Clin Aesthet Dermatol 2013;6:
-38.
Feehan LM, Geldman J, Sayre EC, et al.
Accuracy of fitbit devices: systematic
Review and narrative Syntheses of
quantitative data. JMIR Mhealth Uhealth
;6:e10527.
Fokkema T, Kooiman TJ, Krijnen WP, et
al. Reliability and validity of ten consumer
activity trackers depend on walking speed.
Med Sci Sports Exerc 2017;49:793-800.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
