An open-source remote heart rate imaging method with practical apparatus and algorithms

• Published in: Behavior research methods Vol. 51; no. 5; pp. 2106 - 2119
• Main Authors: van der Kooij, Koen M., Naber, Marnix
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.10.2019; Springer Nature B.V
• Subjects: Adolescent; Adult; Algorithms; Animals; Behavioral Science and Psychology; Cameras; Cattle; Cognitive Psychology; Face; Female; Heart Rate; Humans; Image processing; Male; Photoplethysmography; Physical training; Psychology; Skin; Young Adult; Heart rate; Remote photoplethysmography; Exercise; Pulse oximetry; Respiration
• ISSN: 1554-3528; 1554-351X; 1554-3528
• DOI: 10.3758/s13428-019-01256-8

Recent developments in computer science and digital image processing have enabled the extraction of an individual’s heart pulsations from pixel changes in recorded video images of human skin surfaces. This method is termed remote photoplethysmography (rPPG) and can be achieved with consumer-level cameras (e.g., a webcam or mobile camera). The goal of the present publication is two-fold. First, we aim to organize future rPPG software developments in a tractable and nontechnical manner, such that the public gains access to a basic open-source rPPG code, comes to understand its utility, and can follow its most recent progressions. The second goal is to investigate rPPG’s accuracy in detecting heart rates from the skin surfaces of several body parts after physical exercise and under ambient lighting conditions with a consumer-level camera. We report that rPPG is highly accurate when the camera is aimed at facial skin tissue, but that the heart rate recordings from wrist regions are less reliable, and recordings from the calves are unreliable. Facial rPPG remained accurate despite the high heart rates after exercise. The proposed research procedures and the experimental findings provide guidelines for future studies on rPPG.