"The advent of head mounted displays (HMDs) such as Oculus Rift, Samsung Gear VR, and Microsoft HoloLens are turning immersive virtual reality (VR) into reality. As one of its most compelling applications, we envision that VR will revolutionize the personal fitness experience in our daily lives. Towards this vision, we present JARVIS, a novel immersive exercise tracking applications enabled by miniature IoT sensing devices combined with a mobile HMD device. By attaching IoT sensing devices on any gym machines, JARVIS continuously tracks exercise progress and assesses exercise quality in real-time, enabling effective interaction with machines. By converting the captured exercise progress and quality information to VR inputs, it creates an immersive exercise experience with a virtual avatar to guide machine exercises. We have conducted extensive experiments to validate the performance of JARVIS. It achieves 97.96% of repetition segmentation accuracy without knowing the current exercise type, as well as 99.08% of exercise type recognition accuracy in 1.22 repetitions on average. We have also conducted a real-world deployment study to examine the efficacy of the proposed platform. By analyzing muscle activities using high-fidelity clinical surface Electromyography (sEMG) sensors, our results indicate that our VR/IoT-based platform could provide an engaging and effective guidance to exercisers for their strength training."--Page ii.
Read
