bioRxiv Science⌕ Search

Biology subjects

McPhee, J.

Publications and source records attributed to McPhee, J..

6 recordsLinked to original sources

Simulation of Energy Regeneration in Human Locomotion for Efficient Exoskeleton Actuation

Backdriveable actuators with energy regeneration can improve the efficiency and extend the battery-powered operating times of robotic lower-limb exoskeletons by converting some of the otherwise dissipated energy during negative mechanical work into electrical energy. However, previous related studies have focused on steady-state level-ground walking. To better encompass real-world community mobility, here we developed a feedforward human-exoskeleton energy regeneration system model to simulate energy regeneration and storage during other daily locomotor activities. Data from inverse dynamics analyses of 10 healthy young adults walking at variable speeds and slopes were used to calculate the negative joint mechanical power and work (i.e., the mechanical energy theoretically available for electrical energy regeneration). These human joint mechanical energetics were then used to simulate backdriving a robotic exoskeleton and regenerating energy. An empirical characterization of the exoskeleton device was carried out using a joint dynamometer system and an electromechanical motor model to calculate the actuator efficiency and to simulate energy regeneration. Our performance calculations showed that regenerating energy at slower walking speeds and decline slopes could significantly extend the battery-powered operating times of robotic lower-limb exoskeletons (i.e., up to 99% increase in total number of steps), therein improving locomotor efficiency.

bioengineering↗

MuscleNET: Mapping Electromyography to kinematic and dynamic biomechanical variables by machine learning

ObjectiveThis paper proposes machine learning models for mapping surface electromyography (sEMG) signals to regression of joint angle, joint velocity, joint acceleration, joint torque, and activation torque. ApproachThe regression models, collectively known as MuscleNET, take one of four forms: ANN (Forward Artificial Neural Network), RNN (Recurrent Neural Network), CNN (Convolutional Neural Network), and RCNN (Recurrent Convolutional Neural Network). Inspired by conventional biomechanical muscle models, delayed kinematic signals were used along with sEMG signals as the machine learning models input; specifically, the CNN and RCNN were modeled with novel configurations for these input conditions. The models inputs contain either raw or filtered sEMG signals, which allowed evaluation of the filtering capabilities of the models. The models were trained using human experimental data and evaluated with different individual data. Main resultsResults were compared in terms of regression error (using the root-mean-square) and model computation delay. The results indicate that the RNN (with filtered sEMG signals) and RCNN (with raw sEMG signals) models, both with delayed kinematic data, can extract underlying motor control information (such as joint activation torque or joint angle) from sEMG signals in pick-and-place tasks. The CNNs and RCNNs were able to filter raw sEMG signals. SignificanceAll forms of MuscleNET were found to map sEMG signals within 2 ms, fast enough for real-time applications such as the control of exoskeletons or active prostheses. The RNN model with filtered sEMG and delayed kinematic signals is particularly appropriate for applications in musculoskeletal simulation and biomechatronic device control.

systems biology↗

Environment Classification for Robotic Leg Prostheses and Exoskeletons using Deep Convolutional Neural Networks

Robotic leg prostheses and exoskeletons can provide powered locomotor assistance to older adults and/or persons with physical disabilities. However, the current locomotion mode recognition systems being developed for intelligent high-level control and decision-making use mechanical, inertial, and/or neuromuscular data, which inherently have limited prediction horizons (i.e., analogous to walking blindfolded). Inspired by the human vision-locomotor control system, we designed and evaluated an advanced environment classification system that uses computer vision and deep learning to forward predict the oncoming walking environments prior to physical interaction, therein allowing for more accurate and robust locomotion mode transitions. In this study, we first reviewed the development of the ExoNet database - the largest and most diverse open-source dataset of wearable camera images of indoor and outdoor real-world walking environments, which were annotated using a hierarchical labelling architecture. We then trained and tested over a dozen state-of-the-art deep convolutional neural networks (CNNs) on the ExoNet database for large-scale image classification of the walking environments, including: EfficientNetB0, InceptionV3, MobileNet, MobileNetV2, VGG16, VGG19, Xception, ResNet50, ResNet101, ResNet152, DenseNet121, DenseNet169, and DenseNet201. Lastly, we quantitatively compared the benchmarked CNN architectures and their environment classification predictions using an operational metric called NetScore, which balances the image classification accuracy with the computational and memory storage requirements (i.e., important for onboard real-time inference). Although we designed this environment classification system to support the development of next-generation environment-adaptive locomotor control systems for robotic prostheses and exoskeletons, applications could extend to humanoids, autonomous legged robots, powered wheelchairs, and assistive devices for persons with visual impairments.

bioengineering↗

Computer Vision and Deep Learning for Environment-Adaptive Control of Robotic Lower-Limb Exoskeletons

Robotic exoskeletons require human control and decision making to switch between different locomotion modes, which can be inconvenient and cognitively demanding. To support the development of automated locomotion mode recognition systems (i.e., high-level controllers), we designed an environment recognition system using computer vision and deep learning. We collected over 5.6 million images of indoor and outdoor real-world walking environments using a wearable camera system, of which ~923,000 images were annotated using a 12-class hierarchical labelling architecture (called the ExoNet database). We then trained and tested the EfficientNetB0 convolutional neural network, designed for efficiency using neural architecture search, to predict the different walking environments. Our environment recognition system achieved ~73% image classification accuracy. While these preliminary results benchmark Efficient-NetB0 on the ExoNet database, further research is needed to compare different image classification algorithms to develop an accurate and real-time environment-adaptive locomotion mode recognition system for robotic exoskeleton control.

bioengineering↗

ExoNet Database: Wearable Camera Images of Human Locomotion Environments

Advances in computer vision and artificial intelligence are allowing researchers to develop environment recognition systems for powered lower-limb exoskeletons and prostheses. However, small-scale and private training datasets have impeded the widespread development and dissemination of image classification algorithms for classifying human walking environments. To address these limitations, we developed ExoNet - the first open-source, large-scale hierarchical database of high-resolution wearable camera images of human locomotion environments. Unparalleled in scale and diversity, ExoNet contains over 5.6 million RGB images of different indoor and outdoor real-world walking environments, which were collected using a lightweight wearable camera system throughout the summer, fall, and winter seasons. Approximately 923,000 images in ExoNet were human-annotated using a 12-class hierarchical labelling architecture. Available publicly through IEEE DataPort, ExoNet offers an unprecedented communal platform to train, develop, and compare next-generation image classification algorithms for human locomotion environment recognition. Besides the control of powered lower-limb exoskeletons and prostheses, applications of ExoNet could extend to humanoids and autonomous legged robots.

bioengineering↗

Biomechanical Modelling of Sitting Movements for Designing Robotic Lower-Limb Prostheses and Exoskeletons with Energy Regeneration

Although regenerative actuators can extend the operating durations of robotic lower-limb exoskeletons and prostheses, these energy-efficient powertrains have been exclusively designed and evaluated for continuous level-ground walking. ObjectiveHere we analyzed the lower-limb joint mechanical power during stand-to-sit movements using inverse dynamic simulations to estimate the biomechanical energy available for electrical regeneration. MethodsNine subjects performed 20 sitting and standing movements while lower-limb kinematics and ground reaction forces were measured. Subject-specific body segment parameters were estimated using parameter identification, whereby differences in ground reaction forces and moments between the experimental measurements and inverse dynamic simulations were minimized. Joint mechanical power was calculated from net joint torques and rotational velocities and numerically integrated over time to determine joint biomechanical energy. ResultsThe hip produced the largest peak negative mechanical power (1.8 {+/-} 0.5 W/kg), followed by the knee (0.8 {+/-} 0.3 W/kg) and ankle (0.2 {+/-} 0.1 W/kg). Negative mechanical work from the hip, knee, and ankle joints per stand-to-sit movement were 0.35 {+/-} 0.06 J/kg, 0.15 {+/-} 0.08 J/kg, and 0.02 {+/-} 0.01 J/kg, respectively. Conclusion and SignificanceAssuming an 80-kg person and previously published regenerative actuator efficiencies (i.e., maximum 63%), robotic lower-limb exoskeletons and prostheses could theoretically regenerate ~26 Joules of total electrical energy while sitting down, compared to ~19 Joules per walking stride. Given that these regeneration performance calculations are based on healthy young adults, future research should include seniors and/or rehabilitation patients to better estimate the biomechanical energy available for electrical regeneration among individuals with mobility impairments.

bioengineering↗