ORCID ID
https://orcid.org/0000-0002-3791-3754
Document Type
Conference Paper
Publication Date
1-1-2009
Publication Title
Proceedings of the … Innovative Applications of Artificial Intelligence Conference. Innovative Applications of Artificial Intelligence Conference
Abstract
Clinical tests have shown that the dynamics of a human arm, controlled using Functional Electrical Stimulation (FES), can vary significantly between and during trials. In this paper, we study the application of the actor-critic architecture, with neural networks for the both the actor and the critic, as a controller that can adapt to these changing dynamics of a human arm. Development and tests were done in simulation using a planar arm model and Hill-based muscle dynamics. We begin by training it using a Proportional Derivative (PD) controller as a supervisor. We then make clinically relevant changes to the dynamics of the arm and test the actor-critic’s ability to adapt without supervision in a reasonable number of episodes. Finally, we devise methods for achieving both rapid learning and long-term stability.
Recommended Citation
Thomas, Philip; Branicky, Michael; van den Bogert, Antonie; and Jagodnik, Kathleen, "Application of the Actor-Critic Architecture to Functional Electrical Stimulation Control of a Human Arm" (2009). Mechanical Engineering Faculty Publications. 411.
https://engagedscholarship.csuohio.edu/enme_facpub/411
Version
Preprint
Volume
2009
