A method of ultrasonic finger gesture recognition based on the micro-doppler effect

Qinglin Zeng, Zheng Kuang, Shuaibing Wu, Jun Yang*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

14 Citations (Scopus)

Abstract

With the popularity of small-screen smart mobile devices, gestures as a new type of human-computer interaction are highly demanded. Furthermore, finger gestures are more familiar to people in controlling devices. In this paper, a new method for recognizing finger gestures is proposed. Ultrasound was actively emitted to measure the micro-Doppler effect caused by finger motions and was obtained at high resolution. By micro-Doppler processing, micro-Doppler feature maps of finger gestures were generated. Since the feature map has a similar structure to the single channel color image, a recognition model based on a convolutional neural network was constructed for classification. The optimized recognition model achieved an average accuracy of 96.51% in the experiment.

Original languageEnglish
Article number2314
JournalApplied Sciences (Switzerland)
Volume9
Issue number11
DOIs
Publication statusPublished - Jun 1 2019
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2019 by the authors.

ASJC Scopus Subject Areas

  • General Materials Science
  • Instrumentation
  • General Engineering
  • Process Chemistry and Technology
  • Computer Science Applications
  • Fluid Flow and Transfer Processes

Keywords

  • Convolutional neural network
  • Finger gesture recognition
  • Themicro-Doppler effect
  • Ultrasonic

Cite this