Loading...
Please wait, while we are loading the content...
Similar Documents
3D Point-of-Intention Determination Using a Multimodal Fusion of Hand Pointing and Eye Gaze for a 3D Display
| Content Provider | MDPI |
|---|---|
| Author | Yeamkuan, Suparat Chamnongthai, Kosin |
| Copyright Year | 2021 |
| Description | This paper proposes a three-dimensional (3D) point-of-intention (POI) determination method using multimodal fusion between hand pointing and eye gaze for a 3D virtual display. In the method, the finger joint forms of the pointing hand sensed by a Leap Motion sensor are first detected as pointing intention candidates. Subsequently, differences with neighboring frames, which should be during hand pointing period, are checked by AND logic with the hand-pointing intention candidates. A crossing point between the eye gaze and hand pointing lines is finally decided by the closest distance concept. In order to evaluate the performance of the proposed method, experiments with ten participants, in which they looked at and pointed at nine test points for approximately five second each, were performed. The experimental results show the proposed method measures 3D POIs at 75 cm, 85 cm, and 95 cm with average distance errors of 4.67%, 5.38%, and 5.71%, respectively. |
| Starting Page | 1155 |
| e-ISSN | 14248220 |
| DOI | 10.3390/s21041155 |
| Journal | Sensors |
| Issue Number | 4 |
| Volume Number | 21 |
| Language | English |
| Publisher | MDPI |
| Publisher Date | 2021-02-06 |
| Access Restriction | Open |
| Subject Keyword | Sensors Ergonomics Multimodal Systems Sensor Fusion Eye Tracking Hand Tracking Hand Recognition |
| Content Type | Text |
| Resource Type | Article |
