Design of Virtual Hands for Natural Interaction in the Metaverse
View/ Open
Impact
Scholar |
Other documents of the author: Cerdá Boluda, Joaquín; Mora, Marta Covadonga; Lloret, Nuria; Scarani, Stefano; Sastre-Martínez, Jorge
Metadata
Show full item recordcomunitat-uji-handle:10234/9
comunitat-uji-handle2:10234/7035
comunitat-uji-handle3:10234/8617
comunitat-uji-handle4:
INVESTIGACIONMetadata
Title
Design of Virtual Hands for Natural Interaction in the MetaverseAuthor (s)
Date
2024Publisher
MDPIISSN
1424-8220Bibliographic citation
CERDÁ-BOLUDA, Joaquín, et al. Design of Virtual Hands for Natural Interaction in the Metaverse. Sensors, 2024, vol. 24, núm. 3, p. 741Type
info:eu-repo/semantics/articlePublisher version
https://www.mdpi.com/1424-8220/24/3/741Version
info:eu-repo/semantics/publishedVersionSubject
AR | hand tracking | human–machine interaction | infrared sensor | markerless motion tracking | NFT | retopology | VR | WebXR | XR
Abstract
The emergence of the Metaverse is raising important questions in the field of human–machine interaction that must be addressed for a successful implementation of the new paradigm. Therefore, the exploration and ... [+]
The emergence of the Metaverse is raising important questions in the field of human–machine interaction that must be addressed for a successful implementation of the new paradigm. Therefore, the exploration and integration of both technology and human interaction within this new framework are needed. This paper describes an innovative and technically viable proposal for virtual shopping in the fashion field. Virtual hands directly scanned from the real world have been integrated, after a retopology process, in a virtual environment created for the Metaverse, and have been integrated with digital nails. Human interaction with the Metaverse has been carried out through the acquisition of the real posture of the user’s hands using an infrared-based sensor and mapping it in its virtualized version, achieving natural identification. The technique has been successfully tested in an immersive shopping experience with the Meta Quest 2 headset as a pilot project, where a transactions mechanism based on the blockchain technology (non-fungible tokens, NFTs) has allowed for the development of a feasible solution for massive audiences. The consumers’ reactions were extremely positive, with a total of 250 in-person participants and 120 remote accesses to the Metaverse. Very interesting technical guidelines are raised in this project, the resolution of which may be useful for future implementations. [-]
Is part of
Sensors, 2024, vol. 24, núm. 3, p. 741Funder Name
Ministerio de Ciencia, Innovación y Universidades | Universitat Jaume I
Project code
PID2020-118021RB-I00 | UJI-B2022-48
Investigation project
MICIN/AEI/ 10.13039/501100011033Rights
info:eu-repo/semantics/openAccess
This item appears in the folowing collection(s)
- EMC_Articles [822]
Except where otherwise noted, this item's license is described as Copyright: © 2024 by the authors.
Licensee MDPI, Basel, Switzerland.
This article is an open access article
distributed under the terms and
conditions of the Creative Commons
Attribution (CC BY) license (https://
creativecommons.org/licenses/by/
4.0/).