Hand Recognition and Finger Tracking technology integrated in the TUAS MarSEVR (Maritime Safety Education with VR Technology) Command Bridge Safety VR Technology
A further advance has been made in the technology of virtual reality training for safe bridge operation by ship crew.
Prof Evangelos Markopoulos and Prof Mika Luimula of the Game Lab of the Turku University of Applied Sciences (TUAS) Research Group of Futuristic Interactive Technologies, Panagiotis Markopoulos, PhD student in the doctorate programme of mathematics and computer science at the University of Turku, and Niko Laivuori, TUAS Game Lab engineer, have achieved integration of Hand Recognition and Finger Tracking in the MarSEVR (Maritime Safety Education with VR Technology) Command Bridge VR Technology.
Committed to follow the VR technology trends and challenges from game design, the neuro cognitive science perspective, and user requirements, the evolution of the MarISOT MarSEVR technology has been directed towards obtaining more effective user interfaces (UI) and immersive user experiences (UX).
The integration of the finger tracking and hand recognition technologies of VR in the MarISOT technology was approached from a multidisciplinary perspective. The cognitive neuroscience dimension indicated the pedagogical and behavioural impact of such technologies on the trainee. This can be supported with behavioural biometrics since every person has a unique expression of behavioural characteristics (body movement, coordination etc). To increase the engagement of the trainee, challenges in game design and user experience in VR have been studied. The maritime sector and the shipping industry rely significantly on the updated training and preparedness of seafarers.
Today the MarSEVR technology users are able to point, touch, press, grab, hold and move the command bridge instruments hands free, as they would normally do.
The results of this research have been submitted for publication under the following academic paper:
Evangelos Markopoulos, Panagiotis Markopoulos., Niko Laivuori, Christos Moridis, Mika Luimula (2020). Finger tracking and hand recognition technologies in virtual reality maritime safety training applications. Submitted to CogInfoCom 2020. 11th IEEE International Conference on Cognitive Infocommunications. On-Line Conference. Sept. 23-25, 2020.
NOTE : This post will be updated on September 30th with a link to the above paper.