DOI: 10.17587/prin.15.331-339

Methods for Implementing Tactile Sensations in Virtual Space by Integrating Physical Objects with Their Computer Models

A. V. Maltsev, Ph.D., Leading Researcher, avmaltcev@mail.ru, Scientific Research Institute for System Analysis of the Russian Academy of Sciences, Moscow, 117218, Russian Federation

Corresponding author: Andrey V. Maltsev, Ph.D., Leading Researcher, Scientific Research Institute for System Analysis of the Russian Academy of Sciences, Moscow, 117218, Russian Federation, E-mail: avmaltcev@mail.ru

The paper presents original methods and approaches for integrating, from the user's point of view, three-dimensional virtual models visible to them in a virtual reality headset, and their physical prototypes. This allows for the addition of some important elements of physical reality to the virtual environment, such as tactile and muscle-motor sensations. Developed solutions are based on the use of such wireless devices as HTC Vive Trackers, which determine their position and orientation in space, and can be placed on various objects of the real world. An original approach to making a tracking system by means of two HTC Base Stations and several Vive Trackers with selecting one anchor element is proposed, as well as new methods for real-time integration of physical reality objects with their virtual models by using functional control schemes with own blocks for trackers. Based on methods and approaches proposed in this work, software modules were implemented. Approbation of these modules in the VirSim virtual environment system, which was developed in Scientific Research Institute for System Analysis of the Russian Academy of Sciences, showed that the solutions developed are adequate and effective, and can have practical application in virtual environment systems and training complexes.

Keywords: virtual environment, VR headset, tracking system, visualization, three-dimensional scene, trackers, integration, functional scheme

pp. 331—339

For citation:
Maltsev A. V. Methods for Implementing Tactile Sensations in Virtual Space by Integrating Physical Objects with Their Computer Models, Programmnaya Ingeneria, 2024, vol. 15, no. 7, pp. 331—339. DOI: 10.17587/prin.15.331-339 (in Russian).

The publication is made within the state task of Federal State Institution "Scientific Research Institute for System Analysis of the Russian Academy of Sciences" on topic No. FNEF-2024-0002 "Mathematical modeling of multiscale dynamic processes and virtual environment systems".

References:

1. Maltsev A. V., Strashnov E. V., Mikhaylyuk M. V. Methods and technologies of cosmonaut rescue simulation in virtual environment systems, Scientific Visualization, 2021, vol. 13, no. 4, pp. 52—65. DOI: 10.26583/sv.13.4.05.
2. W-WALL. VR simulator. Virtual reality in learning. Oil in­dustry, available at: https://www.youtube.com/watch?v=keXlfMKyxsI (date of access 20.05.2024).
3. Maltsev A. V. Computer simulation and visualization of wheel tracks on solid surfaces in virtual environment, Scientific Visualization, 2023, vol. 15, no. 2, pp. 80—89. DOI: 10.26583/sv.15.2.05.
4. Bruguera M. B., Ilk V., Ruber S., Ewald R. Use of virtual reality for astronaut training in future space missions — spacecraft piloting for the Lunar Orbital Platform — Gateway (LOP-G), 70th International Astronautics Congress, Washington D. C., 2019, pp. 1—10.
5. Garcia A. D., Schlueter J., Paddock E. Training astronauts using hardware-in-the-loop simulations and virtual reality, AIAA Sci-Tech Forum, Orlando, FL, 2020, pp. 1—13. DOI: 10.2514/6.2020-0167.
6. Mikhaylyuk M. V., Timokhin P. Yu. Memory-effective methods and algorithms of shader visualization of digital core material model, Sci­entific Visualization, 2019, vol. 11, no. 5, pp. 1—11. DOI: 10.26583/sv.11.5.01.
7. Pezent E., Macklin A., Yau J. M. et al. Multisensory Pseudo-Haptics for Rendering Manual Interactions with Virtual Objects, Advanced Intelligent Systems, 2023, vol. 5, pp. 1—13. DOI: 10.1002/aisy.202200303.
8. Hiilsrnariri F., Mattar N., Frohlich J., Wachsmuth I. Simu­lating Wind and Warmth in Virtual Reality: Conception, Realization and Evaluation for a CAVE Environment, Journal of Virtual Reality and Broadcasting, 2014, vol. 11, no. 10, pp. 1—21.
9. Kirvan P. CAVE (Cave Automatic Virtual Environment), available at: https://www.techtarget.com/whatis/definition/CAVE-Cave-Automatic-Virtual-Environment (date of access 20.05.2024).
10. Shen V., Shultz C., Harrison C. Mouth Haptics in VR using a Headset Ultrasound Phased Array, CHI'22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 2022, article no. 275, pp. 1—14. DOI: 10.1145/3491102.3501960.
11. Maltsev A. V. Computer simulation of video surveillance complexes in virtual environment systems, Scientific Visualization, 2022, vol. 14, no. 2, pp. 88—97. DOI: 10.26583/sv.14.2.08.
12. Mikhaylyuk M. V., Torgashev M. A. The Visual Editor and Calculation Module of Block Diagrams for Simulation and Training Complexes, Programmnye produkty i sistemy, 2014, no. 4, pp. 10—15 (in Russian). DOI: 10.15827/0236-235X.108.010-015.
13. Sablin I. P., Mikhaylyuk M. V., Omelchenko D. V. et al. Calculation of Tait-Bryan Angles of HTC VIVE Tracker Orientation, Trudy NIISIRAN, 2023, vol. 13, no. 1—2, pp. 25—31 (in Russian).
14. Mikhaylyuk M. V., Maltsev A. V., Timokhin et al. The VirSim Virtual Environment System for the Simulation Complexes of Cosmonaut Training, Pilotiruemye polety v kosmos, 2020, vol. 37, no. 4, pp. 72—95 (in Russian). DOI: 10.34131/MSF.20.4.72-95.