1. School of Engineering Management, Nanjing University, Nanjing 210093, China; 2. Research Center for Novel Technology of Intelligent Equipment, Nanjing University, Nanjing 210093, China
Abstract:As for the challenges in multi-person interaction and operational convenience within the command and control domain of virtual reality systems, the composition structure of multi-person, multi-channel systems is analyzed and a framework for multi-person,multi-channel virtual reality interaction is proposed. A multi-channel collaborative interaction method integrating gestures, voice, and eye movement into one is introduced. Based on a client/server model, real-time interaction among users in different locations are realized and the application potentials of multi-person, multi-channel collaborative interaction method are demonstrated by a virtual sandbox system. The comparative experiments show that, compared to traditional handheld controllers, this technology has superiority in improving interaction efficiency and user comfort. Additionally, network synchronization tests indicate its low latency and packet loss in multi-person real-time interaction, its practicality and effectiveness are verified.