Hybrid reality simulation interactive system

Hololens, with its feature of hybrid reality (MR), can analyze target object, interact with it in the real environment, position it and add virtual objects to it. For example, in mechanical maintenance, parameters, information and configuration status of mechanical parts are exhibited, and the objects are projected out at full size for inspection and adjustment of each structural design. Interactive functions, picture and text, voice, video and other supporting information are added to display the mechanical structure principle and process of disassembly and assembly. By presenting the full set of maintenance component or equipment at full size in the form of 3D visualization, the system is strongly interactive and enables maintenance training personnel to conduct simulated maintenance operation according to the actual process.

Platform Support

  • Wearable Device

    HTV vive

    Hololens

    BT-300

  • Mobile Devices

  • PC

  • Web

Functional Features

  • The 3D model is presented completely as it is at full size, and the model is moved to a certain position to match the image or actual object through Hololens and its gestures.

  • Parts of the maintenance object have their respective animation demonstrations. Click the object with gestures to watch the animation demonstration.

  • Each part corresponds to a set of supporting auxiliary elements, including picture and text, phonetic description, video and disassembly tooling.

  • Through the online function of Hololens, multiple people can jointly observe and analyze the same machine or component.

Hololens system, if systematically and comprehensively applied in fields like maintenance, interaction and training, can improve practicability and accuracy, enable maintenance or technical personnel to easily obtain relevant information, improve and enhance efficiency, accelerate progress, improve competitiveness, and meet industrial needs, truly achieving Hololens’ taking charge. In addition, through the use of multicomputer interconnection function between Hololens and information sharing between devices, the system allows users to manipulate objects in the virtual world. This can be applied to space collaborative design and research fields among multiple participants. The system is the product of combination between virtual reality technology and network technology. On the basis of the enhanced virtual reality system, multiple users are connected together via the Internet, allowing each user to participate in the same virtual space at the same time. Using networking mechanism to interact with other users, all users can conduct virtual experiments and collaborative operation together.

Technical Characteristics

  • Develop a remote debugging mechanism to remotely debug HoloLensUWP platform programs using PC platform.

  • Add AO screen effect to optimize model display.

  • Positioning and memory technology of HoloLens model is adopted to save the relative position between the model and the environment.

  • The web page controls HoloLens program remotely, and provides functions of recording, screenshot and program setting.

Application Fields and Implication

Entertainment
Medical Treatment
Military
Industry
Bridge Construction
Education
Transportation
Game

As far as current visual technology is concerned, AR/VR has relatively high popularity due to low technical threshold, while MR technology has relatively low popularity due to higher technical threshold. However, since mixed effect achieved by MR is of practical significance, giant companies including Intel, Microsoft and Samsung are mainly promoting MR technology. The applications of this technology is very extensive. In addition to industry and entertainment, there are more applicable fields which are related to our life. The core technology of MR technology lies in how to build an high-definition virtual object that can switch back and forth and focus accurately like a human eye. This is also the biggest difference and advantage compared with ordinary AR/VR devices.

Today, we are at the forefront of the information age: the hybrid age. This new era of technology is coming with the integration between technologies as well as the integration of people and technology. At the same time, the relationship between ourselves and technology is moving beyond tool use to existentialism. In the outside world, technology is no longer just processing our instructions in one direction. It is increasingly giving intelligent feedback. In this way, in the mixed age, man's natural nature will no longer be discrete and eternal truth. Evolution does not have to be accidental. It can have a direction, and it can be assisted by technology. Almost everything that is going to happen in the hybrid age, its seeds have been planted and are taking root around the world. Rapid evolution of Physical self and social relations, "explosive" increase of selections in all aspects of life, and new opportunities of the theory of collective action beyond traditional institutions all belong to a part of the hybrid era.

© 2018 Copyright G2DT. All Rights Reserved.

About Us
English