LVC

LVC

The Live, Virtual, Constructive (LVC) project conducts research that leads to evidence based decisions about the most effective training systems and produces prototypes that push the cutting edge of technology-enhanced training. Within the LVC project are four cohesive areas of research.

1. Homunculus
2. MR-T
3. Multiview
4. Omniscribe
5. The Veldt
       Veldt Scenarios


Homunculus

Homunculus is a project focused on capturing 360 degrees of video from a warfighter during training or combat. To accomplish this, four commercial cameras were embedded within a ski helmet and connected to a small Linux powered Panda board. The streams of all four cameras are sent wirelessly from the Panda board to a server that can direct the video streams to any computer that requests it. The goal is to use this information in useful ways, such as having a remote person or computer algorithm detect threats or useful information from all around the warfighter and signal to them when needed. In essence, you can have someone watching your back…and your sides…and your front.

IMG_5842


MR-T

MR-T is a set of software that helps all the hardware in the MiRAGE communicate with VR and other applications that are running. It helps simulation operators keep track of the relationship between physical and virtual objects by displaying an overview of the current simulation. It also connects to VRJuggler to visualize the data that is flowing into the simulation, allowing problems to be detected much more quickly than they normally could be. Finally, it addresses the complexities of launching a mixed reality application in a constantly changing environment by providing a graphical user interface for application launching.
IMG_5924


Multiview

The Multiview part of the project is aimed at quantifying and solving the issues associated with multiple trainees in the same trainer. Traditionally, virtual trainers use a single head position to determine what to draw on the trainer’s screens. This only provides an accurate view for the one head-tracked trainee, with the other trainees having a slightly distorted view. Multiview quantifies the errors associated with using a single head-tracked position during training. A view-averaged head position was also developed to take two user’s head positions and average then to achieve a single “head-tracked” position in-between the two trainees. The quantitative results can be used to improve current trainers and develop more effective trainers in the future.


Omniscribe

Omniscribe is an opensource after action review (AAR) tool that allows the gathering, annotating, and display of many different disparate forms of data at the same time. Built using C++ libraries like Qt and OpenCV, Omniscribe provides developers a toolset to build their own AAR tools. Currently, Omniscribe allows for the capture of network training information (such as DIS packets), video streams (both web and IP cams), audio information, and physiological information (heart rate, galvanic skin response).

IMG_5918


The Veldt

The Veldt is a mixed-reality training facility integrating virtual reality technology into a physical environment comprised of movable walls and props. The first thing to notice when entering the Veldt is the 40ft by 13ft high definition, stereo projection screen taking up one wall of the room. This screen allows the Veldt to extend beyond the limits of the physical room into a virtual world. L-shaped walls were built within the Veldt that allow trainers to completely reconfigure the floor plan for training within 15 minutes. The walls improves immersion by providing physicals objects to interact with as well as prevents trainees from learning a single floor plan. Smaller stereo displays are used within windows and doors to provide additional “windows” into the virtual world. A 24 camera infrared tracking system is used to track all physical objects in the Veldt. This allows synchronization between the real world and the virtual world as well as providing valuable insights into trainees’ behaviors. The Veldt provides a perfect training platform for all the other training technology investigated in the LVC project.

http://youtu.be/tLfhy_ItsFc

The Mixed Reality of the Veldt


Scenarios

Checkpoint Simulation

Clearing a room

IED Disarming