My Journey at ChimeraXR
I joined ChimeraXR in March 2021 as the company's very first developer. My initial project, Mythos, was a groundbreaking tactical virtual reality training system designed for agencies and academies to train high-quality scenarios with up to five use-of-force options in the same scene. Mythos quickly became recognized as the most advanced, flexible, and realistic tactical VR training system in North America, enabling first responders to train in hyper-realistic scenarios of environments that are not typically accessible.
As part of the Mythos team, I was responsible for developing highly accurate training scenarios to provide users with realistic simulations for firearm training. We created various scenarios, including Vehicle Close Quarters Battle (VCQB) content, to ensure comprehensive and effective training. The focus on realism and accuracy was critical for de-escalation training, communication skills, and recognizing pre-assault indicators.
In 2024, with the release of Meta Quest 3, we began working on an MR project called Project Spear. This project was similar to Mythos but integrated mixed reality for firearm training instead of being purely VR. As a team, we continued to develop content for Project Spear, learning to implement new technologies for mixed reality multi-user scenarios. Throughout my time at ChimeraXR, which was recently acquired by Street Smarts VR, I witnessed the team grow from a single developer to a robust team of about ten talented individuals.
Below, you will find videos and images showcasing some of the advanced training scenarios and the innovative work I accomplished on Project Mythos.
Project Mythos Development Highlight Gallery
Here are a few videos highlighting my work:
This video demonstrates the Suspect Pull Over scenario from Project Mythos. A key aspect of development was ensuring an exceptionally high level of detail for immersive training experiences. Accuracy to real-world scenarios was crucial, providing first responders with realistic and effective training environments that closely mirror real-life situations.
This video showcases the AI character reactions I developed in Project Mythos. Characters remain unresponsive when players hover over them through walls but react appropriately when a weapon is pointed at them in the same room. This emphasizes the importance of line of sight for creating realistic and effective training scenarios.
This video demonstrates VCQB training with weapon muzzle orientation tracking, showcasing my development of a gyroscope feature. This ensures the firearm's muzzle isn't raised too high on the y-axis, regardless of its position, for accurate and realistic training scenarios. This feature is essential for effectiveness in tactical training environments.
This screenshot highlights the implementation of multi-user features for various training scenarios, including concert hall venues and schools. I was responsible for developing these multi-user capabilities, which are crucial for creating realistic and effective training environments.
Multi-user Development:
Project Spear Development Highlight Gallery
Ghost Recorder Functionality in Project Spear
In Project Spear, I developed the Ghost Recorder functionality, a critical feature for enhancing training and analysis in Mixed Reality (MR). The Ghost Recorder captures each frame of a drill, allowing users to review their movements, bullet trajectories, and weapon locations in real-time by playing back ghost characters. This detailed tracking enables users to assess exactly where they shot and the accuracy of their trajectories, making it invaluable for refining techniques.
The Ghost Recorder also tracks enemy NPCs, displaying their actions and bullet trajectories with the same level of detail. This functionality supports multiplayer scenarios, where multiple users can review their drills with dynamically assigned, differently colored ghost characters, ensuring clear differentiation between each participant. By recording and storing frame data, the system accurately replays these sequences, providing a comprehensive review tool that enhances performance, situational awareness, and shooting accuracy during training exercises.
Developing Realistic Instructional Content for Firearm Training
At ChimeraXR, I was deeply involved in creating immersive virtual training environments using Unreal Engine, particularly focusing on scenarios that required precise replication of real-world tactical training. My focus was on accurately replicating real-life VCQB (Vehicle Close Quarters Battle) training scenarios to ensure that the virtual experience closely mirrored real-world training.
In the VCQB scenario, trainees are guided by an explanation video displayed in a floating widget beside a police cruiser. They are instructed to target specific locations on the vehicle, with each task's completion advancing the system's progression. This setup was meticulously designed to replicate the complexities and demands of real-world training.
By developing these realistic training modules, we aimed to provide users with an immersive and effective training environment that not only teaches technical skills but also prepares them for the challenges they might face in real situations. My work ensured that every aspect of the training was as lifelike as possible, contributing to ChimeraXR's mission of creating realistic virtual training solutions.
Diverse Hardware Integration
At ChimeraXR, we worked with various hardware to enhance our training simulations. This included attaching specific components like Quest 3 trackers to firearms, allowing users to interact with their own weapons in VR and MR environments. Our work involved integrating different hardware solutions to support realistic and effective training.
