TEM Lab Digital Twinning

Electron Microscope is a very unique and expensive resource at LSU. They ask us to make a digital twin out of it inside an immersive environment like VR, so they can train their new intern PhD students easier and safer with visual feedback. We are in a team of 6 people start working on this project since 2024.

My role in the team is primarily as a tech artist and tool developer. So far, I have developed two systems:

  • First, a system to simulates the electron movement inside the electron microscope to give student visual feedback of what is happing inside the microscope when they switch and controls the knobs.
  • Second, I have created an UI widget to show each part of the microscope, and keep it flexible for artist so they can add the name of each part quickly.

Created In: Since 2024 – Present
Collaboration: A group of 6 people
Game Engine: Unreal Engine – C++

Making the electron microscope simulation is a creative and important part of this digital twin training. We are using the advantage of virtual world and cutting down the microscope into half to give the students a visual and accurate feedback on how the microscope works in practice. In order to maintain the accuracy while having flexibility and mimicking the real microscope factuality. I developed a flexible system with C++ and mathematic formulas ,like refection and matrixes for rotation, in Unreal Engine. The system first implemented and prototyped within editor debug tools and buttons and after getting feedback from customer the more refined version implemented with Unreal Engine Niagara and particle effect to make built on Meta quest3 VR headsets.