Main Content

Choose a Sensor for Unreal Engine Simulation

In UAV Toolbox, you can obtain high-fidelity sensor data from a virtual environment. This environment is rendered using the Unreal Engine® from Epic Games®.

The table summarizes the sensor blocks that you can simulate in this environment.

Sensor BlockDescriptionVisualizationExample

Simulation 3D Camera

  • Camera with lens that is based on the ideal pinhole camera. See What Is Camera Calibration? (Computer Vision Toolbox)

  • Includes parameters for image size, focal length, distortion, and skew

  • Includes options to output ground truth for depth estimation and semantic segmentation

Display camera images by using a Video Viewer (Computer Vision Toolbox) or To Video Display (Computer Vision Toolbox) block. Sample visualization:

Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation

Display depth maps by using a Video Viewer (Computer Vision Toolbox) or To Video Display (Computer Vision Toolbox) block. Sample visualization:

Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation

Display semantic segmentation maps by using a Video Viewer (Computer Vision Toolbox) or To Video Display (Computer Vision Toolbox) block. Sample visualization:

Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation

Simulation 3D Fisheye Camera

  • Fisheye camera that can be described using the Scaramuzza camera model. See Fisheye Calibration Basics (Computer Vision Toolbox)

  • Includes parameters for distortion center, image size, and mapping coefficients

Display camera images by using a Video Viewer (Computer Vision Toolbox) or To Video Display (Computer Vision Toolbox) block. Sample visualization:

Simulate Simple Flight Scenario and Sensor in Unreal Engine Environment

Simulation 3D Lidar

  • Scanning lidar sensor model

  • Includes parameters for detection range, resolution, and fields of view

Display point cloud data by using pcplayer (Computer Vision Toolbox) within a MATLAB Function block. Sample visualization:

UAV Package Delivery

See Also