How to incorporate Deep Learning models in controlling vehicle maneuver in automated driving toolbox Simulink blocks?

I am trying to build virtual 3D driving senario using Automated Driving Toolbox (simulink blocks). Is there any possibility of controlling the vehicle maneuver dynamically by using Deep Learning models in Simuations.

Is there any possibilyt of including deep learning models in Simulink, if so how to control the vehicle maneuver based on the deep learning model results.

In math works i have seen multiple examples on controllong the vehicle maneuver like ACC, Lane Change, but my requirement is to use Deep Learning models to control the vehicle maneuver.

Thanks in advance.

Answer 1

[Anshika Chaurasia]

Hi Sudheer,

It is my understanding that you want to know how to include deep learning model into Simulink and where to use deep learning models in controlling vehicle maneuver.

• To integrate deep learning model with Simulink refer the link.
• You could try Deep Learning Toolbox block library to build neural networks.
• You could apply deep learning model in lane, vehicle and surrounding detection. Refer to following links for more examples related to controlling vehicle maneuver using deep learning model

Deep learning for automated driving: lane-detection

Highway Lane Change

Training a Deep Learning Vehicle Detector

[Sudheer Dunna]

Hello Anshika,

Thank you for the detailed explnation with reference links. Especially link related to integrate DL Model with simulink, answered my question.