Making Vehicles & Robots See-Getting Started with Perception
Making Vehicles and Robots See: Getting Started with Perception for Students
This submission contains all of the example and exercise materials for the online tutorial series - Making Vehicles and Robots See: Getting Started with Perception for Students. Link to the video series: https://www.youtube.com/playlist?list=PLn8PRpmsu08pMH5wexyjc_4ludkyYvhqo.
While designing autonomous systems, there is typically a requirement to 'see' the environment. It could be an underwater vehicle navigating through obstacles, or a formula student car maneuvering through cones, or robot picking and placing an object.
This tutorial series will help you get started with the practical approaches while working with perception algorithms and how to tackle them. We will use MATLAB® as the platform to understand the algorithms and apply the techniques learnt using Simulink® through the exercises.
- Part 1: Basic Operations on Images - Link to Video https://www.youtube.com/watch?v=GKVLY0iFyK0&list=PLn8PRpmsu08pMH5wexyjc_4ludkyYvhqo&index=1
- Part 2: Image Segmentation and Analysis - Link to Video https://www.youtube.com/watch?v=-bYKl64vpGY&list=PLn8PRpmsu08pMH5wexyjc_4ludkyYvhqo&index=2
- Part 3: Features Matching and Tracking - Link to Video https://www.youtube.com/watch?v=rbjybw9UyOg&list=PLn8PRpmsu08pMH5wexyjc_4ludkyYvhqo&index=3
- Part 4: Basics on Point Cloud Processing - Link to Video https://www.youtube.com/watch?v=-k8CKky5Aqc&list=PLn8PRpmsu08pMH5wexyjc_4ludkyYvhqo&index=4
- Part 5: Image Classification with Deep Learning - Link to Video https://www.youtube.com/watch?v=mO5UqH409jY&list=PLn8PRpmsu08pMH5wexyjc_4ludkyYvhqo&index=5
About the Folders
- This folder contains files to work with the basic operations such as reading, displaying, resizing, cropping, rotating, filtering and enhancement on images in MATLAB.
- It concludes with an exercise to perform the learnt basic operations on images in Simulink.
- This folder contains files to segment an image based on colors, refine these detections, and analyze the resulting image regions all using interactive apps available in MATLAB.
- It concludes with an exercise to perform color-based segmentation and blob detection using Simulink.
- This folder contains files to detect, describe and match features between two images (demo1), and then to track an object in a video based on image features (demo2) using MATLAB.
- It concludes with an exercise to perform video recovery using feature matching in Simulink.
- This folder contains files for introducing the basics of point cloud processing by showing how to estimate the locations of objects in a 3D space using point clouds in MATLAB.
- It concludes with an exercise to perform location estimation of poles using a point cloud generated by an aerial vehicle.
- This folder contains files to train and test a deep neural network to classify a dataset of images
- It concludes with an exercise to perform image classification using the trained network in Simulink
About the Files
The main folder is divided as Parts specficified above. Each folder has files the following structure:
code: Contains MATLAB Live Scripts with all the commands used during the tutorial.
- Open the MATLAB Live Script (.MLX file)
- Step through each section of the code
- Interact with the controls to see the result of the corresponsing operations.
exercise: Recommended exercises to apply the concepts learnt from the video.
- Open the folder and the Simulink model
- Fill the blank areas in the Simulink model according to the problem statement
- Before Begining the series:
- Complete MATLAB Onramp
- During/After the series:
This repository uses the following MathWorks products:
- Image Processing Toolbox ™
- Computer Vision Toolbox ™
- Lidar Toolbox ™
- Deep Learning Toolbox ™
In case of any questions, please reach out to us at email@example.com.
Copyright 2021-2023 The MathWorks, Inc.
MathWorks Student Competitions Team (2024). Making Vehicles & Robots See-Getting Started with Perception (https://github.com/mathworks/getting-started-with-perception-for-students/releases/tag/1.0.8), GitHub. Retrieved .
MATLAB Release Compatibility
Platform CompatibilityWindows macOS Linux
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!Start Hunting!