Deep Learning for Image Processing

Perform image processing tasks, such as removing image noise and performing image-to-image translation, using deep neural networks (requires Deep Learning Toolbox™)

Deep learning uses neural networks to learn useful representations of features directly from data. For example, you can use a pretrained neural network to identify and remove artifacts like noise from images.

A noisy image is passed to a trained denoising network, which returns a denoised image.

Functions

expand all

Create Datastores for Image Preprocessing

`augmentedImageDatastore`	Transform batches to augment image data
`blockedImageDatastore`	Datastore for use with blocks from `blockedImage` objects
`denoisingImageDatastore`	Denoising image datastore
`imageDatastore`	Datastore for image data
`randomPatchExtractionDatastore`	Datastore for extracting random 2-D or 3-D random patches from images or pixel label images
`transform`	Transform datastore
`combine`	Combine data from multiple datastores

Augment Images

`jitterColorHSV`	Randomly alter color of pixels
`randomWindow2d`	Randomly select rectangular region in image
`randomCropWindow3d`	Create randomized cuboidal cropping window
`centerCropWindow2d`	Create rectangular center cropping window
`centerCropWindow3d`	Create cuboidal center cropping window
`Rectangle`	Spatial extents of 2-D rectangular region
`Cuboid`	Spatial extents of 3-D cuboidal region
`randomAffine2d`	Create randomized 2-D affine transformation
`randomAffine3d`	Create randomized 3-D affine transformation
`affineOutputView`	Create output view for warping images
`imerase`	Remove image pixels within rectangular region of interest

Resize and Reshape Deep Learning Input

`resize2dLayer`	2-D resize layer
`resize3dLayer`	3-D resize layer
`dlresize`	Resize spatial dimensions of `dlarray` object
`DepthToSpace2DLayer`	Depth to space layer
`SpaceToDepthLayer`	Space to depth layer
`depthToSpace`	Rearrange `dlarray` data from depth dimension into spatial blocks
`spaceToDepth`	Rearrange spatial blocks of `dlarray` data along depth dimension

Create Deep Learning Networks

`encoderDecoderNetwork`	Create encoder-decoder network
`blockedNetwork`	Create network with repeating block structure
`pretrainedEncoderNetwork`	Create encoder network from pretrained network
`cycleGANGenerator`	Create CycleGAN generator network for image-to-image translation
`patchGANDiscriminator`	Create PatchGAN discriminator network
`pix2pixHDGlobalGenerator`	Create pix2pixHD global generator network
`addPix2PixHDLocalEnhancer`	Add local enhancer network to pix2pixHD generator network
`unitGenerator`	Create unsupervised image-to-image translation (UNIT) generator network
`unitPredict`	Perform inference using unsupervised image-to-image translation (UNIT) network

Denoise Images

`denoiseImage`	Denoise image using deep neural network
`denoisingNetwork`	Get image denoising network
`dnCNNLayers`	Get denoising convolutional neural network layers

Topics

Preprocess Image Data for Deep Learning

Get Started with Image Preprocessing and Augmentation for Deep Learning

Preprocess data with deterministic operations such as normalization or color space conversion, or augment training data with randomized operations such as random cropping or color jitter.
Datastores for Deep Learning (Deep Learning Toolbox)
Learn how to use datastores in deep learning applications.
Prepare Datastore for Image-to-Image Regression (Deep Learning Toolbox)
This example shows how to prepare a datastore for training an image-to-image regression network using the transform and combine functions of ImageDatastore.
Augment Images for Deep Learning Workflows
This example shows how you can perform common kinds of randomized image augmentation such as geometric transformations, cropping, and adding noise.

Create Neural Networks for Image Processing Applications

Train and Apply Denoising Neural Networks
Use a pretrained neural network to remove Gaussian noise from a grayscale image, or train your own network using predefined layers.
Create Modular Neural Networks
You can create and customize deep learning networks that follow a modular pattern with repeating groups of layers, such as U-Net and cycleGAN.
Get Started with GANs for Image-to-Image Translation
Transfer styles and characteristics from one set of images to the scene content of other images by using generative adversarial networks (GANs).
Pretrained Deep Neural Networks (Deep Learning Toolbox)
Learn how to download and use pretrained convolutional neural networks for classification, transfer learning and feature extraction.
List of Deep Learning Layers (Deep Learning Toolbox)
Discover all the deep learning layers in MATLAB^®.

Deep Learning in MATLAB

Deep Learning in MATLAB (Deep Learning Toolbox)
Discover deep learning capabilities in MATLAB using convolutional neural networks for classification and regression, including pretrained networks and transfer learning, and training on GPUs, CPUs, clusters, and clouds.
Semantic Segmentation Using Deep Learning (Computer Vision Toolbox)
This example shows how to segment an image using a semantic segmentation network.

Featured Examples

Increase Image Resolution Using Deep Learning

Create a high-resolution image from a low-resolution image using a very-deep super-resolution (VDSR) neural network.

Deep Learning for Image Processing

Functions

Create Datastores for Image Preprocessing

Augment Images

Resize and Reshape Deep Learning Input

Create Deep Learning Networks

Denoise Images

Topics

Preprocess Image Data for Deep Learning

Create Neural Networks for Image Processing Applications

Deep Learning in MATLAB

Featured Examples

Increase Image Resolution Using Deep Learning

Unsupervised Day-to-Dusk Image Translation Using UNIT

Detect Image Anomalies Using Explainable FCDD Network

Classify Defects on Wafer Maps Using Deep Learning

Detect Image Anomalies Using Pretrained ResNet-18 Feature Embeddings

Unsupervised Medical Image Denoising Using CycleGAN

Unsupervised Medical Image Denoising Using UNIT

JPEG Image Deblocking Using Deep Learning

Image Processing Operator Approximation Using Deep Learning

Develop Camera Processing Pipeline Using Deep Learning

Brighten Extremely Dark Images Using Deep Learning

Classify Tumors in Multiresolution Blocked Images

3-D Brain Tumor Segmentation Using Deep Learning

Semantic Segmentation of Multispectral Images Using Deep Learning

Neural Style Transfer Using Deep Learning

Remove Noise from Color Image Using Pretrained Neural Network

Quantify Image Quality Using Neural Image Assessment