Statistics and Machine Learning Toolbox
Analyze and model data using statistics and machine learning
Statistics and Machine Learning Toolbox™ provides functions and apps to describe, analyze, and model data. You can use descriptive statistics and plots for exploratory data analysis, fit probability distributions to data, generate random numbers for Monte Carlo simulations, and perform hypothesis tests. Regression and classification algorithms let you draw inferences from data and build predictive models.
For multidimensional data analysis, Statistics and Machine Learning Toolbox provides feature selection, stepwise regression, principal component analysis (PCA), regularization, and other dimensionality reduction methods that let you identify variables or features that impact your model.
The toolbox provides supervised and unsupervised machine learning algorithms, including support vector machines (SVMs), boosted and bagged decision trees, k-nearest neighbor, k-means, k-medoids, hierarchical clustering, Gaussian mixture models, and hidden Markov models. Many of the statistics and machine learning algorithms can be used for computations on data sets that are too big to be stored in memory.
Visually explore data using probability plots, box plots, histograms, quantile-quantile plots, and advanced plots for multivariate analysis, such as dendrograms, biplots, and Andrews plots.
Understand and describe potentially large sets of data quickly using a few highly relevant numbers.
Discover patterns by grouping data using k-means, k-medoids, DBSCAN, hierarchical clustering, and Gaussian mixture and hidden Markov models.
Extract features from data using unsupervised learning techniques such as sparse filtering and reconstruction ICA. You can also use specialized techniques to extract features from images, signals, text, and numeric data.
Automatically identify the subset of features that provide the best predictive power in modeling the data. Feature selection methods include stepwise regression, sequential feature selection, regularization, and ensemble methods.
Feature Transformation and Dimensionality Reduction
Reduce dimensionality by transforming existing (non-categorical) features into new predictor variables where less descriptive features can be dropped. Feature transformation methods include PCA, factor analysis, and nonnegative matrix factorization.
Train, Validate, and Tune Predictive Models
Compare various machine learning algorithms, select features, adjust hyperparameters, and evaluate predictive performance. Build and automatically optimize predictive models with interactive apps.
Model a categorical response variable as a function of one or more predictors. Use a variety of parametric and nonparametric classification algorithms, including logistic regression, SVM, boosted and bagged decision trees, naive Bayes, discriminant analysis, and k-nearest neighbors.
Automated Model Optimization
Improve model performance by automatically tuning hyperparameters, selecting features, and addressing data set imbalances with cost matrices.
Linear and Nonlinear Regression
Model behavior of complex systems with multiple predictors or response variables choosing from many linear and nonlinear regression algorithms. Fit multilevel or hierarchical, linear, nonlinear, and generalized linear mixed-effects models with nested and/or crossed random effects to perform longitudinal or panel analyses, repeated measures, and growth modeling.
Generate an accurate fit without specifying a model that describes the relationship between predictors and response, including SVMs, random forests, Gaussian processes, and Gaussian kernels.
Analysis of Variance (ANOVA)
Assign sample variance to different sources and determine whether the variation arises within or among different population groups. Use one-way, two-way, multiway, multivariate, and nonparametric ANOVA, as well as analysis of covariance (ANOCOVA) and repeated measures analysis of variance (RANOVA).
Random Number Generation
Generate pseudorandom and quasi-random number streams from either a fitted or a constructed probability distribution.
Perform t-tests, distribution tests (Chi-square, Jarque-Bera, Lilliefors, and Kolmogorov-Smirnov), and nonparametric tests for one, paired, or independent samples. Test for autocorrection and randomness, and compare distributions (two-sample Kolmogorov-Smirnov).
Design of Experiments (DOE)
Define, analyze, and visualize a customized design of experiments (DOE). Create and test practical plans for how to manipulate data inputs in tandem to generate information about their effects on data outputs.
Statistical Process Control (SPC)
Monitor and improve products or processes by evaluating process variability. Create control charts, estimate process capability, and perform gage repeatability and reproducibility studies.
Reliability and Survival Analysis
Visualize and analyze time-to-failure data with and without censoring by performing Cox proportional hazards regression and fit distributions. Compute empirical hazard, survivor, cumulative distribution functions, and kernel density estimates.
Analyze Big Data with Tall Arrays
Use tall arrays and tables with many classification, regression, and clustering algorithms to train models on data sets that do not fit in memory without changing your code.
Speed up statistical computations and model training with parallelization.
Cloud and Distributed Computing
Use cloud instances to speed up statistical and machine learning computations. Perform the complete machine learning workflow in MATLAB Online™.
Generate portable and readable C or C++ code for inference of classification and regression algorithms, descriptive statistics, and probability distributions using MATLAB CoderTM. Accelerate verification and validation of your high-fidelity simulations using machine learning models through MATLAB function blocks and system blocks.
Integrate with Applications and Enterprise Systems
Deploy statistical and machine learning models as standalone, MapReduce, Spark™ applications, web apps, and Microsoft® Excel® add-ins using MATLAB Compiler™. Build C/C++ shared libraries, Microsoft .NET assemblies, Java® classes, and Python® packages using MATLAB Compiler SDK™.
Updating Deployed Models
Update parameters of deployed models without regenerating the C/C++ prediction code.
Automated Machine Learning (AutoML)
Automatically select the best model and associated hyperparameters for classification (
Rank features using chi-square tests (
fscchi2) for classification and F-tests (
fsrftest) for regression problems
Predict using all-numeric tables (requires MATLAB Coder)
Generate fixed-point C/C++ code for decision trees and ensembles of decision trees (requires MATLAB Coder and Fixed-Point Designer)
random, and 32 probability distribution functions by executing on a GPU (requires Parallel Computing Toolbox)