Feature transformation techniques reduce the dimensionality in the data by transforming data into new features. Feature selection techniques are preferable when transformation of variables is not possible, e.g., when there are categorical variables in the data. For a feature selection technique that is specifically suitable for least-squares fitting, see Stepwise Regression.
|Univariate feature ranking for classification using chi-square tests|
|Rank features for classification using minimum redundancy maximum relevance (MRMR) algorithm|
|Feature selection using neighborhood component analysis for classification|
|Univariate feature ranking for regression using F-tests|
|Feature selection using neighborhood component analysis for regression|
|Rank features for unsupervised learning using Laplacian scores|
|Compute partial dependence|
|Create partial dependence plot (PDP) and individual conditional expectation (ICE) plots|
|Predictor importance estimates by permutation of out-of-bag predictor observations for random forest of classification trees|
|Predictor importance estimates by permutation of out-of-bag predictor observations for random forest of regression trees|
|Estimates of predictor importance for classification tree|
|Estimates of predictor importance for classification ensemble of decision trees|
|Estimates of predictor importance for regression tree|
|Estimates of predictor importance for regression ensemble|
|Rank importance of predictors using ReliefF or RReliefF algorithm|
|Sequential feature selection using custom criterion|
|Perform stepwise regression|
|Create generalized linear regression model by stepwise regression|
Learn about feature selection algorithms and explore the functions available for feature selection.
This topic introduces to sequential feature selection and provides an example that
selects features sequentially using a custom criterion and the
Neighborhood component analysis (NCA) is a non-parametric method for selecting features with the goal of maximizing prediction accuracy of regression and classification algorithms.
Make a more robust and simpler model by removing predictors without compromising the predictive power of the model.
Select split-predictors for random forests using interaction test algorithm.
Feature extraction is a set of methods to extract high-level features from data.
This example shows a complete workflow for feature extraction from image data.
This example shows how to use
disentangle mixed audio signals.
t-SNE is a method for visualizing high-dimensional data by nonlinear reduction to two or three dimensions, while preserving some features of the original data.
This example shows how t-SNE creates a useful low-dimensional embedding of high-dimensional data.
This example shows the effects of various
Output function description and example for t-SNE.
Principal Component Analysis reduces the dimensionality of data by replacing several correlated variables with a new set of variables that are linear combinations of the original variables.
Perform a weighted principal components analysis and interpret the results.
Factor analysis is a way to fit a model to multivariate data to estimate interdependence of measured variables on a smaller number of unobserved (latent) factors.
Use factor analysis to investigate whether companies within the same sector experience similar week-to-week changes in stock prices.
This example shows how to perform factor analysis using Statistics and Machine Learning Toolbox™.
Nonnegative matrix factorization (NMF) is a dimension-reduction technique based on a low-rank approximation of the feature space.
Perform nonnegative matrix factorization using the multiplicative and alternating least-squares algorithms.
Multidimensional scaling allows you to visualize how near points are to each other for many kinds of distance or dissimilarity metrics and can produce a representation of data in a small number of dimensions.
perform classical (metric) multidimensional scaling, also known as
principal coordinates analysis.
This example shows how to perform classical multidimensional scaling using the
cmdscale function in Statistics and Machine Learning Toolbox™.
This example shows how to visualize dissimilarity data using nonclassical forms of multidimensional scaling (MDS).
Perform nonclassical multidimensional scaling using
Procrustes analysis minimizes the differences in location between compared landmark data using the best shape-preserving Euclidean transformations.
Use Procrustes analysis to compare two handwritten numerals.