Matlab activation function list

152 views (last 30 days)
CSCh
CSCh on 3 Mar 2022
Answered: CSCh on 19 Jan 2023
Hello,
where can I find an overview about functions to be used as activation functions in NN, e.g. radbas, tanh, sigmoid, tansig.... available in Matlab.
Thank you.

Answers (3)

Simon Chan
Simon Chan on 3 Mar 2022
Check this ink: MATLAB Functions

CSCh
CSCh on 3 Mar 2022
Thank you Simon,
I used the model function example below. From your link I can see some activationlayerfunction but can't derive if the "standalone" function is available. For Example I can not replace the tanh (I used in the model function) with a swish function, because it does not exists in Matlab, even there is a swishlayer. And the otherway around, there are no Transig- or radbas-layer , but the functions exits, and I can use it instead of tanh.
So I'a looking for a complete list of "Standalone" function which I can try for the model function instead of tanh.
function dlU = model(parameters,dlX,dlT)
dlXT = [dlX;dlT];
numLayers = numel(fieldnames(parameters))/2;
% First fully connect operation.
weights = parameters.fc1_Weights;
bias = parameters.fc1_Bias;
dlU = fullyconnect(dlXT,weights,bias);
% tanh and fully connect operations for remaining layers.
for i=2:numLayers
name = "fc" + i;
dlU = tanh(dlU);
weights = parameters.(name + "_Weights");
bias = parameters.(name + "_Bias");
dlU = fullyconnect(dlU, weights, bias);
end
end

CSCh
CSCh on 19 Jan 2023

Categories

Find more on Install Products in Help Center and File Exchange

Products


Release

R2021a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!