How bayesopt find kernel parameters

11 views (last 30 days)
Aep
Aep on 4 Sep 2020
Edited: Mahdi Nobar on 4 Dec 2021
Hello all,
I know that bayesopt uses fitrgp to create gaussian process in each iteration. But how bayesopt find the optimize kernel parameters of the Gaussian process regression in each step? Does it optimize kernel parameters at all? If not, what are the kernel paramters being used in each iteration?
I want to know the default configurations of bayesopt for the items above, I was not able to find my answer in the documentation.
Thank you in advance

Answers (1)

Mohith Kulkarni
Mohith Kulkarni on 25 Sep 2020
Edited: Mohith Kulkarni on 25 Sep 2020
By default the optimize parameter is set to 0 for the fitrgp KernelFunction and KernelScale hyperparmeters. Refer to the below code to change the parameter:
params = hyperparameters('fitrgp',X,y);
params(3).Optimize = true; %set KernelFunction optimize to true
params(4).Optimize = true; %set KernelScale optimize to true
In case of "fitrgp" fit function, check Hyperparameter Optimization section of fitrgp arguments for more information. You can check the default Kernel Function and Kernel Parameters of fitrgp fit function here:
you can then use the fit function in the objective function.
For more information on performing Bayesian Optimization using bayesopt refer to:
  4 Comments
Aep
Aep on 2 Oct 2020
Thank you very much for your answer Mohith. So as you mentioned the inital values are different in each iteration. But considering just one single iteration. We have some initial values. What happens to these values in that specific iteration in bayesopt? Do they change in that iteration? If yes, how?
I apologize if it is a basic question in Gaussian process. I am new to this and I want to make it clear for myself about how Bayesopt does this.
Mahdi Nobar
Mahdi Nobar on 4 Dec 2021
Edited: Mahdi Nobar on 4 Dec 2021
Can someone please answer last comment? @Mohith Kulkarni?

Sign in to comment.

Tags

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!