MATLAB Answers

During parfor-loop, suddenly get the error "unable to read file"

72 views (last 30 days)
Xingwang Yong
Xingwang Yong on 12 Dec 2020
Commented: Xingwang Yong on 14 Dec 2020
parfor k = 1:100000
% something else
tmpStruct = load(filename);
% something else
end
I have 3 scripts like the one above. I am running them on 3 different nodes of a cluster.
After some iterations, one job get the error "unable to read file, no such file or directory". This is confusing, since the file does exist and the other two jobs can read it.
I thought this is due to limited file handle of the linux system. But I don't understand why the load() function is related to file handle.
And, if they are related, how can I aviod this "limited file handle" problem? I tried to increase the file handle of linux, but it seems it will always exceed the limit if I run several jobs togegher.
By the way, I am definitely sure that I did not use fopen() in my script.
  9 Comments

Sign in to comment.

Answers (0)

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!