So I'm using the parfor toolbox to do a batch analysis of data. In the analysis script, there are around 50 'save(X, ... '-append')' where variables are added on to an existing file. Over 200 runs, half of the runs seem to not be running or actually saving this line. 2 saves sitting in a very nearby earlier location are reliably saved, but something happens after this point.
The data is being generated and used to make figures. This error doesn't seem to trigger any actual error and things proceed as normal, until I try to retrieve variables from the file, at which point another script I'm running after noticing it is missing these variables.
I've seen other discussions about parfor saving but in my case there is no error, and it works sometimes fully. the half of runs which don't store these variables are in blocks throughout the 200 (not all at the beginning or end) which seems to suggest a specific worker may be having the issue (I run 4). Any insights into this would be appreciated.