bug parfor: analyzing and transferring files to worker: not done: blocked
30 views (last 30 days)
Show older comments
Hello there,
I am a running a working script with parfor on matlab, after a while (~1200 iteration on parfor), matlab block without appareant reasons while producing the following message: "analyzing and transferring files to workers...". I am running the parfor on matlab 2023a, on local parfor only. I did validate the cluster of parfor before. The code is working correctly as the 1200 files were done. I tried with other very similar files and it did block also similarly. There is largely enough memory space on my PC. I tried to restart matlab, and also my PC, but this did not solve the problem. I also tried to find solution online, unsuccesfully. Anyone would have an idea ? many thanks for your attention.
2 Comments
Ganesh
on 17 Jan 2024
In order for us to reproduce this issue, it would be a helpful if you share your code files.
I would also request you to share the stack trace of the error you are encountering.
Answers (2)
Edric Ellis
on 17 Jan 2024
The "analyzing and transferring files to workers" message occurs only when the workers encounter a failure to find some code that they need. If you're using the "local" cluster type, then you should basically never see this. You can diagnose what got transferred by using listAutoAttachedFiles after your parfor loop, like this:
parfor i = 1:n
doStuff()
end
% Assuming "analyzing and transferring..." message has occurred
listAutoAttachedFiles(gcp())
3 Comments
Steven Lord
on 17 Jan 2024
Without seeing the body of your functAA function, I suspect it's probably going to be difficult or impossible to offer any specific suggestions.
Felix
on 7 Jul 2024
Ok. This is a bit late but hope it still helps. Also this may help people like me who encountered the same problem.
The behavior of stucking on 'analyzing and transferring files to worker ...' is most likely caused by error thrown by whatever functions called within the parfor loop somewhere in the middle of the parfor iterations.
When this happens, for reasons, instead of actually reporting the error, MATLAB will stuck on the message 'analyzing and transferring files to worker ...'.
The fix of this problem is obviously to resolve the error within the parfor loop. To see the error message, the workaround for MATLAB 2024a/2023b (I didn`t check other releases) is using thread based parpool, i.e., pool = parpool('Threads') before the parpool.
I hope this helps.
0 Comments
See Also
Categories
Find more on Parallel for-Loops (parfor) in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!