Running two functions in parallel of which one would like to use parfor

2 views (last 30 days)
Challenge: I repetitively read external data needing 250ms per data set. Then I process the data which takes 300ms on 20 phyical cores.
Now, it would of course be good to read data, and while the processing is in action, already read the next set. But, since I already use "parfor" in data processing, I cannot put both functions (reading and processing) in an smpd environment.
Ok, I think I know the long answer to this question: Put everything in smpd, send one of the workers in the data reading function and 20 of them to data processing and "rebuild" parfor functionality (means distribute loop indices and accumulate results on a master worker).
Maybe there is a shortcut I don't know? This problem should not be so unusual that there is no chance for an easy solution
Thanks,
Michael

Accepted Answer

Mohammad Abouali
Mohammad Abouali on 23 Dec 2015
Use non-blocking parfeval().

More Answers (0)

Categories

Find more on Parallel for-Loops (parfor) in Help Center and File Exchange

Tags

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!