Working on large .db file (database file) using MapReduce?
1 view (last 30 days)
Show older comments
I have a very large signal file stored in a sqlite database file, it over 100 gb. I have the code section for extracting the data over to a matrix in matlab and storing it in a ,mat file, which has worked fine for small signals. However, I would like to do this to the large signal also but the signal is too large for memory.
I read that you can work on large files using MapReduce, however i only see how to use this with .csv files or other types of table data.
Is it possible to use MapReduce with this type of file? Or are there any other method to work on this signal without loading it into memory in its entirety?
0 Comments
Answers (0)
See Also
Categories
Find more on MapReduce in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!