MATLAB Answers

0

large csv import and split

Asked by Sirius8 on 10 Feb 2018
Latest activity Answered by Jeremy Hughes on 12 Feb 2018
As a newbie i am working on a signal retrieved from a geophone. What i am trying to do is to import my .csv file (weekly file size around 25GB) into matlab in order to process it. Microsoft excel doesn't open it of course. One solution is to split the original .csv into smaller, but i prefer to plot all the file at once (if it is possible).
Αs shown below, first column contains date&time, second column yes/no from a rain sensor and last column voltage.
"2018-01-25T13:17:46.203005" "NO" "0.05"
How can i import my initial large .csv file into 3 different columns (matrices, not cells)? Thanks in advance!

  0 Comments

Sign in to comment.

1 Answer

Answer by Jeremy Hughes on 12 Feb 2018

With a file that's 25GB, you're going to need to break the data up. I recommend using
ds = tabularTextDatastore(filename)
while hasdata(ds)
T = read(ds)
end
You might have to tweak some settings, but this is the easiest way.

  0 Comments

Sign in to comment.