how to accumulation a cell (x) data. from 30 file data.
Show older comments
i have 1440x9 cell data from a file, n i have 360 file data in a folder. how to accumulation data cell 3, from 30 file data.
ps:
1 format file is : mm-day-year.dat
2 folder name ex: 2011
3 data accumulation is from 01-01-2011 to 1-30-2011 (a month from 12 month)
4 how to plot result data poin 3 with month. in a year
thanks
Accepted Answer
per isakson
on 3 Jul 2012
Edited: per isakson
on 3 Jul 2012
This is a start
function cssm( folder_spec, file )
03:05:00 .000 065.501 01** 4864 0086 0074 +19 03:06:00 .000 065.501 01** 4862 0095 0074 +19 03:07:00 R- .026 065.501 01** 4862 0105 0074 +19 03:08:00 R- .180 065.504 01** 4864 0105 0074 +19
sad = dir( fullfile( folder_spec, file ) );
for sa = transpose( sad )
fid = fopen( fullfile( folder_spec, sa.name ), 'r' );
cac = textscan( fid, '%8c%2c%4f%7f%4c%4u%4u%4u+%2u' ...
, 'Delimiter', ' ', 'Whitespace', '' );
fclose( fid );
end
end
Try:
- set break point at first line
- run
cssm( 'c:\your_path\2011\', '*.dat' )
- experiment in break mode with the actual data
- add working lines of code to the function
- save and restart function when it becomes messy
43 Comments
per isakson
on 3 Jul 2012
Have you edited cssm.m according to my answer? Do you have more than one cssm.m? Try "which cssm.m -all". You might want to change the name of the file.
per isakson
on 3 Jul 2012
Name of file and function must be the same!
Walter Roberson
on 3 Jul 2012
And do not forget the important part about setting the breakpoint before running the program.
Soni huu
on 3 Jul 2012
per isakson
on 3 Jul 2012
Edited: per isakson
on 3 Jul 2012
There is no output in the signature! If you want one output you have to change the signature to
function cac = cssmsum( folder_spec, file )
Pay more attention to the error messages. Mostly they are meaningful!
per isakson
on 3 Jul 2012
Edited: per isakson
on 3 Jul 2012
Doug Hull has made many useful demos on coding with Matlab. Watch a demo on using the debugger and search for more. Did you read the page in the documentation that Walter recommended?
Soni huu
on 3 Jul 2012
Walter Roberson
on 3 Jul 2012
If you got as far as that message about too many output arguments, then you did not put in the breakpoint as instructed!
Soni huu
on 3 Jul 2012
Soni huu
on 3 Jul 2012
Walter Roberson
on 3 Jul 2012
cac = cssmsum( 'C:\matlab7\work\org\2011\', '*.dat' )
2880 lines is trivial for these routines.
per isakson
on 3 Jul 2012
Edited: per isakson
on 3 Jul 2012
folder_spec is the name of a variable, the value of which in your case is 'C:\matlab7\work\org\2011\'. file is the name of another variable with the value, '*.dat'. The two serve as input arguments to the function cssmsum.
per isakson
on 3 Jul 2012
Edited: per isakson
on 3 Jul 2012
It is easier to use a small data file when you develop the code. 1440 line makes it awkward. However, 1440 is no problem for Matlab
per isakson
on 3 Jul 2012
Edited: per isakson
on 3 Jul 2012
Why did you change the signature? It shall read
function cssmsum( folder_spec, file )
or if you prefer
function cac = cssmsum( folder_spec, file )
Make sure your call matches the signature.
Why did you remove "fullfile" from the fopen command?
It is time
- you read about functions in the Getting Started.
- make some simple exercises with input and output arguments.
Did you watch the demos of Doug?
Walter Roberson
on 3 Jul 2012
When your lines are not in a consistent format, do not use textscan(). Instead, fgetl() the line, figure out which of the formats the line is in, sscanf() with the appropriate format (or discard the line), append the values to the list of values you are building up, and loop back for the next line. Remember to test that the value returned by fgetl() ischar() as fgetl() will return -1 (a numeric value) at end of file.
per isakson
on 3 Jul 2012
Edited: per isakson
on 3 Jul 2012
The function, textscan, is made to handle text files, which contain
- header lines at the top of the file
- data lines, all of which have the same format, i.e. number and type of columns
- comment lines, which are ignored
All these type of lines are optional.
Thus, your file cannot be read and parsed by textscan in one step.
You save yourself trouble if you gather information on the file before you start to make code. Did you read the manual of the instrument in question?
Are there more special cases than "Calibration"?
How shall these special cases be handled?
per isakson
on 3 Jul 2012
Edited: per isakson
on 3 Jul 2012
What happend to "R-"?
What about the line "09:31:00 C"?
Does "---" differ from "----"?
per isakson
on 3 Jul 2012
Edited: per isakson
on 3 Jul 2012
Markup the data lines as "Code". (Below, I have intended the data lines by four spaces.) That will make communication more effective.
The format string I proposed above parses lines like the two below
03:07:00 R- .026 065.501 01** 4862 0105 0074 +19
03:08:00 R- .180 065.504 01** 4864 0105 0074 +19
However, that format string will not parse lines like the following three (they are four positions shorter)
09:35:00 .000 000.000 01** 4856 0058 0300 +24
09:36:00 .000 000.000 01** 4852 0058 0300 +25
09:37:00 .000 000.000 01** 4854 0058 0300 +25
That is because there is nothing in these lines that matches "%2c".
Prepare a sample file that includes all types of data lines that may appear in a file.
Walter Roberson
on 3 Jul 2012
Sounds like a lot of trouble to go through to me. I would use a much more appropriate tool to filter the data before even reading it into MATLAB. For example, in Unix-like systems, if the data was in rain.txt then
sed -e '/C$/,+3d' rain.txt > newrain.txt
This can also be rewritten in terms of perl (a programming language which is installed with every MATLAB installation)
Soni huu
on 3 Jul 2012
Soni huu
on 3 Jul 2012
per isakson
on 4 Jul 2012
Edited: per isakson
on 4 Jul 2012
This file reads your sample file. First it reads the whole files to a cell array, cac, with one line of the file per row of the array. Next it removes rows, which match "16:45:00 C" or "16:46:00 ----". Lastly it parse the data. It is tested. Try
>> cac = ReadSoniData( 'h:\m\cssm', 'SoniData.txt' );
.
function cac = ReadSoniData( folder_spec, file )
sad = dir( fullfile( folder_spec, file ) );
for sa = transpose( sad )
fid = fopen( fullfile( folder_spec, sa.name ), 'r' );
cac = textscan( fid, '%s', 'Whitespace','', 'Delimiter','\n' );
fclose( fid );
cac = cac{:};
tmp = cellfun( 'isempty', regexp( cac, '\d{2}:\d{2}:\d{2}\s+C\s*$' ) );
isc = not( tmp );
tmp = cellfun( 'isempty', regexp( cac, '\d{2}:\d{2}:\d{2}\s+\*\*\s+----' ) );
iss = not( tmp );
cac( isc | iss ) = [];
str = transpose( char( cac ) );
nl = sprintf('\n');
str = cat( 1, str, repmat( nl(:), [length(nl),size(str,2)] ) );
cac = textscan( str, '%8c%2c%4f%7f%4c%4u%4u%4u+%2u' ...
, 'Delimiter', ' ', 'Whitespace', '' );
end
end
per isakson
on 4 Jul 2012
Your file at 4Share didn't cause problems to ReadSoniData.
plot(cac{3})
shows a peak at index just below 1000.
Soni huu
on 4 Jul 2012
per isakson
on 4 Jul 2012
Edited: per isakson
on 4 Jul 2012
You have to copy the code, which I recently provided in a comment above, to an m-file and save that as "SoniDataRead.m". And rename your sample data file to SoniData.dat. Do I need say that explicitely? Then try
>> cac = ReadSoniData( 'C:\matlab7\work\org', 'SoniData.dat' );
or you may call it "sonid", but you have to pass the input arguments, i.e
>> cac = sonid( 'C:\matlab7\work\org', 'SoniData.dat' );
per isakson
on 4 Jul 2012
Edited: per isakson
on 4 Jul 2012
"h:\m\cssm" is the name of a folder. "cssm.m" is the name of an m-file.
per isakson
on 4 Jul 2012
Try
>> which ReadSoniData -all
>> which sonid -all
Soni huu
on 4 Jul 2012
Soni huu
on 4 Jul 2012
per isakson
on 4 Jul 2012
Edited: per isakson
on 4 Jul 2012
The problem is, I cannot know what code is inside sonid.m. I strongly doubt that it is the code I provided in the comment above a couple of hours ago. The error message says "at 16", but textscan( str, ..) in my code is at line 25.
I believe you use the wrong code.
Matlab documentations says "C = textscan(str, ...) reads data from string str."
per isakson
on 4 Jul 2012
Sorry, "is at line 25" applies to my version, which has some blank lines.
However, it works here.
Soni huu
on 4 Jul 2012
per isakson
on 4 Jul 2012
I downloaded your file and renamed it to "ReadSoniData_2.m" and I changed the name of the function to "ReadSoniData_2". Then I run
>> clear all
>> cac = ReadSoniData_2( 'h:\m\cssm', '11-02-2011.dat' );
>> plot( cac{3})
It worked without problems. The value of the peak is 60 plus.
More Answers (1)
per isakson
on 4 Jul 2012
Edited: per isakson
on 4 Jul 2012
Next step, try:
>> dbstop ReadSoniData 2
>> cac = ReadSoniData( 'h:\m\cssm', '11-02-2011.dat' );
However, if you didn't watch Doug's video you might need to do that now. Then step through the code.
.
The data file, '11-02-2011.dat', shall be in your folder, 'C:\matlab7\work\org'.
You could add an assert to the file after "sad = dir(..."
sad = dir( fullfile( folder_spec, file ) );
assert( not( isempty( sad ) ) ...
, 'ReadSoniData:NoFileFound' ...
, 'Cannot find files matching "%s"' ...
, fullfile( folder_spec, file ) )
9 Comments
Soni huu
on 4 Jul 2012
Soni huu
on 4 Jul 2012
per isakson
on 4 Jul 2012
"MATLAB prior to MATLAB 7.0.4" that explains that problem.
per isakson
on 4 Jul 2012
Edited: per isakson
on 4 Jul 2012
Replace the line
cac = textscan( str, '%8c%2c%4f%7f%4c%4u%4u%4u+%2u' ...
, 'Delimiter', ' ', 'Whitespace', '' );
by
cac = cell(1,9);
[cac{:}] = strread( str, '%8c%2c%4f%7f%4c%4u%4u%4u+%2u' ...
, 'delimiter', ' ', 'whitespace', '' );
Note the lower-case letters in 'delimiter' and 'whitespace'
per isakson
on 4 Jul 2012
Edited: per isakson
on 4 Jul 2012
If
[cac{:}]
causes problems replace it by
[cac{1},cac{2},cac{3},cac{4},cac{5},cac{6},cac{7},cac{8},cac{9}]
Soni huu
on 4 Jul 2012
per isakson
on 4 Jul 2012
BE AWARE my first answer said "This is a start". The function we arrived at will only return the result of the last of the 30 files.
Soni huu
on 4 Jul 2012
per isakson
on 4 Jul 2012
Edited: per isakson
on 4 Jul 2012
Hint: In the for-loop you need to assign the result, which you want to keep to an appropriate variable and make that new variable the output argument.
Case closed!
Categories
Find more on Data Import and Export in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!
