How to Text Scan and remove columns full of zeros?
    7 views (last 30 days)
  
       Show older comments
    
    Ibro Tutic
      
 on 15 May 2017
  
    
    
    
    
    Answered: Andrei Bobrov
      
      
 on 15 May 2017
            I am scanning in large data sets and many of them have multiple fields that don't have data (recorded as 0). How would I use text scan to get the data into Matlab and remove any columns with 0s and move all columns over to not leave empty space in the resulting array? I attached a sample text file (tab delimited). The columns with zeros are not always the same, I need to somehow dynamically figure out which columns have 0s and remove them (the entire column needs to be removed, including the header)
0 Comments
Accepted Answer
  Cam Salzberger
      
 on 15 May 2017
        Hello Ibro,
I'd highly recommend "readtable" over "textscan" in this case. This will also allow you to keep track of which columns are which, since tables keep header names. Otherwise, how would you know which columns were removed, and what are the columns that are left?
T = readtable('sample.txt');
for k = size(T,2):-1:1
    if ~any(T{:,k})
        T(:,k) = [];
    end
end
I went backwards so that if I removed a variable, it wouldn't skip checking the next one, or require weird while loop syntax. There are other ways to access the different variables in a table, but this was one of the easiest to do while in a loop.
-Cam
More Answers (1)
See Also
Categories
				Find more on Tables in Help Center and File Exchange
			
	Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!