Python: split a large text file by many headers -

-

I have a large text file, which looks like this: 

  latitude height Pressure 3 lines data group BSAS 2.3 4.5 45.0 875 5.6 6.5 46.2 676 3.4 3.4 48.2 565 6 Line data group SDAD 3.4 4.5 56.1 535 5.6 6.5 46.2 676 3.4 4.5 56.1 535 2.3 4.5 45.0 875 5.6 6.5 46.2 676 3.4 3.4 48.2 565 50 Line Data group asdasd 5.5 6.6 44.5 343 ... 3.7 8.4 56.5 456 ... and so on   
 I want to split the whole text file to isolate the data group, every data The group is stored in 2D Or the array. So far, I have tried two ways to do this.  
 The first route is going through each line and thus the data is being obtained:  
  # Objects define the object class called the wave # There are 4 attributes in each object: latitude, loan, height, pressure wave_list = [] with Open (file name, 'R') as F: except the next (F) # headline wave = wave (), enumerate In line (f): If 'data' is in line: If the wave is not empty: wave_list.append (wave) Every = wave () and: wave.lat.append (line.split () [0]) wave.lon.append (Line.split () [1]) wave.altitude.append (line.split () [2] ] Wave.pressure.append (line.split () [3]) wave_list.append (wave) return wave_list   
 The second method is using numpy loadtext:  
  f = open (filename, 'r') txt = f.read () # "Data" is divided by first element raw_chunks = txt.split ("data") [1:] # results Define a new list to store wave_list = [] # raw_chunks go through each part for RC: # "\ n" first_id = rc.find ("\ n") # "\ n" last_id Last index Lit = Rc.rfind = ""] = Trngklanl data. [1] WaveRetected = Data. [2] wave Pressure = data [3] wave_list.width wave wave list   
 However, both approaches are very slow, I have a look at pondo documentation but can not find the way to avoid headers in the middle of the file Could. I also look at various questions for examples:  
  
  
  
 But none of them solves my problem There is no faster way to read such a text file. Thank you in advance.   
 
 
  & lt; Number & gt; ( & lt; something & gt; ) and the number of lines to read ( & lt; numbers & gt; ) & lt; Some & gt;     
  
 
 
  
 Code> Import imports from imports of imports imports of the default decode Re-Data = With the default dict (list) Feather as the open (file name): Header = Next (wings, '') .split () for line in fin: m = re.match R '(\ d + ) Line. * (\ B \ w +) $ ', line) If I: Data [m.group (2)]. Detail (Islice (wings, int (m.group (1))))   
 Looking at:    upper latitudes 3 lines of data Group BSAS 2.3 4.5 45.0 875 5.6 6.5 46.2 676 3.4 3.4 48.2 565 6 Line Data Group Sdad 3.4 4.5 56.1 535 5.6 6.5 46.2 676 3.4 4.5 56.1 535 2.3 4.5 45.0 875 5.6 6.5 46.2 676 3.4 3.4 48.2 565   
 gives you the  data  like this:  
  {'bsas': ['2.3 4.5 45.0 875 \ n', '5.6 6.5 46.2 676 \ n' , '3.4 3.4 48.2 565 \ n'], 'sdad': ['3.4 4.5 56.1 535 \ n', '5.6 6.5 46.2 676 \ n', '3.4 4.5 56.1 535 \ n', '2.3 4.5 45.0 875 \ n ',' 5.6 6.5 46.2 676 \ n ',' 3.4 3.4 48.2 565 \ n ']}   
 For your comments, if "group" is unimportant Land, then:  
  fin as data = [] with open (filename): Header = Next (wings, ''). For the row in the wings. (): I = re If I: Data .append (list (Islice (wings, int (m.group (1)))) <('\') / Code>

Comments

Post a Comment

Popular posts from this blog

php - PDO bindParam() fatal error -

-
I am trying to learn PDO, now I have written this small code, but it gives me a serious error: < P> Fatal error: Call a member function at a non-object dot () ... $ con = new mysqli ("127.0.0.1", "root", "", "csvdangercheck"); $ Query = $ con- & gt; ("Id,` var1`, `var2`) values ​​(" id,: var1,: var2) ";); $ query- & gt; bypass pattern (': id', $ id); $ query- & gt; BindParam (': var1', $ VAL1); $ Query- & gt; bindParam (': var2', $ val2); $ Query-> Executed (); I Trying to use print_r ($ con-> errorInfo ()) but Fatal error: Undefined method mysqli :: errorInfo ( ) ... can someone tell me what am I missing? Flaffeh said, you have PDO Missing Mysqy, try it: $ con = new PDO ('mysql: host = 127.0.0.1; dbname = csvdangercheck', 'root', '');
Read more

logging - How can I log both the Request.InputStream and Response.OutputStream traffic in my ASP.NET MVC3 Application for specific Actions? -

-
For a specific set of tasks, I need to log in to the incoming request inputstream as well as outgoing response. is. I am using an ActionFilterAttribute for this and overriding the OnActionExecuted and OnResultExecuted methods. So I'm starting with this idea ... Public category ActionLoggerAttribute: ActionFilterArrbit {Public Override Zero On-Offed Execution (ActionActioned Contact Filter Filter) {base.OnActionAxecuted (FilterContext); HttpRequestBase request = filterContext.HttpContext.Request; // TODO: Log the request. InputStream} Public Override Zero OnResultExecuted (ResultExecutedContext FilterContext) {base.OnResultExecuted (filterContext); HTTPRPSPointBase Response = FilterContacts Hpptex response; // TODO: Log on Response.OutputStream}} Ideally I'll hook it up with enterprise library logging because I'm already using it for error logging. Am I reaching the input and output stream at the right time? Can I easily use the Enterprise Library to log i
Read more

java - Why my included JSP file won't get processed correctly? -

-
I am trying to create Java web framework (and learning), and on the basis of 'Code Generator In the process of making the material view of the database in the process of development, I stumbled into a difficulty, which I do not know how to solve it. First of all, I want the following index.jsp : & lt; Body & gt; Use all pages to be created. & Lt;% @ include file = "header.jsp"% & gt; & Lt; Hours / & gt; & Lt;% @ included file = "body.jsp"%> & Lt; Hours / & gt; & Lt;% @ include file = "footer.jsp"% & gt; & Lt; / Body & gt; And, in body.jsp , I should have it like this: & lt; Jsp: include page = "$ {Application_modul}"%> Where application_modul is an attribute defined in its controller: request.setAttribute ("application_modul", "USER_ACCOUNT \\ ' View_user_account.jsp "); This file can be found properly, but the processed JSP does
Read more