regex - R: Fast string split on first delimiter occurence -

-

I have a file with ~ 40 million lines that I need to split by the first comma delimiter. Using the

stringr function str_split_fixed does the following, but it is very slow. 

  Library (Dataable) Library (stringer) Df1 & lt; - data.frame (id = 1: 1000, letter 1 = representative (letter [sample (1: 25,1000, substituted = t)], 40)) df1 $ combCol1 & lt; - paste (df1 $ id, ', df1 $ letter1 September =' ') DF1 $ combCol2 & lt; - Paste ($ combCol1 DF1, ',', DF1 $ combCol1 September = '') st1 & lt; - str_split_fixed ($ combCol2 DF1, ',', 2)   
 Is there a faster way to do this? 
 updates  
  stri_split_fixed in more recent versions of   
 
 "Stringi" The  function has a  simplified  argument which will be the  TRUE  to return a matrix, thus the update solution will be:  
  Original answer (with updated benchmark)  
 If you click on " Stringer "are resting with syntax and do not want to be a hero from far away, If you want to profit even by increasing the speed, instead of the "string" package:  
  Library (stringer) library (string) system.time (temp1) - str_split_fixed (df1 $ combCol2 , ',', 2)) # User system elapsed # 3.25 0.00 3.25 system.time stri_split_fixed (DF1 $ combCol2, -; - (temp2a & lt do.call (rbind, stri_split_fixed (DF1 $ combCol2, "", 2 )) # User System # 0.04 0.00 0.05 system.time (temp2b go and execute ",", 2, simplify = TRUE) # User System Elapsed # 0.01 0.00 0.01   
 Most " "Stringing" functions in "string" functions Ntaan, but as it can be seen, for example, "string" output requires an additional step to bind data to output as a matrix instead of a list.  
 
 Here's the comparison with @ RichardScriven's suggestion in this comment:  
  fun1a & lt; - Function () do.call (rbind, stri_split_fixed (DF1 $ combCol2, "", 2)) fun1b & LT; - Function () stri_split_fixed (, DF1 $ combCol2, "" 2, easy making = TRUE) fun2 & lt; - Function () {do.call (rbind, regmatches ($ combCol2, regexpr (DF1 ",", DF1 $ combCol2) ,,, invert = TRUE)}} library (microbenchmark) microbenchmark (fun1a) fun1b () fun2 ), Bar = 10) # Unit: millisecond # expr min LQ Mean median uq max neval # fun1a () 4272647 46,35848 59,56948 51,94796 629.2920 9 8.46330 10 # fun1b () 17,55183 18 , 59337 20,09049 18,84907 22,09419 26,85343 10 # fun2 () 370,82055 404,23115 434,62582 439,54923 476,02889 480,97912 10

Comments

Post a Comment

Popular posts from this blog

php - PDO bindParam() fatal error -

-
I am trying to learn PDO, now I have written this small code, but it gives me a serious error: < P> Fatal error: Call a member function at a non-object dot () ... $ con = new mysqli ("127.0.0.1", "root", "", "csvdangercheck"); $ Query = $ con- & gt; ("Id,` var1`, `var2`) values ​​(" id,: var1,: var2) ";); $ query- & gt; bypass pattern (': id', $ id); $ query- & gt; BindParam (': var1', $ VAL1); $ Query- & gt; bindParam (': var2', $ val2); $ Query-> Executed (); I Trying to use print_r ($ con-> errorInfo ()) but Fatal error: Undefined method mysqli :: errorInfo ( ) ... can someone tell me what am I missing? Flaffeh said, you have PDO Missing Mysqy, try it: $ con = new PDO ('mysql: host = 127.0.0.1; dbname = csvdangercheck', 'root', '');
Read more

logging - How can I log both the Request.InputStream and Response.OutputStream traffic in my ASP.NET MVC3 Application for specific Actions? -

-
For a specific set of tasks, I need to log in to the incoming request inputstream as well as outgoing response. is. I am using an ActionFilterAttribute for this and overriding the OnActionExecuted and OnResultExecuted methods. So I'm starting with this idea ... Public category ActionLoggerAttribute: ActionFilterArrbit {Public Override Zero On-Offed Execution (ActionActioned Contact Filter Filter) {base.OnActionAxecuted (FilterContext); HttpRequestBase request = filterContext.HttpContext.Request; // TODO: Log the request. InputStream} Public Override Zero OnResultExecuted (ResultExecutedContext FilterContext) {base.OnResultExecuted (filterContext); HTTPRPSPointBase Response = FilterContacts Hpptex response; // TODO: Log on Response.OutputStream}} Ideally I'll hook it up with enterprise library logging because I'm already using it for error logging. Am I reaching the input and output stream at the right time? Can I easily use the Enterprise Library to log i
Read more

java - Why my included JSP file won't get processed correctly? -

-
I am trying to create Java web framework (and learning), and on the basis of 'Code Generator In the process of making the material view of the database in the process of development, I stumbled into a difficulty, which I do not know how to solve it. First of all, I want the following index.jsp : & lt; Body & gt; Use all pages to be created. & Lt;% @ include file = "header.jsp"% & gt; & Lt; Hours / & gt; & Lt;% @ included file = "body.jsp"%> & Lt; Hours / & gt; & Lt;% @ include file = "footer.jsp"% & gt; & Lt; / Body & gt; And, in body.jsp , I should have it like this: & lt; Jsp: include page = "$ {Application_modul}"%> Where application_modul is an attribute defined in its controller: request.setAttribute ("application_modul", "USER_ACCOUNT \\ ' View_user_account.jsp "); This file can be found properly, but the processed JSP does
Read more