linux - Speed-up Bash ID3 to MySQL import -

-

I have 2 Bash scripts that go through a directory, extract ID3 information for MP3 and they Import tag information into a MySQL DB It takes a lot of time to complete the walk, so I was hoping someone could help me make the script more efficient.

The scripts are as follows:

makeid3dbentry.sh 

  track = $ (id3info "$ 1" | grep '^ === TIT2' sed -e 's /.*: // g') ARTIST = $ (id3info "$ 1" | grep '^ === TPE1' | sed -e 's /.*: //g') ALBUM = $ ( Id3info "$ 1" | grep '^ === TALB' | sed -e 's /.*: //g') ALBUMARTIST = $ (id3info "$ 1" | grep '^ === TPE2' | sed - e 's /.*: // g') COLS = '`artist``,` name`, `album`,`' $$ {ARTIST // \ "/ \\\"} '', '' $ To avoid {TRACK / '$'}, avoid $ {string // substrings / replace} "VALS = '" / \ "/ \\\"}' "" '$ {album // \ "/ \\ \ "} '" "' $ {ALBUMARTIST // \" / \\\ "} '" "' $ {1} '' SETLIST = '` artist` = "' $$ ARTIST // \" / \\ \ "} '',` Name` = "'$ {track //" / \\\ "}' ',` album` = "' $ {album // \" / \\\ "} '',` Albumartist` = "'$ {ALBUMARTIST / '' $ '', '' '' $ {SETLIST} '' '' ('$ {COLS}') values' ('$ {VALS}' } ') In' echo 'INSERT;'   
 This produces an INSERT statement such as  
  `music` in INSERT (` artist`, `name`,` album`, 'album artist '' File name ') value ("1200 microgram", "ayahuosa", "1200 microgram", "1200 microgram", "/ mnt / shared media / music / album / 1200 microgram / 1200 micrograms [2002] / 1-01 -1200 microgram - "1200 microgram", `Albertast '=" 1200 microgram ",` filename` = "- 1200 microgram", `name` =" ayahuska "," album "/ mnt / share Video / Audio / 1200 microgram / 1200 microgram [2002] / 1-01 - 1200 microgram - Ayahuska MP3 ";   
 Main update script:  
 UpdateMusicdb.sh    DIRFULLPATH = "$ {1}" DIRECTORY = $ (BaseName "$ {DIRFULLPATH}") SQLFILE = "/ var / www / html / scripts / sql / rebuilddb_ $" {DIRECTORY} .sql "find" $ {DIRFULLPATH} "-type F -iname" * .mp3 "-exec /var/www/html/scripts/bash/makeid3dbentry.sh {} & gt;" $ {SQLFILE} " \; mysql --defts- Additional file = / var / www / html / config / website.cnf --default-cHunner-set = UTF8 "website" & lt; "$ {SQLFILE}"   
 Unfortunately I'm bash & amp; To see the Linux environment as well as where the obstacles are and how to improve these scripts. I appreciate any suggestions on improving scripts or on a different perspective if this is better / faster.   
 
 
 You already have a comment as a suggestion in the  id3info  Avoid walking times.  
 You can find  makeid3dbentry.sh  also for a file in a simple  "$ {@}"  around your code.  with  -exec yourcript.sh {} +  (works like xargs). This way you can greatly reduce the number of invitations to your script. I would probably recommend doing this whole thing as a script, however, you wrap the insert statement for loop in your  Find  command (without  -exec  parameter) And can pipe this output into the file.  
 Your MySQL database believes that you are using INODB, until the work is completed (on each insert)  start transactions at the top of your code ;  insert and below  COMMIT;  View,

Comments

Post a Comment

Popular posts from this blog

php - PDO bindParam() fatal error -

-
I am trying to learn PDO, now I have written this small code, but it gives me a serious error: < P> Fatal error: Call a member function at a non-object dot () ... $ con = new mysqli ("127.0.0.1", "root", "", "csvdangercheck"); $ Query = $ con- & gt; ("Id,` var1`, `var2`) values ​​(" id,: var1,: var2) ";); $ query- & gt; bypass pattern (': id', $ id); $ query- & gt; BindParam (': var1', $ VAL1); $ Query- & gt; bindParam (': var2', $ val2); $ Query-> Executed (); I Trying to use print_r ($ con-> errorInfo ()) but Fatal error: Undefined method mysqli :: errorInfo ( ) ... can someone tell me what am I missing? Flaffeh said, you have PDO Missing Mysqy, try it: $ con = new PDO ('mysql: host = 127.0.0.1; dbname = csvdangercheck', 'root', '');
Read more

logging - How can I log both the Request.InputStream and Response.OutputStream traffic in my ASP.NET MVC3 Application for specific Actions? -

-
For a specific set of tasks, I need to log in to the incoming request inputstream as well as outgoing response. is. I am using an ActionFilterAttribute for this and overriding the OnActionExecuted and OnResultExecuted methods. So I'm starting with this idea ... Public category ActionLoggerAttribute: ActionFilterArrbit {Public Override Zero On-Offed Execution (ActionActioned Contact Filter Filter) {base.OnActionAxecuted (FilterContext); HttpRequestBase request = filterContext.HttpContext.Request; // TODO: Log the request. InputStream} Public Override Zero OnResultExecuted (ResultExecutedContext FilterContext) {base.OnResultExecuted (filterContext); HTTPRPSPointBase Response = FilterContacts Hpptex response; // TODO: Log on Response.OutputStream}} Ideally I'll hook it up with enterprise library logging because I'm already using it for error logging. Am I reaching the input and output stream at the right time? Can I easily use the Enterprise Library to log i
Read more

java - Why my included JSP file won't get processed correctly? -

-
I am trying to create Java web framework (and learning), and on the basis of 'Code Generator In the process of making the material view of the database in the process of development, I stumbled into a difficulty, which I do not know how to solve it. First of all, I want the following index.jsp : & lt; Body & gt; Use all pages to be created. & Lt;% @ include file = "header.jsp"% & gt; & Lt; Hours / & gt; & Lt;% @ included file = "body.jsp"%> & Lt; Hours / & gt; & Lt;% @ include file = "footer.jsp"% & gt; & Lt; / Body & gt; And, in body.jsp , I should have it like this: & lt; Jsp: include page = "$ {Application_modul}"%> Where application_modul is an attribute defined in its controller: request.setAttribute ("application_modul", "USER_ACCOUNT \\ ' View_user_account.jsp "); This file can be found properly, but the processed JSP does
Read more