mysql - Magento importing customers(700k) using csv dataflow is too slow -

-

I am creating a Magento eCommerce website, and importing client profiles from the old profile. I am using CSV Importer, and this process is slower than my imagination takes only about 4 seconds for a customer. So far the process is running for 6+ hours and only 30k customers have been imported. CSV file is divided into several ~ 10M short

For now, I am using Amazon Web Services EC2 (Micro) for development server in it's 1 vCPU (2.5GHz) And 1 GB memory but I do not think this may be an issue, I've increased the PHP memory limit for 1G

I've read an article, which states that Magnets' EAV database system and Import due to heavy PHP API module This speed of products with a lot is very common [] It is said that Magento sends 450 MySQL queries to import a single product. I have also seen an alternative solution using [] that tries to bypass the Magento API and insert the data directly into the MySQL table. Although AFAIK does not import it to customers, but only products and categories I do not know whether they (products and customers) are using the same mechanism.

I have disabled caching management and set the option of managing the index for manual updates. Although client profiles do not actually use these processes.

Do you have any suggestions for speeding up this CSV import? [/ Compliance]

I found one of the problem sources, Amazon EC2 T2 examples, they use CPU credit to control maximum CPU usage. For subtle examples, base CPU performance is limited to 10% of its capacity. I used all the CPU credit, and the server did not allow me to use the full CPU.

I just checked the performance of importing, and it is importing about 2 records per second. I think it's still very slow, so I'll wait for any other solution. Maybe optimization?

Forget about Maggie, forget about the dataflow. This is the best practice magento way ...

Use this one:

You can use any array to import entities product And customers .

Comments

Post a Comment

Popular posts from this blog

php - PDO bindParam() fatal error -

-
I am trying to learn PDO, now I have written this small code, but it gives me a serious error: < P> Fatal error: Call a member function at a non-object dot () ... $ con = new mysqli ("127.0.0.1", "root", "", "csvdangercheck"); $ Query = $ con- & gt; ("Id,` var1`, `var2`) values ​​(" id,: var1,: var2) ";); $ query- & gt; bypass pattern (': id', $ id); $ query- & gt; BindParam (': var1', $ VAL1); $ Query- & gt; bindParam (': var2', $ val2); $ Query-> Executed (); I Trying to use print_r ($ con-> errorInfo ()) but Fatal error: Undefined method mysqli :: errorInfo ( ) ... can someone tell me what am I missing? Flaffeh said, you have PDO Missing Mysqy, try it: $ con = new PDO ('mysql: host = 127.0.0.1; dbname = csvdangercheck', 'root', '');
Read more

logging - How can I log both the Request.InputStream and Response.OutputStream traffic in my ASP.NET MVC3 Application for specific Actions? -

-
For a specific set of tasks, I need to log in to the incoming request inputstream as well as outgoing response. is. I am using an ActionFilterAttribute for this and overriding the OnActionExecuted and OnResultExecuted methods. So I'm starting with this idea ... Public category ActionLoggerAttribute: ActionFilterArrbit {Public Override Zero On-Offed Execution (ActionActioned Contact Filter Filter) {base.OnActionAxecuted (FilterContext); HttpRequestBase request = filterContext.HttpContext.Request; // TODO: Log the request. InputStream} Public Override Zero OnResultExecuted (ResultExecutedContext FilterContext) {base.OnResultExecuted (filterContext); HTTPRPSPointBase Response = FilterContacts Hpptex response; // TODO: Log on Response.OutputStream}} Ideally I'll hook it up with enterprise library logging because I'm already using it for error logging. Am I reaching the input and output stream at the right time? Can I easily use the Enterprise Library to log i
Read more

java - Why my included JSP file won't get processed correctly? -

-
I am trying to create Java web framework (and learning), and on the basis of 'Code Generator In the process of making the material view of the database in the process of development, I stumbled into a difficulty, which I do not know how to solve it. First of all, I want the following index.jsp : & lt; Body & gt; Use all pages to be created. & Lt;% @ include file = "header.jsp"% & gt; & Lt; Hours / & gt; & Lt;% @ included file = "body.jsp"%> & Lt; Hours / & gt; & Lt;% @ include file = "footer.jsp"% & gt; & Lt; / Body & gt; And, in body.jsp , I should have it like this: & lt; Jsp: include page = "$ {Application_modul}"%> Where application_modul is an attribute defined in its controller: request.setAttribute ("application_modul", "USER_ACCOUNT \\ ' View_user_account.jsp "); This file can be found properly, but the processed JSP does
Read more