python - Unicode Encode error when writing to CSV after scraping -

-

I am learning web scraping, and to practice, I get a table of baseball figures from Derek Jeter I am trying to scrape. Using the beautiful soup, I was able to extract it like a table: import from bs4 BeautifulSoup import urllib2 jeter = "http://www.baseball-reference.com/players/j / Jeterde01- bat.shtml "Page = urllib2.urlopen (jeter) soup = beautiful soup (page) table = soup.find ('table', id = 'batting_standard') #The list of header names tableheaders = table.find_all (' Th ') Header = [] I = 0 while i

table_rows ends with a list, where each element is another list representing each row of the table: 

  table_rows = [['a', 'b' , 'c'], when I try to write it in CSV using this code:  
 Import CSV  
  open ('/ home / russell / Desktop / python learning / web scraping / jeter.csv ',' wb ') Fp: a = csv.writer (fp) #write Header for CSV file: awriterow (headers) for e in table_ro: a.writerow (e)   
 I get the following error message :  
  Traceback (most recent call final): File "/ home / Russell / Document / Python Learning / Web Scrapping / jeter_scrape2.py", line 39, & lt; Module & gt; A.writerow (e) UnicodeEncodeError: The 'ascii' codec can not encode characters in position 4-5: not in serial number (128)   
 I'm new to all this , So the information you can provide will be greatly appreciated.  
 Note: I am using Python 2.7  
  Edit:   
 The line that is hanging it is :    " U'127, U'203 ', U'25', 'U' 8, U '19', 'U'84', 'U'30', 'You' 6, You '57', 'You' 11 ',' U ' 4.34, U '3 84, U'481', '864', 'U'127', 'You' 301, U'13 ',' You '5, You' 3 ', You' 3 ',' You '1 , U '6']   
 I assume that this is the first object slash? (U'1998 \ xa0 \ u2605 '). It is considered a year - 1998. The CSV writer can first process some lines, but it is hung on it. The problem is that the HTML table you are scraping has a U + 2605 black star. You can see it clearly on the front page of "1999". You can easily remove it to remove those bits from the first column:    table_rows for e: e [0] = e [0] .replace (u '\ xa0 \ U2605 ', u' ') a.writerow (e)   
 something like that

Comments

Post a Comment

Popular posts from this blog

php - PDO bindParam() fatal error -

-
I am trying to learn PDO, now I have written this small code, but it gives me a serious error: < P> Fatal error: Call a member function at a non-object dot () ... $ con = new mysqli ("127.0.0.1", "root", "", "csvdangercheck"); $ Query = $ con- & gt; ("Id,` var1`, `var2`) values ​​(" id,: var1,: var2) ";); $ query- & gt; bypass pattern (': id', $ id); $ query- & gt; BindParam (': var1', $ VAL1); $ Query- & gt; bindParam (': var2', $ val2); $ Query-> Executed (); I Trying to use print_r ($ con-> errorInfo ()) but Fatal error: Undefined method mysqli :: errorInfo ( ) ... can someone tell me what am I missing? Flaffeh said, you have PDO Missing Mysqy, try it: $ con = new PDO ('mysql: host = 127.0.0.1; dbname = csvdangercheck', 'root', '');
Read more

logging - How can I log both the Request.InputStream and Response.OutputStream traffic in my ASP.NET MVC3 Application for specific Actions? -

-
For a specific set of tasks, I need to log in to the incoming request inputstream as well as outgoing response. is. I am using an ActionFilterAttribute for this and overriding the OnActionExecuted and OnResultExecuted methods. So I'm starting with this idea ... Public category ActionLoggerAttribute: ActionFilterArrbit {Public Override Zero On-Offed Execution (ActionActioned Contact Filter Filter) {base.OnActionAxecuted (FilterContext); HttpRequestBase request = filterContext.HttpContext.Request; // TODO: Log the request. InputStream} Public Override Zero OnResultExecuted (ResultExecutedContext FilterContext) {base.OnResultExecuted (filterContext); HTTPRPSPointBase Response = FilterContacts Hpptex response; // TODO: Log on Response.OutputStream}} Ideally I'll hook it up with enterprise library logging because I'm already using it for error logging. Am I reaching the input and output stream at the right time? Can I easily use the Enterprise Library to log i
Read more

java - Why my included JSP file won't get processed correctly? -

-
I am trying to create Java web framework (and learning), and on the basis of 'Code Generator In the process of making the material view of the database in the process of development, I stumbled into a difficulty, which I do not know how to solve it. First of all, I want the following index.jsp : & lt; Body & gt; Use all pages to be created. & Lt;% @ include file = "header.jsp"% & gt; & Lt; Hours / & gt; & Lt;% @ included file = "body.jsp"%> & Lt; Hours / & gt; & Lt;% @ include file = "footer.jsp"% & gt; & Lt; / Body & gt; And, in body.jsp , I should have it like this: & lt; Jsp: include page = "$ {Application_modul}"%> Where application_modul is an attribute defined in its controller: request.setAttribute ("application_modul", "USER_ACCOUNT \\ ' View_user_account.jsp "); This file can be found properly, but the processed JSP does
Read more