Python 2.7 : Put extracted data from URL in a CSV file

Question

这是我第一次使用Python 2.7，我很喜欢它。但是，我试图弄清楚如何将从 URL 中提取的数据放入 CSV 文件中。我发现this tutorial ，但是当我运行我的脚本时:

# import libraries
import csv
import urllib2
from bs4 import BeautifulSoup

# specify the url
quote_page = 'http://www.bkfrem.dk/default.asp?id=19'

# query the website and return the html to the variable ‘page’
page = urllib2.urlopen(quote_page)

# parse the html using beautiful soup and store in variable soup
soup = BeautifulSoup(page, 'html.parser')

# create CSV file
csvfile = csv.writer(open('firsteam.csv', 'w'))
csvfile.writerow(["Name", "Position"])

# take out the <div> of name and get its value
items = soup.find_all('div', attrs={'class': 'visTruppenContainer'})

for i in range(len(items)):

    playerInfo = items[i].getText(separator=u' ')
    imageURL = items[1].find('img')['src']
    csvfile.writerow([playerInfo, imageURL])
    print (playerInfo)
    print (imageURL)

我收到此错误:

Traceback (most recent call last):
  File "C:/Users/User/Desktop/script2.py", line 26, in <module>
    csvfile.writerow([playerInfo, imageURL])
UnicodeEncodeError: 'ascii' codec can't encode character u'\xe5' in position 27: ordinal not in range(128)

我做错了什么？在写入 CSV 文件之前是否必须转换数据？

Answer 1

您需要对 playerInfo 进行编码，如下所示:

代码:

csvfile.writerow([playerInfo.encode('utf-8'), imageURL])

结果:

1. Marco Brylov Position: Målmand Højde: 191 Vægt: 92 Født: 21-11-1995
http://www.bkfrem.dk/images/spillere/02_mikkel_andersson.jpg
2. Mikkel Andersson Position: Midtbane Højde: 170 Vægt: 67 Født: 17-03-1990
http://www.bkfrem.dk/images/spillere/02_mikkel_andersson.jpg
3. Casper Andersen Position: Midtstopper Højde: 190 Vægt: 90 Født: 04-08-1982
http://www.bkfrem.dk/images/spillere/02_mikkel_andersson.jpg
...