我正在尝试为一个受欢迎的汽车网站构建一个快速抓取工具。我可以返回一辆车的结果,但我不知道如何返回页面上的所有汽车。 findAll()
抛出错误。任何帮助将不胜感激
from bs4 import BeautifulSoup
import requests
#search = input('Enter car to search: ')
url = 'https://www.donedeal.ie/cars?words=bmw' #+ search
site = requests.get(url)
page = site.content
soup = BeautifulSoup(page, 'html.parser')
print("URL: ", site.url)
if site.status_code == 200:
print("HTTP Status: ", site.status_code, "\n")
else:
print("Bad HTTP response", "\n")
cars = soup.find('div', attrs={'class': 'top-info'})
county = soup.find('span', attrs={'class': 'county-disp icon-pin'})
span = cars.find('span')
for result in span:
for result2 in county:
print(result, "-", result2)
最佳答案
我不确定您要提取哪些信息。假设您想要汽车类型和县信息,findAll()
的工作原理如下:
>>> cars = soup.findAll('div', attrs={'class': 'top-info'})
>>> for car in cars:
... loc = car.find('span', attrs={'class': 'county-disp icon-pin'})
... if loc:
... print('type:', car.text, 'location:', loc.text)
... else:
... print('type:', car.text)
type: Bmw 320 CdTipperary location: Tipperary
type: Bmw 520d MsportDonegal location: Donegal
type: BMW2004
type: BMW2010
type: Bmw2010
type: Bmw2000
type: Bmw2001
type: Bmw2004
type: Bmw2004
type: bmw2003
type: BMW2009
type: Bmw2010
type: Bmw1990
type: BMW2004
type: BMW2012
type: Bmw2000
type: bmw2001
type: BMW2004
type: BMW2008
type: BMW2005
type: Bmw2006
type: Bmw2002
type: BMW2004
type: Bmw2000
type: BMW2003
type: BMW2011
type: BMW2001
type: Bmw2000
type: Bmw2002
type: BMW2007
请注意,仅适用于一页。您将必须执行其他页面的网址。
关于python - 迭代页面元素 beautifulsoup,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/36421119/