我正在尝试自动登录此页面 http://portal.globaltransit.net/问题是当您第一次到达页面时页面返回 401 header 但不显示标准的基本 http 身份验证页面而不是 http 表单。这是 curl -vvv http://portal.globaltransit.net/
* About to connect() to portal.globaltransit.net port 80 (#0)
* Trying 124.158.236.65... connected
* Connected to portal.globaltransit.net (124.158.236.65) port 80 (#0)
> GET / HTTP/1.1
> User-Agent: curl/7.19.7 (i486-pc-linux-gnu) libcurl/7.19.7 OpenSSL/0.9.8k zlib/1.2.3.3 libidn/1.15
> Host: portal.globaltransit.net
> Accept: */*
>
< HTTP/1.1 401 Unauthorized
< Date: Thu, 14 Nov 2013 07:18:06 GMT
< Server: Apache
< X-Powered-By: PHP/5.2.11
< Set-Cookie: symfony=1960d9b76a5f9fc3b00786e126cc69af; path=/
< Content-Length: 1211
< Content-Type: text/html; charset=utf-8
<
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title></title>
<link rel="shortcut icon" href="/favicon.ico" />
<link rel="stylesheet" type="text/css" media="screen" href="/css/main.css" />
</head>
<body>
<form action="/login" method="post">
<table>
<tr>
<th><label for="signin_username">Username</label></th>
<td><input type="text" name="signin[username]" id="signin_username" /></td>
</tr>
<tr>
<th><label for="signin_password">Password</label></th>
<td><input type="password" name="signin[password]" id="signin_password" /></td>
</tr>
<tr>
<th><label for="signin_remember">Remember</label></th>
<td><input type="checkbox" name="signin[remember]" id="signin_remember" /><input type="hidden" name="signin[_csrf_token]" value="6bdf80ca900038ada394467752593135" id="signin__csrf_token" /></td>
</tr>
</table>
<input type="submit" value="sign in" />
<a href="/request_password">Forgot your password?</a>
</form>
</body>
</html>
当我尝试使用 machanize 通过以下脚本加载页面时
import mechanize
import mimetypes
import logging
import urllib2
from urlparse import urlparse
import cookielib
from base64 import b64encode
class Browser:
def __init__(self, url):
br = mechanize.Browser()
br.set_handle_robots(False) # no robots
br.set_handle_refresh(False)
br.set_handle_redirect(True)
br.set_debug_http(True)
cj = cookielib.LWPCookieJar()
br.set_cookiejar(cj) # can sometimes hang without this
br.addheaders = [('User-agent', 'Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.1) Gecko/2008071615 Fedora/3.0.1-1.fc9 Firefox/3.0.1')]
self.page = br.open(url).read()
print self.page
if __name__ == '__main__':
browser = Browser("http://portal.globaltransit.net/")
我收到以下错误 mechanize._response.httperror_seek_wrapper: HTTP Error 401: Unauthorized。我想知道是否有任何方法可以让 Mechanize 忽略服务器返回的 401，以便我可以处理表单。
最佳答案
我想你可以这样做:
try:
response = mechanize.urlopen("http://portal.globaltransit.net/")
except mechanize.HTTPError, response:
pass
body = response.read()
#Do stuff with the form in the response body
关于python - 使用 Mechanize 处理非标准 401 header ，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/19973984/