python - 如何在Python3.6和CentOs上安装Twisted + Scrapy

标签 python scrapy twisted

我在 Centos 7 上使用最新的 Python 和专用的 virtualenv

(ENV) [luoc@study ~ ]$ lsb_release -a
LSB Version:    :core-4.1-amd64:core-4.1-noarch:cxx-4.1-amd64:cxx-4.1-noarch:desktop-4.1-amd64:desktop-4.1-noarch:languages-4.1-amd64:languages-4.1-noarch:printing-4.1-amd64:printing-4.1-noarch
Distributor ID: CentOS
Description:    CentOS Linux release 7.3.1611 (Core) 
Release:    7.3.1611
Codename:   Core

(ENV) [luoc@study ~ ]$ python --version
Python 3.6.0

我安装scrapy的时候报错

(ENV) [luoc@study ~ ]$ pip install scrapy
Collecting scrapy
  Using cached Scrapy-1.3.2-py2.py3-none-any.whl
Collecting cssselect>=0.9 (from scrapy)
  Using cached cssselect-1.0.1-py2.py3-none-any.whl
Requirement already satisfied: six>=1.5.2 in ./ENV/lib/python3.6/site-packages (from scrapy)
Collecting Twisted>=13.1.0 (from scrapy)
  Could not find a version that satisfies the requirement Twisted>=13.1.0 (from scrapy) (from versions: )
No matching distribution found for Twisted>=13.1.0 (from scrapy)

当我安装twis​​ted independence时,报错

(ENV) [luoc@study ~ ]$ pip install Twisted
Collecting Twisted
  Could not find a version that satisfies the requirement Twisted (from versions: )
No matching distribution found for Twisted

(ENV) [luoc@study ~ ]$ pip install --verbose Twisted
Collecting Twisted
  1 location(s) to search for versions of Twisted:
  * https://pypi.python.org/simple/twisted/
  Getting page https://pypi.python.org/simple/twisted/
  Looking up "https://pypi.python.org/simple/twisted/" in the cache
  Current age based on date: 40208
  Freshness lifetime from max-age: 600
  Freshness lifetime from request max-age: 600
  The cached response is "stale" with no etag, purging
  Starting new HTTPS connection (1): pypi.python.org
  "GET /simple/twisted/ HTTP/1.1" 200 10196
  Updating cache with response from "https://pypi.python.org/simple/twisted/"
  Caching b/c date exists and max-age > 0
  Analyzing links from page https://pypi.python.org/simple/twisted/
Skipping link ...
Could not find a version that satisfies the requirement Twisted (from versions: )
Cleaning up...
No matching distribution found for Twisted
Exception information:
Traceback (most recent call last):
  File "/home/luoc/ENV/lib/python3.6/site-packages/pip/basecommand.py", line 215, in main
    status = self.run(options, args)
  File "/home/luoc/ENV/lib/python3.6/site-packages/pip/commands/install.py", line 335, in run
    wb.build(autobuilding=True)
  File "/home/luoc/ENV/lib/python3.6/site-packages/pip/wheel.py", line 749, in build
    self.requirement_set.prepare_files(self.finder)
  File "/home/luoc/ENV/lib/python3.6/site-packages/pip/req/req_set.py", line 380, in prepare_files
    ignore_dependencies=self.ignore_dependencies))
  File "/home/luoc/ENV/lib/python3.6/site-packages/pip/req/req_set.py", line 554, in _prepare_file
    require_hashes
  File "/home/luoc/ENV/lib/python3.6/site-packages/pip/req/req_install.py", line 278, in populate_link
    self.link = finder.find_requirement(self, upgrade)
  File "/home/luoc/ENV/lib/python3.6/site-packages/pip/index.py", line 514, in find_requirement
    'No matching distribution found for %s' % req
pip.exceptions.DistributionNotFound: No matching distribution found for Twisted

那么为什么不能在Python3.6上安装Twisted呢?我的环境有问题吗?

Kmike suggested me to ask twisted's developer

最佳答案

我知道问题已经解决了,但我想帮助 future 的用户。
我在 Debian Strech 上,刚刚安装了 Python 3.6,
如果你想自己安装scrapy编译Python 3.6,试试运行

sudo apt-get install bzip2 libbz2-dev

之后,只需重新编译 Python 3.6 就可以了

关于python - 如何在Python3.6和CentOs上安装Twisted + Scrapy,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/42230070/

相关文章:

python - 如何计算与 Python 中性能最佳的 p 值的相关性?

python - 判断点击事件中是哪个椭圆

python - 尝试将列表项添加到 tkinter 中的文本框

python - 如何删除特殊字符并删除字符之间的空格?

python - 类似字典的对象,没有 __getitem__、__setitem__

python - Scrapy代理ip不适用于https,返回 'ssl handshake failure'

python - 在 Python Pandas 中查找 ID 的最小值、最大值和平均值

css - 当没有元素时,是否可以使用 CSS 选择器在列表中获取空字符串?

python - Scrapy - 蜘蛛爬取重复的网址

python - 如何在python中控制子线程进程?