python - 将压缩的 Stata 文件从 URL 读取到 pandas 中

Question

是否可以从 URL 读取仅包含 .dta 文件的 .zip 文件？

例如，https://www.federalreserve.gov/econres/files/scfp2016s.zip包含一个文件:rscfp2016.dta，但是 pandas.read_stata不起作用:

import pandas as pd
pd.read_stata('https://www.federalreserve.gov/econres/files/scfp2016s.zip')

ValueError: Version of given Stata file is not 104, 105, 108, 111 (Stata 7SE), 113 (Stata 8/9), 114 (Stata 10/11), 115 (Stata 12), 117 (Stata 13), or 118 (Stata 14)

read_csv如果 zip 仅包含 csv，则支持通过 compression 参数读取压缩文件，该参数默认推断压缩。 read_stata 缺少此选项。

我可以通过下载并解压缩文件，然后阅读它来完成此操作，但这很困惑。

!wget https://www.federalreserve.gov/econres/files/scfp2016s.zip
!unzip scfp2016s.zip
df = pd.read_stata('rscfp2016.dta')

还有什么更好的办法吗？

Answer 1

read_stata 接受类文件对象，因此您可以执行以下操作:

import pandas as pd
from io import BytesIO
from zipfile import ZipFile
from urllib.request import urlopen

url = 'https://www.federalreserve.gov/econres/files/scfp2016s.zip'
with urlopen(url) as request:
    data = BytesIO(request.read())

with ZipFile(data) as archive:
    with archive.open(archive.namelist()[0]) as stata:
        df = pd.read_stata(stata)