iterator - Python 3.6 : async version of islice?

标签 iterator python-itertools python-asyncio python-3.6

我正在尝试做这样的事情:

import asyncio
from itertools import islice

async def generate_numbers(n):
    for x in range(n):
        yield x


async def consume_numbers(n):
    async for x in generate_numbers(n):
        print(x)

async def consume_some_numbers(n,m):
    async for x in islice(generate_numbers(n),m): #<-- This doesn't work.  islice doesn't recognize async iterators as iterators.
        print(x)


loop = asyncio.get_event_loop()
loop.run_until_complete(consume_numbers(10))
loop.run_until_complete(consume_some_numbers(10,5))

有没有办法让它工作,或者至少获得类似的功能?

最佳答案

这是实现异步友好的尝试 islice (并枚举):

import asyncio
import sys

import random


async def aenumerate(aiterable):
    i = 0
    async for x in aiterable:
        yield i, x
        i += 1


async def aislice(aiterable, *args):
    s = slice(*args)
    it = iter(range(s.start or 0, s.stop or sys.maxsize, s.step or 1))
    try:
        nexti = next(it)
    except StopIteration:
        return
    async for i, element in aenumerate(aiterable):
        if i == nexti:
            yield element
            try:
                nexti = next(it)
            except StopIteration:
                return


async def generate_numbers(n):
    for x in range(n):
        await asyncio.sleep(random.uniform(0.1, 0.4))
        yield x


async def consume_numbers(tag, n):
    print(tag, "start")
    async for x in generate_numbers(n):
        print(tag, x)
    print(tag, "done")


async def consume_some_numbers(tag, n, a, b, step=1):
    print(tag, "start")
    async for x in aislice(generate_numbers(n), a, b, step):
        print(tag, x)
    print(tag, "done")


loop = asyncio.get_event_loop()
loop.run_until_complete(asyncio.wait([
    consume_numbers("A", 5),
    consume_numbers("B", 10),
    consume_some_numbers("C", 10, 0, 5),
    consume_some_numbers("D", 30, 3, 20, 4),
    consume_some_numbers("E", 10, 3, 8, 2),
]))
loop.close()

在现实世界的应用程序中进行测试,欢迎评论:-)

关于iterator - Python 3.6 : async version of islice?,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/42378566/

相关文章:

python - 在 Python 中跳过迭代变量的 N 个值的最佳方法是什么?

c++ - 迭代器默认构造函数和 POD 成员初始化

python - Itertools.chain.from_iterable

Python - asyncio - 从未检索到任务异常

c++ - 具有通用 uint8_t 数据存储的图像类的迭代器

c++ - 删除元素时使用 STL 映射的迭代器时遇到问题

python - 计算满足特定条件的组合?

python - 如何在给定字符集的情况下获得第 n 个排列,反之亦然

python - 如何解决 python unittest 的事件循环已关闭的错误?

python - 为什么 pywin32 服务没有正确停止?