问题
我有一系列管道:
class PipelineA(base_handler.PipelineBase):
def run(self, *args):
# do something
class PipelineB(base_handler.PipelineBase):
def run(self, *args):
# do something
class EntryPipeline(base_handler.PipelineBase):
def run(self):
if some_condition():
self.abort("Condition failed. Pipeline aborted!")
yield PipelineA()
mr_output = yield mapreduce_pipeline.MapreducePipeline(
# mapreduce configs here
# ...
)
yield PipelineB(mr_output)
p = EntryPipeline()
p.start()
在 EntryPipeline
中,我在启动 PipelineA
、MapreducePipeline
和 PipelineB
之前测试了一些条件。如果条件失败,我想中止 EntryPipeline
和所有后续管道。
问题
什么是优雅的管道中止?
self.abort()
是正确的方法还是我需要sys.exit()
?如果我想在
PipelineA
内进行堕胎怎么办?例如PipelineA
成功启动,但阻止后续管道(MapreducePipeline
和PipelineB
)启动。
编辑:
我最终将条件语句移至 EntryPipeline
之外,因此仅当条件为真时才启动整个过程。否则我认为尼克的答案是正确的。
最佳答案
由于文档当前说“TODO:谈论显式中止和重试”
我们必须阅读源代码:
def abort(self, abort_message=''):
"""Mark the entire pipeline up to the root as aborted.
Note this should only be called from *outside* the context of a running
pipeline. Synchronous and generator pipelines should raise the 'Abort'
exception to cause this behavior during execution.
Args:
abort_message: Optional message explaining why the abort happened.
Returns:
True if the abort signal was sent successfully; False if the pipeline
could not be aborted for any reason.
"""
因此,如果您拥有 some_pipeline 的句柄,但不是 self,则可以调用 some_pipeline.abort()...但是如果你想中止自己,你需要引发 Abort() ...这将冒泡到顶部并杀死整棵树
关于python - 如何优雅地中止 App Engine 管道?,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/29979036/