python - 如何在 python/Django 中找出给定 URL 的摘要文本？

Question

<分区>

Answer 1

我有同样的需求，而 lemur，虽然它具有摘要功能，但我发现它有问题到无法使用的地步。周末我用 nltk 在 python 中编写了一个总结模块:https://github.com/thavelick/summarize

我从此处的 Java 库 Classifier4J 中获取算法:http://classifier4j.sourceforge.net/但尽可能使用 nltk 和 python。

这是基本用法:

>>> import summarize

SimpleSummarizer(目前唯一的摘要器)使用出现频率最高的句子进行摘要:

>>> ss = summarize.SimpleSummarizer()
>>> input = "NLTK is a python library for working human-written text. Summarize is a package that uses NLTK to create summaries."
>>> ss.summarize(input, 1)
'NLTK is a python library for working human-written text.'

您可以根据需要在摘要中指定任意数量的句子。

>>> input = "NLTK is a python library for working human-written text. Summarize is a package that uses NLTK to create summaries. A Summariser is really cool. I don't think there are any other python summarisers."
>>> ss.summarize(input, 2)
"NLTK is a python library for working human-written text.  I don't think there are any other python summarisers."

与 Classifier4J 的原始算法不同，此摘要器有效 正确使用句点以外的标点符号:

>>> input = "NLTK is a python library for working human-written text! Summarize is a package that uses NLTK to create summaries."
>>> ss.summarize(input, 1)
'NLTK is a python library for working human-written text!'

更新

我现在(终于!)在 Apache 2.0 许可下发布了这个，与 nltk 相同的许可，并将模块放在 github 上(见上文)。欢迎任何贡献或建议。