Python 搜索文本列，如果单词列表中有任何匹配的关键字，则返回

Question

我有一个包含两列的数据框:message_id 和 msg_lower。我还有一个称为术语的关键字列表。我的目标是在 msg_lower 字段中搜索术语列表中的任何单词。如果它们匹配，我想返回一个包含 message_id 和关键字的元组。

数据如下所示:

|message_id|msg_lower                      |
|1116193453|text here that means something |
|9023746237|more text there meaning nothing|

terms = [text, nothing, there meaning]

术语也可以超过一个单词

对于给定的示例，我想返回:

[(1116193453, text),(9023746237,text),(9023746237,nothing),(9023746237,there meaning)]

理想情况下，我希望尽可能高效地做到这一点

Answer 1

您可以压缩两列以进行可能的按元组循环、按项循环并测试分割值中的成员资格:

terms = ['text', 'nothing']
a = [(x,i) for x, y in zip(df['message_id'],df['msg_lower']) for i in terms if i in y.split()]
print (a)
[(1116193453, 'text'), (9023746237, 'text'), (9023746237, 'nothing')]

编辑:

terms = ['text', 'nothing', 'there meaning']

a = [(x, i) for x, y in zip(df['message_id'],df['msg_lower']) for i in terms if i in y]
print (a)
[(1116193453, 'text'), (9023746237, 'text'), 
 (9023746237, 'nothing'), (9023746237, 'there meaning')]

另一个想法是使用 findall 和单词边界来提取值:

a = [(x, i) for x, y in zip(df['message_id'],df['msg_lower']) 
            for i in terms if re.findall(r"\b{}\b".format(i), y)]