python - word2vec 出现编码错误

Question

执行代码时出现以下错误

Traceback (most recent call last):
  File "test.py", line 21, in <module>
    print model.most_similar(positive=['男人'])
  File "/usr/local/lib/python2.7/dist-packages/gensim/models/word2vec.py", line 660, in most_similar
    raise KeyError("word '%s' not in vocabulary" % word)
KeyError: "word '\xe7\x94\xb7\xe4\xba\xba' not in vocabulary"

这里是我的代码

 # -*- coding: utf8 -*    
    from gensim.models import word2vec
    import logging

logging.basicConfig(format='%(asctime)s : %(levelname)s : %(message)s', level=logging.INFO)
        sentences = word2vec.Text8Corpus('/tmp/text8')
        model = word2vec.
    Word2Vec(sentences, size=200)
        model.most_similar(['男人'])

Answer 1

"it works by the following changes. model.most_similar([u'男人'])"

这意味着您可能正在使用 utf-8 编码的字符串而不是 unicode 字符串，一个好的做法是使用 unicode 对输入进行解码，然后对输出进行编码。

.decode('utf-8') 你的字符串