python如何求词语关联性相关词pmi?
网友回复
使用word2vec的model.wv.most_similar来获取关联性词汇,完整代码如下:
#!/usr/local/python3/bin/python3 # -*- coding: utf-8 -* import jieba from gensim.models import word2vec import logging #分词 f1 =open("/data/wwwroot/default/asset/fenci.txt",encoding = 'utf-8') f2 =open("fenci_result.txt", 'a',encoding = 'utf-8') lines =f1.readlines() # 读取全部内容 for line in lines: line.replace('\t', '').replace('\n', '').replace(' ','') seg_list = jieba.cut(line, cut_all=False) f2.write(" ".join(seg_list)) f1.close() f2.close() # 主程序 logging.basicConfig(format='%(asctime)s:%(levelname)s: %(message)s', level=logging.INFO) sent...
点击查看剩余70%