transformers可以实现离线生成embeddings向量,支持python、nodejs,甚至浏览器都能运行:
<script defer type="module"> import { pipeline } from '//repo.bfw.wiki/bfwrepo/js/transformers@2.3.0.js'; const generateEmbeddings = await pipeline( 'feature-extraction', 'Xenova/all-MiniLM-L6-v2' ); const output1 = await generateEmbeddings("hello,my friend", { pooling: 'mean', normalize: true, }); console.log(output1) </script>
网友回复