transformers可以实现离线生成embeddings向量,支持python、nodejs,甚至浏览器都能运行:
<script defer type="module">
import { pipeline } from '//repo.bfw.wiki/bfwrepo/js/transformers@2.3.0.js';
const generateEmbeddings = await pipeline(
'feature-extraction',
'Xenova/all-MiniLM-L6-v2'
);
const output1 = await generateEmbeddings("hello,my friend", {
pooling: 'mean',
normalize: true,
});
console.log(output1)
</script>
网友回复


