11 points | by devstein 3 hours ago ago
2 comments
I've liked qwen and embeddinggemma for local search. Qwen because 32K is enough to basically fit a whole page into the context window and embeddiggemma because it's crazy efficient.
embeddings are easy to fine tune. Try modern bert.
I've liked qwen and embeddinggemma for local search. Qwen because 32K is enough to basically fit a whole page into the context window and embeddiggemma because it's crazy efficient.
embeddings are easy to fine tune. Try modern bert.