#apple-silicon

1 postwith this tag

Hybrid search: how to combine BM25 and embeddings (and make them fit on a laptop)

Third installment of the benchmark: we merge the BM25 and embedding rankings and the result beats both individually. We also measure how to index the full corpus from the Mac M3: what works (GGUF/Metal), what does not (large batches, fp16), and why jina's binary quantization decides the storage architecture.

Joaquín Bravo ContrerasRead more