Add vector search

[OriPekelman]

It would be nice to find a cool API that would allow to use some vector search capabilities with shocking simplicity.

There clearly is going to be here a system boundaries/responsibilities issue as to the relationship with grabbing embeddings...

But from an API perspective something like:

relevant_senior_jobs=Job.similar_to(user).where(level: 'senior')

relevant_senior_jobs=Job.similar_to_description(user.bio).where(level: 'senior')

relevant_jobs=Job.similar_to_description(embeddings: [1,2,3], distance: :cosine)

I'd suggest pg_vector as baseline with an alternate implementation with meilisearch (to keep us honest on generality - they have very different APIs).

[adenta]

I think this is a duplicate of #26

[OriPekelman]

I am not sure it is.. a full RAG would be something opinionated with a bunch of ideas on how you ingest etc. This would possibly be a simple primitive a RAG could use. But .. separation of responsibilities here is actually murky and very much depends on where the maintainer would like to take this.

But do close the issue if I am noisy :)

[vicentereig]

@OriPekelman Have you seen https://github.com/ankane/neighbor? It integrates pgvector nicely with Active Record. You can use it with your preferred LLM to index your documents and queries. Even pair it with an in-memory ONNX model: https://github.com/ankane/informers.

[crmne]

I'm afraid we're not going to support vector search #26 (comment)