4 Commits

Author	SHA1	Message	Date
Roman Rizzi	e2e753d73c	FEATURE: Formalize support for matryoshka dimensions. (#1083) ... We have a flag to signal we are shortening the embeddings of a model. Only used in Open AI's text-embedding-3-*, but we plan to use it for other services.	2025-01-22 11:26:46 -03:00
Roman Rizzi	a5e5ae72a8	FIX: Open AI embedding shortening is only available for some models (#1080)	2025-01-21 17:50:40 -03:00
Roman Rizzi	f5cf1019fb	FEATURE: configurable embeddings (#1049) ... * Use AR model for embeddings features * endpoints * Embeddings CRUD UI * Add presets. Hide a couple more settings * system specs * Seed embedding definition from old settings * Generate search bit index on the fly. cleanup orphaned data * support for seeded models * Fix run test for new embedding * fix selected model not set correctly	2025-01-21 12:23:19 -03:00
Roman Rizzi	534b0df391	REFACTOR: Separation of concerns for embedding generation. (#1027) ... In a previous refactor, we moved the responsibility of querying and storing embeddings into the `Schema` class. Now, it's time for embedding generation. The motivation behind these changes is to isolate vector characteristics in simple objects to later replace them with a DB-backed version, similar to what we did with LLM configs.	2024-12-16 09:55:39 -03:00