discourse-ai/lib/shared/inference
Rafael dos Santos Silva 2c0f535bab
FEATURE: HyDE-powered semantic search. (#136)
* FEATURE: HyDE-powered semantic search.

It relies on the new outlet added on discourse/discourse#23390 to display semantic search results in an unobtrusive way.

We'll use a HyDE-backed approach for semantic search, which consists on generating an hypothetical document from a given keywords, which gets transformed into a vector and used in a asymmetric similarity topic search.

This PR also reorganizes the internals to have less moving parts, maintaining one hierarchy of DAOish classes for vector-related operations like transformations and querying.

Completions and vectors created by HyDE will remain cached on Redis for now, but we could later use Postgres instead.

* Missing translation and rate limiting

---------

Co-authored-by: Roman Rizzi <rizziromanalejandro@gmail.com>
2023-09-05 11:08:23 -03:00
..
anthropic_completions.rb FIX: setting explorer was exceeding token budget 2023-09-01 11:48:51 +10:00
discourse_classifier.rb FEATURE: Handle invalid media in NSFW module (#57) 2023-05-11 15:35:39 -03:00
discourse_reranker.rb DEV: DiscourseAI -> DiscourseAi rename to have consistent folders and files (#9) 2023-03-14 16:03:50 -03:00
function.rb FEATURE: add initial support for personas (#172) 2023-08-30 16:15:03 +10:00
function_list.rb FEATURE: add initial support for personas (#172) 2023-08-30 16:15:03 +10:00
hugging_face_text_generation.rb FEATURE: HyDE-powered semantic search. (#136) 2023-09-05 11:08:23 -03:00
openai_completions.rb FIX: setting explorer was exceeding token budget 2023-09-01 11:48:51 +10:00
openai_embeddings.rb FEATURE: Add Azure cognitive service support (#93) 2023-06-21 10:39:51 +10:00
stability_generator.rb FEATURE: add support for final stable diffusion xl model (#122) 2023-08-02 16:53:28 -03:00