Go to file
Keegan George 1f9f330ce2
DEV: Add summarization type to eval (#1138)
Adds `type: summarization` for topic summarization eval: https://github.com/discourse/discourse-ai-evals/pull/4
2025-02-20 09:07:23 -08:00
.github/workflows Initial commit 2023-02-17 11:33:47 -03:00
admin/assets/javascripts/discourse FEATURE: PDF support for rag pipeline (#1118) 2025-02-14 12:15:07 +11:00
app DEV: Update annotations for models using Core tables (#1140) 2025-02-20 11:49:50 -03:00
assets DEV: add summary button wrapper removed from core (#1136) 2025-02-19 12:58:10 -05:00
config DEV: Misconfigured llm should go to edit page (#1132) 2025-02-18 10:34:18 -08:00
db FEATURE: PDF support for rag pipeline (#1118) 2025-02-14 12:15:07 +11:00
discourse_automation FEATURE: Select stop sequences from triage script (#1010) 2024-12-06 11:13:47 -03:00
evals DEV: Add summarization type to eval (#1138) 2025-02-20 09:07:23 -08:00
lib FIX: Add workaround to pgvector HNSW search limitations (#1133) 2025-02-19 16:30:01 -03:00
public/ai-share UX: improve artifact styling add direct share link (#930) 2024-11-20 13:13:03 +11:00
spec FIX: Add workaround to pgvector HNSW search limitations (#1133) 2025-02-19 16:30:01 -03:00
svg-icons UX: improve embeddings config styles (#1085) 2025-01-24 16:24:59 +11:00
test/javascripts FEATURE: PDF support for rag pipeline (#1118) 2025-02-14 12:15:07 +11:00
tokenizers FEATURE: Gemini Tokenizer (#1088) 2025-01-23 18:20:35 -03:00
.discourse-compatibility DEV: Pin version for Discourse <3.5.0.beta1-dev (#1114) 2025-02-05 19:57:52 +01:00
.gitignore FEATURE: PDF support for rag pipeline (#1118) 2025-02-14 12:15:07 +11:00
.npmrc DEV: Switch to use pnpm (#833) 2024-10-14 13:37:20 +02:00
.prettierignore FEATURE: UI to update ai personas on admin page (#290) 2023-11-21 16:56:43 +11:00
.prettierrc.cjs DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
.rubocop.yml DEV: Expose AI spam scanning metrics (#1077) 2025-01-27 11:57:01 +08:00
.streerc DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
.template-lintrc.cjs DEV: Update linting (#326) 2023-11-29 23:01:48 +01:00
Gemfile DEV: Update linting configs (#280) 2023-11-03 11:30:09 +00:00
Gemfile.lock Build(deps-dev): Bump rack from 3.1.6 to 3.1.10 (#1124) 2025-02-13 12:09:04 +11:00
LICENSE Initial commit 2023-02-17 11:33:47 -03:00
README.md DEV: improve artifact editing and eval system (#1130) 2025-02-19 15:44:33 +11:00
about.json DEV: Expose AI spam scanning metrics (#1077) 2025-01-27 11:57:01 +08:00
eslint.config.mjs DEV: Update eslint config (#917) 2024-11-19 11:57:40 +01:00
package.json DEV: Bump dependencies and fix linting (#1115) 2025-02-06 17:42:32 +01:00
plugin.rb FEATURE: Native PDF support (#1127) 2025-02-18 09:22:57 +11:00
pnpm-lock.yaml DEV: Bump dependencies and fix linting (#1115) 2025-02-06 17:42:32 +01:00
translator.yml UX: Display the indexing progress for RAG uploads (#557) 2024-04-09 11:03:07 -03:00

README.md

Discourse AI Plugin

Plugin Summary

For more information, please see: https://meta.discourse.org/t/discourse-ai/259214?u=falco

Evals

The directory evals contains AI evals for the Discourse AI plugin.

To run them use:

cd evals ./run --help

Usage: evals/run [options]
    -e, --eval NAME                  Name of the evaluation to run
        --list-models                List models
    -m, --model NAME                 Model to evaluate (will eval all models if not specified)
    -l, --list                       List evals

To run evals you will need to configure API keys in your environment:

OPENAI_API_KEY=your_openai_api_key ANTHROPIC_API_KEY=your_anthropic_api_key GEMINI_API_KEY=your_gemini_api_key