discourse
/
discourse-ai
mirror of https://github.com/discourse/discourse-ai.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

FIX: Bedrock was complaining input was too long (#365)

This commit is contained in:
Roman Rizzi 2023-12-18 16:06:06 -03:00 committed by GitHub
parent 4d7ccdda2f
commit 203906be65
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
lib/completions/endpoints/aws_bedrock.rb
View File

@ -1,5 +1,7 @@
# frozen_string_literal: true # frozen_string_literal: true
require "aws-sigv4"
module DiscourseAi module DiscourseAi
module Completions module Completions
module Endpoints module Endpoints
@ -12,7 +14,7 @@ module DiscourseAi
end end
def default_options def default_options
{ max_tokens_to_sample: 20_000 } { max_tokens_to_sample: 2_000 }
end end
def provider_id def provider_id