Add support for AWS Bedrock Claude | Voters

Add support for AWS Bedrock Claude

complete

Adrian Simionov

+ every other model from AWS Bedrock.

April 23, 2024

Daniel Nguyen

marked this post as

complete

Added in v1.29.0: https://boltai.com/blog/amazon-bedrock-and-xai-support-cache-breakpoint-and-more

Sam

Glad to see Bedrock support land today Daniel Nguyen!
One thing - would it be possible for Bolt to get the access key ID and secret key from your current AWS profile?
Most places I've worked have between a 1 and 6 hour session timeout (a right pain in the ass) which means the keys rotate several times throughout the day which would make getting them from the aws cli config and copy/pasting them a bit of a pain.

Daniel Nguyen

Sam: Interesting. I will add support for this soon.

Daniel Nguyen

Sam: Can you create a separate post for this feature. I'm closing this now.

Sam

Daniel Nguyen done :) https://boltai.canny.io/feature-requests/p/bedrock-get-authentication-from-environment-aws-cli-session

Pablo

Now more than ever given that Amazon Nova Models are only available through Bedrock.

Henry Rausch

might be also good to look into Google Vertex. Maybe you could implement both with one update

Daniel Nguyen

marked this post as

in progress

Paul-Louis Pröve

I have to ditch BoltAI because without this feature it has no use to me. My company has switched to Bedrock for their higher rate limits and generation speed. I cannot use Claude without it.

Daniel Nguyen

Paul-Louis Pröve: Sorry. I will add support for Bedrock soon.

Daniel Nguyen

marked this post as

planned