AWS now allows prompt caching with 90% cost reduction

Posted by:

On:

December 4, 2024

AWS added Intelligent Prompt Routing and Prompt Caching to Bedrock in hopes of getting model usage prices down.Read More

Posted by