AWSSDK.Extensions.Bedrock.MEAI ChatClient Prompt Caching

[kaldasm]

After a lot of time looking into documentation to no avail and then reviewing the implementation of the BedrockChatClient as part of AWSSDK.Extensions.Bedrock.MEAI, it appears to me that there is no support for prompt caching although the underlying Converse API that is being used does support it through the CachePoint property on content blocks.

Just hoping to get some clarity if my understanding is correct, or if it is already implemented and I am just not seeing how to use it?

[eddiemcs3]

Thank you for the question. We will take a look and respond.

[ashishdhingra]

@kaldasm Good morning. Currently there is no support for prompt caching in AWSSDK.Extensions.Bedrock.MEAI package. Feel free to open a new feature request with additional details, which could be reviewed by the team.

Thanks,
Ashish