Gitstar Ranking

aws-samples / sample-traffic-shaping-for-amazon-bedrock

Bedrock Traffic Shaper for queuing inference requests trading latency for reliability with serverless AWS infrastructure - View it on GitHub
https://builder.aws.com/content/3DgcVkGOGQWumJouGwVKKdP9yyW/building-a-resilient-inference-engine-is-essential-for-genai-workloads
Star
4
Rank
2941134