On an NVIDIA RTX 3090, Strands Decider 2B answers questions in a median of 115 milliseconds, with a 95th-percentile latency of 299 milliseconds.

From the articleAWS Releases Decision Model for AI Agents That Routes Without Generating Any Text