Rewriting the Anthropic Messages API in Rust improved time-to-first-token latency by 10% to 20% on workloads

Activity

Activity (0)
Loading comments...