Hugging Face's Carbon-X features a 40-layer standard Qwen3 backbone with a hidden size of 5,120, grouped-query attention with 8 KV heads, and a 40,960-token context length