Increasing inference efficiency can improve both the performance and cost-effectiveness of an AI system