AI Gateway can now re-run a decision on a fallback model when the primary model has low confidence; the feature is currently available in beta. This can increase system reliability and reduce the risk of incorrect decisions.
AI-generated text
AI Gateway agents can forward uncertain decisions to a fallback model (beta)
AI Gateway can now re-run a decision on a fallback model when the primary model has low confidence; the feature is currently available in beta.
