TrueFoundry, an enterprise AI infrastructure platform, announced the launch of Ask TFY, a conversational interface built on the company’s own agent technology that gives engineering and operations teams a unified way to query AI Gateway data, manage configurations, and diagnose production issues using natural language.

As enterprise AI deployments scale across models, teams, and infrastructure, the operational burden has grown in parallel. Teams managing production AI must manually cross-reference configurations, trace costs, monitor providers, and debug failures across siloed systems. The engineers best equipped to act are often those spending the most time searching for critical data. As organizations mature past pilot projects, streamlined access to operational data is now essential for running AI at scale.

Ask TFY addresses this by consolidating AI Gateway operations into a single conversational interface. It draws on three knowledge sources. These include live AI Gateway configuration and trace data (models, MCP servers, guardrail policies, budget rules, access controls, and request-level traces), TrueFoundry's full documentation library, and web search. Ask TFY can render charts and UI elements, generate YAML for configuration changes, highlight anomalies, and recommend application fixes, delivering diagnostic insight and actionable output within a single query. Ask TFY can also apply certain recommended changes directly upon request, without requiring a manual handoff to another screen.

“Managing enterprise AI infrastructure at scale requires teams to cross-reference configurations, trace errors, and optimize costs across systems that weren’t built to talk to each other,” said Nikunj Bajaj, co-founder and CEO of TrueFoundry. “Ask TFY collapses that complexity into a single conversational interface so teams can surface what they need and act on it immediately.”

Among its primary use cases, Ask TFY can:

• Respond to queries such as “which MCP servers are running without a guardrail” by auditing tool access across every connected server and rendering findings in a graph
• Convert a request to “set quotas by developer, by application, or by model” into budget configuration recommendations drawn from live usage data
• Answer questions about prompt cache utilization across LLM requests and surface exactly where caching is going unused, with a ready-to-apply configuration
• Diagnose recurring application failures on demand, tracing errors to their source—whether the model, provider, or application—with a clear remediation path

Enterprise teams using TrueFoundry’s AI Gateway can access Ask TFY directly within the existing platform.

Ask TFY is the latest in a series of platform expansions from TrueFoundry in 2026. Last month, the company launched Agent Gateway, a unified control plane for governing AI agents across frameworks and environments. In January, TrueFailover added outage resilience, keeping AI workloads running through model, region, or provider failures. NetApp, Innovaccer, and Siemens Healthineers are among the enterprises already running the platform at scale.