Using Tetrate Intelligence

Learn how to leverage the AI-powered assistant in Agent Operations Director to gain deeper insights into your LLM usage patterns and optimization opportunities.

Overview

Tetrate Intelligence is an AI assistant integrated throughout Agent Operations Director that helps users analyze data, identify patterns, and discover optimization opportunities across providers, resources, consumers, and budgets. This capability transforms raw usage data into actionable insights without requiring deep expertise in data analysis.

Key Capabilities

Interactive Analysis

Tetrate Intelligence provides an intuitive interface for exploring your LLM usage:

• Natural Language Queries: Ask questions in plain English about your usage data
• Contextual Understanding: The assistant understands the context of different dashboards
• Follow-up Questions: Build on previous queries for deeper exploration

Insight Generation

The assistant automatically identifies important patterns in your data:

• Usage Anomalies: Unusual spikes or changes in consumption patterns
• Cost Drivers: Major contributors to overall spending
• Efficiency Opportunities: Potential areas for optimization
• Trend Analysis: Emerging patterns that may require attention

Recommendation Engine

Beyond analysis, Tetrate Intelligence offers actionable recommendations:

• Budget Adjustments: Suggestions for optimizing quota allocations
• Resource Selection: Recommendations for more cost-effective models
• Governance Improvements: Suggestions for better policy implementation

Accessing Tetrate Intelligence

The assistant is available as a menu and also in Analysis pages

Prompts Library

Each analytical view includes a Prompts Library with pre-configured questions:

• Usage Analysis Prompts:

  • "Who are starting to use more resources?"
  • "Who uses the most variety of Providers?"
  • "Where are usage spikes?"

• Budget Analysis Prompts:

  • "Which budgets are close to overage?"
  • "Which budgets have overages historically?"
  • "How can I budget for maximum impact?"

• Consumer Analysis Prompts:

  • "Which consumers are growing fastest?"
  • "What resource types are most popular?"
  • "Which applications need optimization?"

• Resource Analysis Prompts:

  • "Which Resources are gaining adoption?"
  • "What are the most widely used resources?"
  • "Which models offer the best value?"