Skip to main content
logoTetrate Agent Operations DirectorVersion: Latest

Providers and Resources

Understanding both providers and resources is essential for effective management and governance of your LLM infrastructure in Tetrate Agent Operations Director.

Providers​

In Tetrate Agent Operations Director, providers refer to the external LLM services that supply AI capabilities to your applications. The platform offers comprehensive management tools for your entire provider ecosystem.

Provider Types​

The platform supports multiple LLM service providers, including but not limited to:

  • Amazon: AWS Bedrock and other Amazon AI services
  • Anthropic: Provider of Claude models
  • Meta: Provider of Llama models
  • OpenAI: Provider of GPT models
  • Google: Vertex AI and other Google AI services
  • Custom/Self-hosted: Internal AI services

Provider Management​

The Providers interface offers comprehensive tools for managing your LLM services:

Provider Dashboard​

  • Provider List: Overview of all configured providers
  • Display Name: User-friendly names for each provider
  • Template Assignment: Associated budget templates that defines quotas

Administration Controls​

  • Add Provider: Create new provider configurations
  • Edit: Modify existing provider settings
  • Delete: Remove provider configurations
  • Search and Filter: Quickly locate specific providers
  • Resolve: Analyze and configure automatically discovered resources and providers

Provider Analytics​

The Usage Analysis interface provides detailed insights into provider usage:

  • Provider Filtering: View analytics for specific providers
  • Cross-Consumer Analysis: See how different teams use each provider
  • Resource Breakdown: Detailed usage by specific model resources
  • Utilization Patterns: Percentage distribution of usage across consumers

Provider Configuration​

When adding a new provider, administrators must specify:

  • Provider ID: Unique identifier for the provider
  • Display Name: Human-readable name
  • Template: Associated budget template that defines quotas

Multi-provider Strategy​

Tetrate Agent Operations Director enables sophisticated multi-provider strategies:

  • Provider Diversity: Usage spread across multiple providers for redundancy
  • Cost Optimization: Directing traffic to the most cost-effective provider
  • Capability Matching: Selecting providers based on specific model capabilities

Resources and Models​

Resources represent the specific AI model endpoints that can be consumed by applications within your organization. The platform provides visibility into various resource states:

  • Discovered: Automatically detected resources
  • Resolved: Fully configured resources

Resource Usage Patterns​

The Usage Analysis interface provides detailed insights into how resources are being utilized across your organization:

  • Provider Breakdown: Usage distribution across Amazon, Anthropic, and Meta
  • Consumer Utilization: How specific consumers like ConversationAI and Maven teams use resources
  • Percentage Analysis: Relative usage patterns indicated by percentage values and token counts

Resource Management​

Tetrate Agent Operations Director offers comprehensive tools for managing resources:

Discovery and Resolution​

  • Auto-Discovery: Automatic identification of resources being consumed
  • Resolution Process: Configuring discovered resources for proper governance
  • Status Tracking: Monitoring the state of each resource

Analysis Tools​

  • Resource Analysis: Dedicated analytics for understanding resource consumption
  • Provider Filters: View resources by specific providers
  • Tetrate Intelligence Integration: AI-powered insights into resource usage