Consumers and Owners

Understanding the roles of consumers and owners is essential for effective management of LLM resources in Tetrate Agent Operations Director. These concepts define who uses AI resources and who is responsible for their governance.

Owners

Owners represent organizational entities responsible for managing consumers and their LLM resource usage. In the Agent Operations Director, owners are directly tied to budget allocations and administrative control.

Owner Structure

The platform supports various organizational structures as owners. For example:

• Teams: Cybersecurity, Central-IT, Platform, Support
• Business Units: EquityResearch, InvestmentBanking, RetailBanking

Owner Properties

Each owner in the system has several key attributes:

• Owner ID: Unique identifier for the owner entity
• Display Name: Human-readable name
• Template: Associated budget template that defines quota limits for this Owner

Owner Management

The Owners interface provides administrators with tools to:

• Create Owners: Add new organizational entities with the "Add Owner" function
• Assign Templates: Link budget templates to owners
• Filter and Search: Quickly locate specific owners
• Edit and Delete: Modify or remove owner configurations

Consumers

Consumers are the applications, services, or systems that utilize LLM resources. Each consumer is associated with an owner who manages their resource allocation.

Consumer Types

Consumers can take various forms:

• Applications: Backend services that integrate with LLMs
• Chat Interfaces: User-facing AI assistants
• Data Analysis Tools: Systems that process information using LLMs
• Development Environments: Testing and experimental platforms

Consumer Status

Consumers in the Director system can have various statuses:

• Discovered: Automatically detected but not yet configured
• Reconciled: Properly configured in the system

Consumer Management

The platform provides tools for managing consumers:

• Auto-Discovery: Automatic identification of LLM usage
• Owner Assignment: Linking consumers to responsible owners
• Usage Tracking: Monitoring of token consumption and costs