Resource Resolution and Management

Learn how to resolve and manage LLM resources and providers in use across your organization.

Overview

Tetrate Agent Operations Director provides discovery capabilities that automatically detect LLM resources in use, helping you build a complete inventory without requiring extensive manual effort.

Discovery Methods

Automatic Discovery

The platform scans network traffic to identify LLM API calls, automatically detecting:

1. Provider Endpoints: Recognition of common LLM provider endpoints
2. Model Types: Identification of specific models being called
3. Metadata: Any metadata that can be used to identify consumers

Manual Addition

For resources that cannot be automatically discovered, you can add specific LLM resources through the UI.

Resources Resolution Workflow

Option 1 - Resolve from Dashboard

1. In the Dashboard page, click on Unresolved bar in Resource graph to open Unresolved Resources dialog
2. Click Resolve on a resource
3. Select the Provider for the resource
   • If the provider from discovered resources is not available in the resolve dialog, then add the provider manually in the Providers page. Set appropriate Budget Template for the provider.
4. Set Budget Template and additional detail for the resource

Option 2 - Resolve from Provider Page

1. Navigate to the Providers page from the main navigation menu
2. Click the Resolve button to access the Resources discovery page
3. The table should show Unresolved Resources
4. Click Resolve on a resource
5. Select the Provider for the resource
   • If the provider from discovered resources is not available in the resolve dialog, then add the provider manually in the Providers page. Set appropriate Budget Template for the provider.
6. Set Budget Template and additional detail for the resource

Manually Add Resources (if needed)

For resources not automatically discovered, use the "+ Add Resource" button and enter required details.