Discover & Reconcile Resources & Providers

Learn how to find, catalog, and manage LLM resources and providers in use across your organization.

Overview

Tetrate Agent Operations Director provides discovery capabilities that automatically detect LLM services in use, helping you build a complete inventory without requiring extensive manual effort.

Discovery Methods

Automatic Discovery

The platform scans network traffic to identify LLM API calls, automatically detecting:

1. Provider Endpoints: Recognition of common LLM provider endpoints
2. Model Types: Identification of specific models being called
3. Metadata: Any metadata that can be used to identify consumers

Manual Addition

For resources that cannot be automatically discovered, you can add specific LLM resources through the UI.

Resources and Providers Management Workflow

Step 1: Access Resource Management

Navigate to the Providers page from the main navigation menu

Step 2: Review Discovered Resources

1. Click the Resolve button to access the Resources discovery page
2. Provider dropdown list should show Unresolved

Step 3: Reconcile Resources

For each discovered resource:

1. Verify the information shown on the table
2. Click Reconcile button to start reconciling the resource
3. Set Budget Template and additional detail for the resource

Step 4: Provider Management

If the provider from discovered resources is not available in the reconcile dialog, then add the provider manually in the Provider page. Select appropriate Budget Template for the provider.

Step 5: Manually Add Resources (if needed)

For resources not automatically discovered, use the "+ Resource" button and enter required details.

Step 6: Validate Inventory

1. Verify all known LLM resources appear in the resource list
2. Check the resource status metrics on the dashboard
3. Ensure pricing information is correctly configured