Skip to main content
Version: Current

Azure Llama Connection

Overview​

The Azure Llama connection allows IB-X Agents to access Azure Llama models through a configured Llama endpoint.

Use this connection when your organization hosts or manages a Llama endpoint that IB-X needs to access.

note

Configuring a native Llama connection is optional when using supported Llama services through the IntelliBuddies Integration Gateway.

Connection Options​

Llama models can be accessed in IB-X using either:

  • Native Endpoint – Connect to a customer-managed Llama endpoint.
  • Integration Gateway – Access supported Llama services through the IntelliBuddies Integration Gateway.

Native Endpoint​

Use Native Endpoint to connect IB-X directly to a custom-deployed Llama endpoint.

The endpoint must be accessible from the IB-X environment in which the Agent executes.

Integration Gateway​

Instead of configuring a customer-managed Llama endpoint, supported Llama services can be accessed through the IntelliBuddies Integration Gateway.

When using the Integration Gateway:

  • A customer-managed Llama connection is not required.
  • Requests are routed through the IntelliBuddies Integration Gateway.
  • Usage consumes IB-X Currency.

The Llama models and capabilities available through the Integration Gateway depend on the services supported by IB-X.

Testing the Connection​

For native Llama connections that support connection testing, click Test Connection after providing the required endpoint configuration.

Connection issues can result from:

  • An incorrect endpoint configuration
  • An unavailable Llama endpoint
  • Network connectivity problems
  • Authentication or authorization failures, where applicable
note

A successful connection test verifies that IB-X can connect to the configured endpoint. Access to individual models and capabilities depends on the models and services available through that endpoint.

Used By​

The Llama connection can be used by IB-X AI activities and capabilities that support Llama as an AI provider.

The models and capabilities available depend on the Llama models exposed through the configured endpoint or Integration Gateway.

Security Considerations​

When configuring a native Llama connection:

  • Use an endpoint intended for the appropriate IB-X environment.
  • Protect any credentials associated with the endpoint from unauthorized access.
  • Restrict access to connection management based on organizational requirements.
  • Ensure that access to the Llama endpoint follows your organization's network and security policies.

When using Llama services through the Integration Gateway, customer-managed provider configuration is not required.

Additional Resources​

For additional information about configuring and using Llama with IB-X, see Connecting to Llama.

For information about creating, editing, testing, cloning, deleting, and auditing connections, see Connections.