What can Custom LLMs be used for in TotalAgility?

Issue

Users might wonder what they can use Custom LLMs for, since Copilot for Extraction and Copilot for Development are not available to them, unlike the built-in OpenAI providers.

Solution

The Custom LLM provider in TotalAgility only allows linking to a custom process and doesn’t offer the same built-in capabilities as the OOTB providers. It provides flexibility to integrate with any LLM, but requires users to handle all request/response logic within the linked process.

By making use of a Custom LLM integration, users can connect their workflows to self-hosted, fine-tuned, or private cloud endpoints (such Anthropic Claude, Google Gemini, or local Llama deployments) alongside TotalAgility’s built-in AI capabilities.

This offer's flexibility with regard to:

• Data Sovereignty & Compliance: Fulfills strict regulatory requirements (GDPR, HIPAA, zero-retention policies) by directing sensitive data to internally hosted or region-isolated LLM instances.
• Model Flexibility: Enables organizations to utilize existing LLM enterprise subscriptions, custom-trained domain models, or open-source LLMs rather than relying solely on default provider endpoints.

They can also use your custom LLM in a GenAI activity within a process.

Applies to