Inference Hub
Inference Hub is an optional Capability Reference Design for delivering governed inference to enterprise applications and agents. This page explains how to compose it with the Enterprise AI Factory core, Secure Agent Workspace, and Industry Profiles.
When to Apply Inference Hub
Apply this capability when multiple applications or teams need a shared inference service rather than independently managed model endpoints. Begin with workload outcomes, service objectives, ownership, and data constraints; use the published design to plan the service.
Inference Hub composes existing core responsibilities. It does not replace the core stack or require every AI Factory workload to use one serving engine, gateway product, or deployment model.
Relationship to the Core
Select Inference Hub in the interactive architecture to see the responsibilities it adds, extends, or inherits:
Compose with Other Capabilities and Profiles
- Secure Agent Workspace: SAW governs agent execution, workspace isolation, tool authority, and egress. Inference Hub governs access to inference services. Using both does not remove workspace isolation or network-perimeter requirements.
- Government: Apply the Government profile to backend eligibility, residency, external dependencies, and operating boundaries. Do not assume that a published implementation supports disconnected operation or satisfies sector authorization requirements.
- Implementation selection: Choose components using the publication’s implementation guidance and current publisher support documentation. Catalog candidates support discovery, not interoperability or support claims.
Detailed Design and Adoption Guidance
Continue to the published design for implementation-level guidance.
Published Example Implementations
Use these published examples to evaluate component choices and their operating boundaries:
Confirm component availability, deployment assumptions, and support in the published example and current vendor documentation.