Skip to main content

Kong AI Gateway

One gateway for AI traffic.
One policy for the data behind it.

Kong routes and secures every LLM, MCP and agent request. Data Harbor Platform makes sure each answer only includes data the requester is allowed to see.

Kong AI Gateway and Data Harbor Platform

How Kong AI Gateway and Data Harbor Platform work together to govern AI traffic and the data behind it.

One control plane for AI traffic

Kong AI Gateway is one control plane for all LLM, MCP and agent-to-agent traffic. Teams set a single endpoint to route and balance across providers like OpenAI, Anthropic, Amazon Bedrock and Google Gemini, with built-in authentication, policy enforcement and live analytics for tokens, latency and errors.

How it works together

Policy that reaches the data

An agent’s calls route through Kong to fetch enterprise data, such as objects in Amazon S3. Before any file reaches the agent, attribute-based access control checks the request in real time against the policy embedded in the object. Identity and attributes come straight from your identity provider, and only authorized records come back.

Kong governs tool permissions and response content. Virtru governs the file underneath. Control travels with the data, whatever the tool call pipeline.

Three integration points

  • Object-level authorization behind every MCP call

    Kong clears the agent to call a tool under a given OAuth2 scope. Data Harbor Platform decides what that tool can hand back, object by object, so exposing more tools never quietly exposes more records.

  • One identity, two enforcement layers

    The same OIDC or OAuth2 attributes Kong uses to authenticate and route a request also drive the policy decision at the data. Change a role once in your identity provider and both layers follow, with no second policy to keep in sync.

  • Self-hosted end to end

    Kong’s data planes and Data Harbor Platform can both run in your own environment. The gateway, the tool calls and the access decision all sit inside one accreditation boundary, with no vendor-hosted control plane in the loop.

Features

What you get when Kong AI Gateway and Data Harbor Platform run side by side.

  • Real-time authorization behind every MCP call

    Each retrieval through a Kong-exposed tool is checked against the policy in the object, so the agent only receives the records the requester’s current attributes allow.

  • One identity driving two enforcement layers

    The OIDC or OAuth2 attributes that route traffic through Kong also drive access decisions at the data, so clearance and role changes apply everywhere without duplicate setup.

  • Self-hosted end to end

    Kong AI Gateway runs fully self-hosted and Data Harbor Platform runs self-managed, with no vendor-hosted control plane in the data path.

  • Governance that scales with agent autonomy

    Every new tool Kong exposes inherits the same central data policy automatically, instead of needing its own access rules.

  • Model and provider agnostic

    Protection is enforced at the data, not inside one LLM integration, so it holds as Kong routes across OpenAI, Anthropic, Amazon Bedrock, Google Gemini or any other provider.

  • An audit trail beyond the gateway log

    Alongside Kong’s analytics for requests, tokens, errors and latency, every grant or denial is recorded. You can show the disclosure was authorized, not just that the call was logged.

  • No rebuild required

    Kong’s gateway, AI policies and provider routing stay as they are. Data Harbor Platform’s Storage capability and Key Access Service enforce policy at the data layer behind it.

Requirements

Running Data Harbor Platform behind Kong AI Gateway needs active deployments of both platforms, plus an identity provider to supply the attributes that drive access decisions.

  • Kong AI Gateway

    Konnect-managed or fully self-hosted, fronting LLM, MCP and tool-call traffic through the AI MCP Server entity.

  • Data Harbor Platform

    In your VPC or on premises. The Kong integration needs the self-managed deployment, not the Virtru-hosted SaaS.

  • A target data store

    Amazon S3 or other object storage, fronted by the platform’s Storage capability and Key Access Service.

  • AI Auth Strategy in Kong

    OAuth2 scopes on the exposed MCP tools, such as read or write access.

  • An identity provider

    Microsoft Entra ID in the reference architecture, or any OIDC or OAuth2 system that supplies the attributes in your policy.

  • An ABAC policy

    Attributes and rules you write, checked at every data retrieval a tool call triggers.

  • Network connectivity

    Between Kong’s data plane, the agent’s tool-call path and the Virtru Key Access Service.

  • FIPS mode on Kong (optional)

    Recommended for regulated environments.

Security

How the two platforms split the work across traffic, compliance and privacy.

Two layers, each doing its own job

Kong secures and governs the traffic: authentication, OAuth2-scoped tool calls through AI Auth Strategies, rate limiting and observability across every LLM, MCP and agent-to-agent connection. Its prompt and response guardrails (AI Prompt Guard, AI Semantic Prompt Guard, AI Sanitizer and AI Semantic Response Guard) screen content for safety and PII leaks.

Data Harbor Platform secures the data itself, with object-level TDF encryption and ABAC that holds whichever tool, model or agent makes the request. Kong never sees protected plaintext, only the traffic metadata and prompt and response content it needs to route and govern.

Compliance

Built for regulated environments

Kong AI Gateway offers a FIPS 140-3 compliant mode on its data planes, using the OpenSSL 3.1.2 FIPS provider set in kong.conf.

Data Harbor Platform is FedRAMP Moderate authorized, built on the OpenTDF open standard, and uses a FIPS 140-3 validated cryptographic module (VirtruCrypto, certificate #4440).

Privacy

The data owner holds the keys

The Key Access Service releases keys only when the requester’s attributes meet the policy embedded in the object. Kong authenticates, routes and screens the request. It doesn’t decide what the data response contains.

More partners

Build on Data Harbor Platform

Open APIs and SDKs, the same ones Virtru uses to build its own products. Two paths in: the self-hosted platform, fully extensible with a partner ecosystem already on it, or the SaaS SDK for building protection into your own apps. Tell us what you’re building.