Skip to main content

Network-level governance of generative AI

Network-level governance inspects traffic to generative AI services and applies policy before a request reaches its destination.

Your workforce uses generative AI (GenAI) tools with or without your approval. Use network-level GenAI governance to see that use and act on it, without blocking it.

What is network-level governance of generative AI

Network-level GenAI governance inspects traffic bound for GenAI services. It applies policy to each request before that request reaches its destination. F5 Workforce AI Security governs public GenAI services, such as ChatGPT and Microsoft Copilot. It also governs private models your company runs in its own cloud.

It is neither a block list nor a secure access service edge (SASE). If you block a public GenAI service outright, you lose insight into how your workforce uses it. A SASE policy can allow or block a whole GenAI domain by URL category. It can't read the prompt inside a request.

Workforce AI Security reads that content. It then applies policy to the single request, not the whole domain. It runs alongside your SASE stack rather than replacing it.

This document covers three things:

  • How traffic reaches the platform.

  • How Workforce AI Security identifies a user.

  • How policy applies.

For setup steps, see Initial configuration steps.

How generative AI traffic reaches the platform

Traffic steering sends only GenAI domains to Workforce AI Security. Other web traffic follows its typical path. Workforce AI Security supports three steering methods:

  • Your SASE platform runs TLS interception, then forwards GenAI traffic to Workforce AI Security. Vendors call this forward proxy chaining, or forward-to-proxy. This is the preferred method.

  • Your SASE platform forwards GenAI traffic without upstream TLS interception. Endpoints must trust the Workforce AI Security root certificate authority (CA).

  • Endpoints use a proxy auto-configuration (PAC) URL. It sends only GenAI domains to the Workforce AI Security TLS proxy. You distribute the PAC file with your device management tool.

How Workforce AI Security identifies the user

Workforce AI Security must identify the user behind a request. Without an identified user, it can't apply a Group Policy or record the request against a person. It either receives an identifier with the request, or it prompts the user to log in.

Most SASE vendors' forward-to-proxy policies support adding an X-Authenticated-User header to a forwarded request. Workforce AI Security accepts that header. When all three of these hold, the platform authenticates the request without a prompt:

  • The header reaches the platform.

  • Your tenant has the matching SASE connector set up.

  • The request comes from a known IP address of that SASE vendor.

A proxy PAC deployment sets authentication on the Proxy connector instead. Your choice of setting changes what User Activity records:

  • User prompts every user. Native traffic and desktop apps don't work, because their traffic can't be redirected to authenticate.

  • Connector never prompts. Native traffic and desktop apps work. User Activity records the connector in place of the user, so it captures no username.

  • User with Connector prompts a user in a web browser and leaves native traffic and desktop apps working. This is the recommended setting.

How policy applies

Every tenant has one Default Policy, and it covers all users. Group Policies are additive. Each one grants a named group more access than the Default Policy allows, and never less.

Directory Sync imports users and groups from your directory service. It uses the System for Cross-domain Identity Management (SCIM) protocol. You then assign a Group Policy to a group rather than tracking each person by hand.

Inside a policy, the Public Service Catalog sets which GenAI services a user can reach.

Content Controls check a request for High-risk Request, Confidential Data, Programming Language, Harmful Content, and Prompt Injection.

PII Detection checks for personally identifiable information (PII) separately, entity by entity. Its entities cover data such as Phone Number, Credit Card, Email Address, and IP Address.

Each control carries its own action: Monitor, Warn, Tag, Mask, Delete, Synthesize, or Block.


Use cases

See how your workforce uses generative AI before you enforce policy

You run a new tenant and you don't yet know how your workforce uses GenAI. A new tenant monitors GenAI traffic and logs violations by default. That changes nothing about what a user can do. You review User Activity for single sessions. You review Insights for adoption and risk trends. When the data supports a decision, you move a control from Monitor to an action that changes the request.

Keep sensitive data out of public generative AI services

You need to stop confidential data and PII from reaching a public GenAI service. Content Controls and PII Detection read the request before it leaves your environment. Each control has its own action. You can mask or delete one value and let the rest of the request continue. You don't have to block the user.

Give one team broader access than the rest

Your engineering team needs GenAI services that the rest of the company must not reach. Directory Sync imports the Engineering group from your directory service. You assign a Group Policy to that group. That policy adds those services on top of the Default Policy. Everyone else stays on the Default Policy alone.


Comparison

Network-level GenAI governance adds controls that a SASE platform doesn't provide on its own.

SASE-only controls

Workforce AI Security

Service access

Domain allow or block, by URL category

Per-service allow or block, through the Public Service Catalog

Prompt and response content

Limited or no inspection

Inspection by Content Controls and PII Detection, before the request reaches its destination

Sensitive data handling

Data loss prevention (DLP), generic and varying by vendor

Entity-based PII Detection, with actions from Monitor to Block

Policy response

Allow or block

A Monitor, Warn, Mask, or Block action, per group

Activity records

Web access logs

Session-level records in User Activity, exportable to a bucket you own in Amazon Simple Storage Service (S3)

Private model access

No equivalent

Routing to your private models, through the Gateway and Model Router

Best for

Control of general web access

Traffic, content, and data specific to generative AI services


References

For more information, see:

Did this answer your question?