Leaders, lesson 9 of 11

Data rules: what may go to a model provider

3 min read

Who it's for

Engineering leaders who must say what data agents may see.

You'll be able to

Write a one-page data rule that people and agents both follow.

Every prompt sends data somewhere. Decide in advance which data may go, so nobody decides it in the moment.

Four classes of data

Sort every piece of data into one of four classes. The class says where it may go.

ClassExamplesWhere it may go
PublicReleased code and docsAnywhere
InternalSpecs, plans, numbers, error detailsYour repositories and machines, and a model provider as allowed below
SecretKeys, passwords, tokens, private addressesOne machine, or a secret store. Never a repository
PersonalAnything about a real person: names, messages they wrote, health detailsOnly the system that needs it

If you are not sure which class something is, treat it as the stricter one. The rules apply to people and to agents alike.

The four classes of data, from most open to most closed. Public: released code and docs. Internal: specs, plans, numbers, error details. Both may go to a model provider.

Then the line. Below it, nothing goes to an outside model provider. Personal: anything about a real person, such as names, messages they wrote, health details; a model on your own machines may see it only in the product that needs it, never while building. Secret: keys, passwords, tokens, private addresses; it stays on one machine, or in a secret store, never in a repository, and goes to no model.

If you are not sure which class something is, treat it as the stricter one.

Where the line falls: Public and Internal data may go to a model provider; Personal and Secret data may not.

What may go to a model provider

DataA model on your own machinesAn outside model provider
Code, specs and docsYesYes
Internal data not about a personYesYes
Secret dataNoNo
Personal dataOnly in the product that needs it, never while buildingNo

The table decides what may be sent at all. It is not a list of what is safe once sent.

Never in a log

Logs and events hold IDs, counts, times, results and labels. They never hold:

  • secret data;
  • personal data;
  • the text of a user's message, or of a model's answer to a user;
  • the full text of a prompt.

Before a log leaves a developer's machine, a cleaning step keeps only the fields the log format knows and drops any line where the secret scan finds something. Recordings, screenshots and demos show made-up users and made-up conversations only.

How long you keep things

Retention is part of the rule, not an afterthought. One working example:

WhatKept for
Logs on a developer's machine30 days
Archived logs and CI results12 months
Recordings attached to pull requests90 days
The progress recordThe life of the project

Say who can read each one, too. Archived logs go to the project team. Secret data goes only to the people who run the machine that needs it.

Try it

Take the last week of your team's AI use. List five things someone pasted into a prompt. Put each in one of the four classes. If any was Secret or Personal, write your own version of the two tables above and share it with the team.

Get one lesson a week

Short and practical, from a factory people and agents really work in. Leave any time.