A model trained on support tickets, applicant records, or a scraped social feed does not store those rows in a tidy table. It absorbs them statistically, which means you cannot search for a person's email address and delete it. Privacy work for training therefore happens before the data reaches the training job, and in the notices, contracts, and logs that surround it. What follows is a practical baseline under the GDPR and the California Consumer Privacy Act, as amended. It is orientation, not legal advice.
Start With an Inventory, Not a Dataset
Before anyone exports a CSV, write down what you hold: which categories of personal data, from which sources, for which purpose, kept how long, and shared with whom. Under the GDPR this is your record of processing activities; in California you must be able to tell consumers the categories you collected and why.
For each dataset, name the source — signup form, CRM export, licensed vendor, public web — plus the fields it contains and the training purpose. "Improve our services" fails the purpose limitation test. If two datasets serve different purposes, keep them apart rather than pooling everything into one lake. A five-column spreadsheet someone actually updates beats a wiki page nobody reads, and every dataset gets one named owner.
An example row might read: "Support tickets, source: Zendesk export, fields: customer name, email, issue text, resolution notes, category label. Purpose: train a topic classifier for routing. Retention: 24 months. Shared with: annotation vendor under DPA." That level of specificity makes the next steps possible. Without it, you cannot assess lawful basis, minimisation, or deletion obligations.
Fix and Document a Lawful Basis
European processing needs a basis: consent, contract, legal obligation, vital interests, public task, or legitimate interests — the last of which requires a documented balancing test rather than a shrug. Training is often run on consent or legitimate interests. Consent must be specific, informed, and as easy to withdraw as to give; a blanket box permitting "any use" does not qualify. Health data, biometrics, ethnicity, and similar categories demand more.
For legitimate interests, write down the test: what is the interest, why is processing necessary, and how do you balance it against the individual's rights and expectations? A model that predicts churn from usage logs is one thing; a model that infers health status from purchase history is another. Document the safeguards that tip the balance, such as pseudonymisation, aggregation, and a short retention period.
California's framework leans on disclosure. Tell people at or before collection which categories you take, why, whether you sell or share them, and how long you keep them. If model output shapes decisions about them — pricing, eligibility, ranking — say so plainly. Record who approved each basis and when it was last reviewed.
Minimise Before You Train
Data minimisation is a step in the pipeline, not a cleanup at the end.
- Drop what you do not need. Names, emails, free-text notes, device IDs, precise location — if a coarser label answers the question, use it.
- Pseudonymise. Swap direct identifiers for tokens and keep the mapping table in a separate, access-controlled store. Pseudonymised data is still personal data, so requests still apply.
- Consider aggregation or differential privacy where the task allows. These lower risk; they do not automatically take you out of scope.
- Flag sensitive fields — health, biometrics, ethnicity, union membership, precise geolocation, government IDs, log-in credentials — and justify each one or remove it.
- Quarantine oddities. A single unusual record is memorable, and memorable records are the ones that leak.
Rule of thumb: no dataset enters training until someone other than the person who wants to train on it has signed off on the minimisation pass.
For instance, a free-text field like "additional comments" might contain a customer's medical history or a threat of self-harm. Either redact it or drop the column entirely. If you need sentiment, train on a coarse positive/negative label rather than the raw text. Similarly, replace exact ages with age brackets, and ZIP codes with state or region unless the model truly needs granularity.
A Checklist Reviewers Can Sign
Before training
- Lawful basis recorded; balancing test signed where required.
- Notice or consent text live and matching this exact use.
- Minimisation pass complete and independently reviewed.
- Retention set for raw data and derived artifacts.
- Data protection impact assessment completed for high-risk work: large-scale profiling, sensitive data, vulnerable people.
- Vendor DPAs and cross-border transfer mechanisms in place.
While training
- Least-privilege access and access logs; no training copies on personal laptops.
- Versioned datasets with a short note on what changed between versions.
- Field-level record of what was used, so you can answer "what do you hold about me?"
- Encryption at rest and in transit for all training data and artifacts.
After training
- Mapping tables stored separately and treated as sensitive assets.
- Model documentation: intended use, limits, known failure modes.
- A deletion plan — a retraining cycle, or targeted removal you have actually tested.
- Retention schedule for model weights, checkpoints, and evaluation logs.
Deleted from the raw file is not the same as gone from the model. Treat those as two separate problems with two separate owners.
Make Rights Requests Work in Practice
European law gives access, correction, deletion, restriction, portability, objection, and safeguards around decisions made without human involvement that have significant effects. California gives the right to know, delete, correct, opt out of sale or sharing, limit use of sensitive personal information, and non-discrimination. You need a verified request workflow with a 30-day GDPR clock and a 45-day CCPA clock (extendable in some cases).
When someone requests deletion, you must delete from raw datasets and stop using their data for future training. Deleting from an already trained model is technically hard. Be honest in your response about what you can and cannot do. If you cannot remove a single record's influence, document that limitation and offer to retrain if feasible or explain why it is not. Do not promise "complete deletion from the model" unless you have a tested method.
Also, handle opt-out of sale or sharing: if you share data with a model vendor or ad tech partner, that may count. Honor Global Privacy Control signals. For sensitive data, offer a limit-use option. Train your support team on scripts that do not overpromise.
Vendor and Contract Hygiene
Most training pipelines involve third parties: data labelers, cloud providers, pretrained model vendors, and analytics tools. Each one needs a data processing agreement (DPA) under GDPR and a service provider contract under CCPA. The DPA must specify purpose limitation, confidentiality, security measures, subprocessor rules, and assistance with rights requests. If data leaves the EEA, you need a
Photo: Hans / Pixabay
Related posts
More stories you’ll love reading