FIELD GUIDE

Synthetic Data Is Not Automatically Private

Synthetic rows can reduce exposure to real records, but small datasets, memorization and linkage attacks may still reveal information about people.

Synthetic rows can reduce exposure to real records, but small datasets, memorization and linkage attacks may still reveal information about people.

What synthetic means

Synthetic data is artificially generated information designed to resemble or preserve selected characteristics of source data. It may be created without any real person, or produced by a model trained on sensitive records. Those processes have different privacy implications. Calling a dataset ‘fake’ does not establish that it contains no personal information or that an attacker cannot infer something about its sources.

Three privacy failure pathways

First, a generator may reproduce an unusual real record or a near duplicate. Second, a synthetic record may be linkable to external information about an actual person. Third, an attacker may infer whether a person’s record appeared in the original training set even without exact copying. Risk depends on training procedure, rarity, disclosure setting and attacker knowledge. A superficial change of names is not a robust anonymization test.

What a proper assessment examines

Document the original dataset, purpose of generation, any identifiers or quasi-identifiers, sampling strategy, transformations and the intended recipients. Test for duplicates, outlier disclosure, linkage and membership signals using a defensible threat model. Restrict access to the original training records and generated outputs pending review. Do not publish privacy scores without explaining the evaluation and residual uncertainty.

Privacy and utility conflict

The closer synthetic data match rare real cases, the more useful they may be for some research but the harder it can be to rule out disclosure. Stronger protection may erase minority patterns and degrade evaluations of fairness. Describe both risks. For demonstration or software testing, fully fictional records invented from a schema may be preferable to generation conditioned on actual customer data.

An example

A clinic replaces names in appointment history and asks an AI to generate believable visits. A rare combination of location, treatment and date could still identify someone. Instead of posting generated rows publicly, the clinic tests re-identification risk, minimizes detail and considers entirely simulated events for interface testing. Health-record use also raises jurisdiction-specific obligations beyond this general guide.

Regulatory context without overclaiming

The UK Information Commissioner’s Office explains that synthetic information outside the scope of identifiable individuals can be non-personal, but that conclusion depends on whether it can be related to identified or identifiable people. The European Data Protection Board likewise treats anonymity in AI models as a contextual assessment. Neither source supports the slogan that every synthetic dataset is exempt from privacy law worldwide.

A publishing checklist

State how the data were generated, which privacy and utility tests were performed, any prohibited uses, jurisdictional review status and who approved release. If re-identification testing has not been performed, retain ‘privacy not established’ as an explicit result rather than assuming compliance.

Sources & Further Reading

CONTINUE EXPLORINGExplore related files ↗