A camera beside original and varied component samples.
All notes

Industrial AI

Synthetic data for visual inspection explained

Learn how synthetic data supports visual inspection training, why generated variation can help, and why real test evidence still matters.

Synthetic data are generated observations rather than direct recordings of the target environment. For visual inspection, a team can render images with known object positions, lighting and surface properties, then use them during model development.

Generated variation can fill a training gap. It can also reproduce the assumptions of the scene generator instead of the conditions the camera will encounter.

NVIDIA's published tutorial demonstrates this using rendered soda cans. It varies scene properties, trains an object detector and tests with real objects. The tutorial describes a development workflow; it does not establish a general factory defect-detection rate.

Separate three jobs in the dataset

Dataset role What it supports Boundary to preserve
Synthetic training examples Teach the model selected variations Their variety is limited by the generator and its assumptions
Development checks Investigate failures and choose changes Repeated use makes these part of development
Independent real evaluation Assess performance on representative captured observations Keep it outside training and model selection

Once a team uses a test failure to redesign the generator, that test has informed development. Retain a later independent evaluation for the revised model.

The data-leakage guide explains the same boundary for preprocessing and feature selection.

Keep generated training and real tests distinctNVIDIA can-detection tutorial workflow; independent real evaluation has a separate role.Keep generated training and real tests distinctGenerated trainingScene variations andknown syntheticlabelsDevelopmentFit, inspect andreviseReal evaluationIndependent capturedobservationsUsing evaluation failures to revise the generator makes them part ofdevelopment. Retain a separate final evaluation.
Generated training variation and independent real evaluation serve different purposes. The published can-detection tutorial supplies the workflow context, not a production performance benchmark.

Check what the scene actually represents

A renderer can vary camera pose, lighting, object position and material. The team must still establish which variations correspond to the process being inspected.

A visually convincing defect is not automatically a physically plausible defect. Check the defect definition with people who understand the material and failure mode. Retain the generator version and the parameters that produced each image.

The labelling guide covers the target definition. A generated label can be exact relative to the virtual scene while still describing the wrong target for production.

Test the complete inspection task

A detector trained to locate cans has not thereby been validated to detect cracks, read a code or judge a seal. Match the evaluation to the required output.

Use independent captured examples covering relevant products, operating states and defects. Record performance separately for important defect categories; a combined measure can conceal a weak category.

The inspection business case shows why the rate of good parts flagged matters alongside defects caught. Generated examples selected to contain many defects do not establish how often each outcome occurs in ordinary production.

Keep the evidence beside the model

Retain which data were generated, which were captured and how each entered training, development or final evaluation. Include generator changes in the model release record.

Approve the inspection on representative real evidence for the intended task. Treat synthetic data as one development input, with its assumptions visible, rather than as a replacement for that acceptance evidence.

Sources

NextTWI job instruction: four steps to teach work

Discuss an operations problem

I work with operations and transformation teams on operational excellence, digital transformation programs, supply chains and industrial AI. Send me the problem you’re working on and the result you need.

Abolfazl ShirkavandImage preview unavailable