A process vessel, valve and connected control loop.
All notes

Industrial AI

Reinforcement learning in manufacturing

Learn reinforcement learning through process control. Separate observations, actions, rewards and the constraints needed before a plant trial.

Reinforcement learning trains a decision policy using feedback from actions. The policy receives observations, chooses an action and receives a reward that guides later learning.

A good reward score means the policy performed well against the defined reward in the tested conditions. It does not establish that the reward captured every operating requirement.

MathWorks' process-control demonstration describes using reinforcement learning for a multiple-input, multiple-output control problem. That is a control-design example, not evidence that an untested policy can safely learn by experimenting on a production plant.

Identify what the policy is allowed to change

Separate the observed state, permitted actions, reward and limits. These describe different parts of the design.

Part of the task What to specify
Observations Signals available when the policy chooses an action
Actions Commands the policy may issue and their permitted range
Reward How training evaluates the consequence of an action
Constraints Conditions the design must preserve, including those outside the reward
Episode and reset How a training run starts, ends and returns to a defined condition

A controller can learn to exploit an incomplete reward. Review what the score leaves out before increasing the policy's authority.

Specify the loop and its independent limitsObservations feed a policy. Actions affect the process. Constraints and fallback remain separate.Specify the loop and its independent limitsProcess orsimulatorProducesobservationsPolicyChooses permittedactionAction and consequenceConstraintsLimits andfallbackTraining also supplies a defined reward.A deployed fixed policy is different from continuing to update it online.
Observations, actions and rewards form a learning loop. Independent constraints and the boundary between training and operation remain separate design requirements.

Use simulation without mistaking it for the plant

Simulation can let engineers explore actions without exposing production equipment to each training attempt. Its value depends on which behaviour the model represents and where it differs from the operating system.

The digital twin and simulation guide explains why a model's connection to live records does not by itself validate every use of that model.

Test the policy against relevant disturbances, input faults and operating conditions. Compare it with an appropriate existing control method on the same task. A favourable training result on the original simulator is insufficient evidence for deployment.

Keep learning and operating authority explicit

A deployed policy can remain fixed while it selects actions. That is different from continuing to update the policy online. Identify which design the supplier proposes.

Changes to the policy need versioned evidence and an approved release process. The MLOps guide covers that continuing work. For physical control, the IT/OT guide adds the equipment, operating-window and recovery considerations.

Before a plant trial, document the available actions, independent limits, fallback controller and conditions that stop the trial. Test those protections separately from the reward score. The control team needs evidence that the policy can be contained when its assumptions fail.

Sources

NextRemaining useful life: reading the estimate

Discuss an operations problem

I work with operations and transformation teams on operational excellence, digital transformation programs, supply chains and industrial AI. Send me the problem you’re working on and the result you need.

Abolfazl ShirkavandImage preview unavailable