US Patent No. 10,782,664

PRODUCTION SYSTEM THAT SETS DETERMINATION VALUE OF VARIABLE RELATING TO ABNORMALITY OF PRODUCT


Patent No. 10,782,664
Issue Date September 22, 2020
Title Production System That Sets Determination Value Of Variable Relating To Abnormality Of Product
Inventorship Shouta Fujii, Yamanashi (JP)
Sou Saitou, Yamanashi (JP)
Assignee Fanuc Corporation, Yamanashi (JP)

Claim of US Patent No. 10,782,664

1. A production system comprising:a manufacturing machine that manufactures a product made of a plurality of components;
a machine state detector that detects a state of the manufacturing machine;
an environment state detector that detects an environment state around the manufacturing machine;
an inspection device that inspects the product manufactured by the manufacturing machine; and
a manufacturing management apparatus that is connected to a control apparatus of the manufacturing machine and a control apparatus of the inspection device, wherein
the manufacturing management apparatus includes:
a memory that stores data on the state of the manufacturing machine, data on the environment state, and data on an inspection result of the product;
a processor configured to access the memory to:
select a variable relating to an occurrence of an abnormality, wherein the selected variable is based on a correlation between the inspection result of the product, and the data on the state of the manufacturing machine and the data on the environment state when the abnormality occurs in the inspection result, wherein the variable is among a plurality of variables relating to the state of the manufacturing machine and to the environment state;
set an initial determination value of the selected variable relating to the abnormality;
update the initial determination value by reinforcement learning;
obtain the data on the state of the manufacturing machine, the data on the environment state, and the inspection results of the product corresponding to the abnormality;
set a reward for calculating an action value when the initial determination value is set based on the obtained data on the state of the manufacturing machine, data on the environment state, and the inspection result of the product;
update an action evaluation function of an action value table based on the obtained data and the set reward; and
set a new determination value of the selected variable based on the updated action evaluation function.