US Patent No. 10,838,211

MAINTENANCE SUPPORT DEVICE AND MAINTENANCE SUPPORT SYSTEM FOR FACTORY EQUIPMENT


Patent No. 10,838,211
Issue Date November 17, 2020
Title Maintenance Support Device And Maintenance Support System For Factory Equipment
Inventorship Hiroji Nishi, Yamanashi (JP)
Assignee FANUC CORPORATION, Yamanashi (JP)

Claim of US Patent No. 10,838,211

1. A maintenance support device, comprising:an image analysis unit configured to extract information indicating an operational state of a piece of factory equipment, by
detecting character regions and image regions in a real image captured by an image capture unit of a head-mounted display comprising a display unit configured to display an augmented reality image in which an additional image is superimposed on a real scene and the image capture unit configured to capture the real scene to acquire the real image,
taking out characters from the character regions, and
recognizing image patterns in the image regions;
a data storage unit configured to store the information indicating the operational state extracted by the image analysis unit;
a data analysis unit configured to determine whether or not an abnormality has occurred in the piece of factory equipment, based on the information indicating the operational state stored in the data storage unit; and
a display control unit configured to cause the display unit of the head-mounted display to display the augmented reality image in which the additional image is superimposed on the real scene, the additional image indicating maintenance information for the piece of factory equipment with respect to which the data analysis unit has determined that the abnormality has occurred, wherein
the data analysis unit is configured to
determine that the abnormality has occurred, in response to a difference between (i) a first change in the information indicating the operational state during a first time period and (ii) a second change in the information indicating the operational state during a second time period preceding the first time period being out of a predetermined range of difference, and
determine that the abnormality has not occurred, in response to the difference between (i) the first change and (ii) the second change being within the predetermined range of difference, and
the maintenance information for the piece of factory equipment is information on maintenance including at least one of replacing a component constituting a device, replacing tools, replacing provisions, replenishing consumables, changing design, emergency stop of a device or manufacturing line including the device, shutting down power supply, diversion operation, relocating devices and products, removing alien objects, adding to raw materials, adjusting temperature, adjusting humidity, adjusting atmospheric pressure, and cleaning.