US Patent No. 10,169,718

SYSTEM AND METHOD FOR DEFINING AND USING DIFFERENT LEVELS OF GROUND TRUTH


Patent No. 10,169,718
Issue Date January 01, 2019
Title System And Method For Defining And Using Different Levels Of Ground Truth
Inventorship James W. Murdock, IV, Amawalk, NY (US)
Stephan J. Roorda, Fuquay-Varina, NC (US)
Mary D. Swift, Rochester, NY (US)
Assignee International Business Machines Corporation, Armonk, NY (US)

Claim of US Patent No. 10,169,718

1. A computer-implemented method comprising:receiving, by a computing device, a first set of ground truth instances from a first source;
receiving a second set of ground truth instances from a second source;
weighting the first and second sets of ground truth instances differently based on a level of trust associated with each of the first and second sources; and
applying the weighted first and second sets of ground truth instances in a machine learning task executed by a computer, wherein applying the weighted first and second sets of ground truth instances in the machine learning task includes adjusting a loss function for at least one of the first and second sets of ground truth instances based upon, at least in part, the level of trust associated with each of the first and second sources, and at least one of a mean squared error and duplication of instances for the first set of ground truth instances over that of the second set of ground truth instances, wherein the first set of ground truth instances are more trusted than the second set of ground truth instances, and wherein a model is created by the duplication of instances for the first set of ground truth instances in a model data set to create a more effective model by more thoroughly reflecting more trusted data.