US Patent No. 9,965,869

SENSING LIGHT THROUGH A SURFACE WITH A RESIDUE


Patent No. 9,965,869
Issue Date May 08, 2018
Title Sensing Light Through A Surface With A Residue
Inventorship David John Evans, V, Palo Alto, CA (US)
Xinrui Jiang, San Jose, CA (US)
Andrew E. Rubin, Los Altos, CA (US)
Matthew Hershenson, Los Altos, CA (US)
Xiaoyu Miao, Palo Alto, CA (US)
Joseph Anthony Tate, San Jose, CA (US)
Jason Sean Gagne-Keats, Cupertino, CA (US)
Assignee ESSENTIAL PRODUCTS, INC., Palo Alto, CA (US)

Claim of US Patent No. 9,965,869

1. A method comprising:placing a light sensor beneath a dual-mode region of a display, the dual-mode region comprising a transparent mode allowing environment light to reach the light sensor and an opaque mode blocking environment light from reaching the light sensor, wherein the dual-mode region contains a residue;
displaying a predetermined pattern on the dual-mode region above the light sensor;
recording a first image of the predetermined pattern by the light sensor;
determining a position of the residue by detecting a pixel in the first image that is different from a corresponding pixel in the predetermined pattern, and including a position of the pixel in the first image into the position of the residue;
recording a stained image of environment surrounding the light sensor through the dual-mode region containing the residue; and
calculating a pixel in a resulting image of environment whose position is within the position of the residue based on a pixel in the stained image whose position is outside the position of the residue.