US Patent No. 11,030,753

IMAGE SEGMENTATION AND MODIFICATION OF A VIDEO STREAM


Patent No. 11,030,753
Issue Date June 08, 2021
Title Image Segmentation And Modification Of A Video Stream
Inventorship Igor Kudriashov, Saratov (RU)
Fedir Poliakov, Marina Del Rey, CA (US)
Maksim Gusarov, Marina del Rey, CA (US)
Assignee Snap Inc., Santa Monica, CA (US)

Claim of US Patent No. 11,030,753

1. A method comprising:determining, using one or more processors of a client device, an approximate location of an object of interest within a video stream comprising a first set of images and a second set of images;
identifying, by the one or more processors, an area of interest comprising a plurality of pixels within the one or more images of the first set of images, the area of interest being a portion of the one or more images encompassing the approximate location of the object of interest;
generating, by the client device a binarization matrix by performing operations comprising:
for each pixel of the plurality of pixels within the area of interest:
retrieving a set of color values associated with the pixel;
determining a binary value for the pixel by comparing a first value of a first portion of the set of color values with a second value of a second portion of the set of color values;
storing the binary value for the pixel in the binarization matrix;
modifying each pixel in the plurality of pixels within the area of interest using the binarization matrix to create a binarized area of interest;
identifying, by the one or more processors, a first set of pixels and a second set of pixels within the binarized area of interest; and
modifying, by the one or more processors, a color value for the first set of pixels within the second set of images of the video stream.