US Pat. No. 10,140,695

HEAD-MOUNTED COMPOUND DISPLAY INCLUDING A HIGH RESOLUTION INSET

Facebook Technologies, LL...

1. A head-mounted display (HMD) comprising:a high resolution (HR) inset display that is configured to display an inset region, the inset region comprising a high resolution (HR) inset portion of an image and a transitional portion of the image, the HR inset portion at a first resolution, and the transitional portion is blended such that there is a smooth change in resolution from the first resolution to a second resolution that is lower than the first resolution;
a peripheral display that is configured to display a background region, the background region having a second resolution that is less than the first resolution, the second resolution corresponding to a resolution of a non-fovea region of the human eye;
an eye tracking unit that is configured to detect movement of an eye of a user of the HMD;
an optics block configured to:
combine the inset region and the background region to create composite content, wherein the inset region is inset into the background region, and
direct the composite content to an exit pupil of the HMD corresponding to a location of the eye; and
a controller configured to:
receive, from the eye tracking unit, information related to movement of the eye,
determine, based on the information, a gaze direction of the user representing an axis between a fovea of the eye of the user and a center of a pupil of the eye, and
send steering instructions to a steering element of the optical block to adjust a position of the inset region relative to the background region such that the inset region is centered on the determined gaze direction.

US Pat. No. 10,175,414

CHANNEL CUT BACKLIGHT FOR LIQUID CRYSTAL DISPLAY

Facebook Technologies, LL...

1. A liquid crystal display (LCD) device, comprising:a LCD panel including a first panel portion and a second panel portion adjacent to the first panel portion;
a backlight for illuminating the LCD panel, including:
a light guide including a top surface, a bottom surface, and a side surface, the light guide including an array of notches on the bottom surface to define an array of light channels along the side surface, the array of light channels including a first light channel and a second light channel adjacent to the first light channel; and
light emitting diodes (LEDs) disposed along the side surface of the light guide to emit light in a first direction into the array of light channels of the light guide, the first light channel receiving first light from a first LED and directing the first light in a second direction from the top surface of the light guide toward the first panel portion of the LCD panel, the second light channel receiving second light from a second LED and directing the second light in the second direction from the top surface of the light guide toward the second panel portion of the LCD panel; and
a controller configured to:
in a first time period, program the first panel portion;
in a second time period subsequent to the first time period, program the second panel portion while liquid crystals in the first panel portion transition states;
in a third time period subsequent to the second time period, control the first LED to emit the first light into the first light channel and toward the first panel portion while liquid crystals in the second panel portion transition states; and
in a fourth time period subsequent to the third time period, control the second LED to emit the second light into the second light channel and toward the second panel portion.

US Pat. No. 10,168,537

SINGLE CHIP SUPERLUMINOUS LIGHT EMITTING DIODE ARRAY FOR WAVEGUIDE DISPLAYS

Facebook Technologies, LL...

1. A source assembly comprising:a source element array comprising a super luminous diode (SLED) array of SLEDs that are arranged on a single chip, the SLED array configured to emit light; and
a scanning mirror assembly configured to scan the light to an entrance location of an output waveguide as scanned image light.

US Pat. No. 10,148,324

POSITIONAL TRACKING ASSISTED BEAM FORMING IN WIRELESS VIRTUAL REALITY SYSTEMS

Facebook Technologies, LL...

1. An apparatus comprising:a positional tracking system having built-in sensors, the positional tracking system configured to:
track, over a time period using the built-in sensors, a position of a head-mounted display (HMD) relative to the apparatus that wirelessly communicates with the HMD, and
generate positional information describing the tracked position of the HMD over the time period relative to the apparatus;
a beam controller configured to:
determine a change in the position of the HMD relative to the apparatus based on the positional information over the time period,
determine a directional beam of a plurality of directional beams of the HMD, based in part on the determined change, and
generate communication instructions identifying the determined directional beam; and
a transceiver configured to:
communicate directly with the HMD via a wireless channel, and
transmit the communication instructions to the HMD instructing the HMD to adjust a direction of wireless communication with the apparatus to the determined directional beam.

US Pat. No. 10,115,205

EYE TRACKING SYSTEM WITH SINGLE POINT CALIBRATION

Facebook Technologies, LL...

1. A method comprising:obtaining cornea information for an eye of a user, the cornea information including a radius of a corneal sphere of the eye and location of a center of the corneal sphere;
capturing one or more reflections of a pupil of the eye of the user while the user is viewing content displayed on a head-mounted display (HMD);
determining a shape of the pupil based on the one or more captured pupil reflections;
identifying a three-dimensional plane parallel to the pupil, the three-dimensional plane identified based on the obtained cornea information and the identified pupil shape;
identifying a ray originating from the three-dimensional plane and perpendicular to a surface of the corneal sphere;
determining a pupillary axis for the pupil of the user based on the identified ray; and
performing an optical action based in part on the determined pupillary axis.

US Pat. No. 10,181,200

CIRCULARLY POLARIZED ILLUMINATION AND DETECTION FOR DEPTH SENSING

Facebook Technologies, LL...

1. A depth camera assembly (DCA) comprising:a polarized light generator configured to illuminate a local area with polarized light in accordance with emission instructions, the polarized light generator comprising:
an illumination source configured to emit one or more optical beams,
a modulator configured to modulate the one or more optical beams based in part on the emission instructions to generate modulated light, and
a projection assembly configured to project the modulated light into the local area as the polarized light having a first polarization;
an imaging device configured to:
receive light from the local area, the received light including ambient light and a portion of the polarized light reflected from one or more objects in the local area,
reduce an intensity of the received light having polarization different from a second polarization to generate filtered light substantially composed of light of the second polarization, and
detect the portion of the polarized light reflected from the one or more objects in the local area having the second polarization using the filtered light; and
a controller configured to:
generate the emission instructions,
provide the emission instructions to the polarized light generator, and
determine depth information for the one or more objects based at least in part on the detected portion of the reflected polarized light.

US Pat. No. 10,178,457

AUDIO OUTPUT ASSEMBLY FOR A HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. A head-mounted display (HMD), comprising:a housing defining an enclosure having an aperture;
a speaker positioned within the enclosure, the speaker having a back side facing an interior surface of the housing and a front side facing away from the interior surface of the housing, a back volume defined between at least a portion of the housing and the back side of the speaker for enhancing sound generated by the speaker; and
a sound conduit having an end open to the enclosure and extending outside the housing through the aperture, the sound conduit having another end open toward a rear direction to transmit the sound generated by the speaker.

US Pat. No. 10,170,060

INTERLACED LIQUID CRYSTAL DISPLAY PANEL AND BACKLIGHT USED IN A HEAD MOUNTED DISPLAY

Facebook Technologies, LL...

1. A display device, comprising:a liquid crystal display (LCD) panel including at least a first group of pixel lines and a second group of pixel lines;
a backlight disposed behind the LCD panel to emit light toward the first and second groups of pixel lines;
a shift grating disposed between the LCD and the backlight, the shift grating configured to block the light from the backlight from reaching either the first group of pixel lines or the second group of pixel lines; and
a controller configured to:
while the shift grating is blocking the light from the backlight from reaching the first group of pixel lines, set the first group of pixel lines with first group line data for a video frame;
control the backlight and the shift grating such that the light from the backlight illuminates the first group of pixel lines when the first group of pixel lines are set with the first group line data;
while the backlight is illuminating the first group of pixel lines, the first group line data is set on the first group of pixel lines, and the shift grating is blocking the light from reaching the second group of pixels lines, set the second group of pixel lines with second group line data for the video frame; and
control the backlight and the shift grating such that the light from the backlight illuminates the second group of pixel lines and the shift grating blocks the light from reaching the first group of pixel lines when the second group of pixel lines are set with the second group line data.

US Pat. No. 10,211,371

SEMICONDUCTOR MODIFICATION PROCESS FOR CONDUCTIVE AND MODIFIED ELECTRICAL REGIONS AND RELATED STRUCTURES

Facebook Technologies, LL...

1. A fabrication process for electronic components, comprising:depositing a spreading layer on top of a GaN p-layer;
depositing a mask feature onto the spreading layer to form a structure with at least part of the structure protected by the mask feature, and at least another part of the structure not protected by the mask feature to form an unprotected mask region; and
processing the unprotected mask region to form an area with modified electrical characteristics from the GaN p-layer, wherein the processing includes:
exposing the structure having the mask feature to a plasma treatment;
removing the mask feature from the structure after exposing the structure to the plasma treatment and prior to annealing the plasma treated structure; and
annealing the plasma treated structure, wherein;
the at least other part of the structure not protected by the mask feature is exposed to the plasma treatment and forms a modified p-GaN region that blocks current flow due to the plasma treatment and annealing process; and
the at least part of the structure protected by the mask is shielded from the plasma treatment and forms a conductive contact after the annealing.

US Pat. No. 10,151,961

SWITCHABLE BRAGG GRATINGS FOR CHROMATIC ERROR CORRECTION OF PANCHARATNAM BERRY PHASE (PBP) COMPONENTS

Facebook Technologies, LL...

1. A Pancharatnam Berry Phase (PBP) color corrected structure comprising:a plurality of switchable gratings that are each configured to have an inactive mode to reflect light of a specific color channel, of a set of color channels, and transmit light of other color channels in the set of color channels, wherein the specific color channel is different for each of the plurality of switchable gratings, and to have an active mode to transmit light that is inclusive of the set of color channels; and
a plurality of PBP active elements that receive light output from at least one of the plurality of switchable gratings, and the plurality of PBP active elements are each configured to adjust light of a different color channel of the set of color channels by a same amount to output light corrected for chromatic aberration for the set of color channels.

US Pat. No. 10,140,955

DISPLAY LATENCY CALIBRATION FOR ORGANIC LIGHT EMITTING DIODE (OLED) DISPLAY

Facebook Technologies, LL...

1. A system comprising:an organic light emitting diode (OLED) display having a plurality of illumination elements organized in a two-dimensional array;
one or more photodiodes coupled to at least a portion of the illumination elements, the one or more photodiodes configured to
measure, for each illumination element in at least the portion of the illumination elements, a latency for that illumination element to illuminate image light of each of a plurality of brightness levels, and
measure, for each illumination element in at least the portion of the illumination elements, a time rise to reach each of the plurality of brightness levels;
a controller coupled to the one or more photodiodes, the controller configured to:
obtain, for each illumination element in at least the portion of the illumination elements, information about brightness levels associated with image light emitted from that illumination element for at least two consecutive video frames, and
determine, for each illumination element in at least the portion of the illumination elements, a driving signal based on the measured latency, the measured time rise and the information about brightness levels; and
a driver circuit coupled to the controller, the driver circuit configured to apply the determined driving signal to that illumination element.

US Pat. No. 10,168,466

CORNER CUT LIQUID CRYSTAL DISPLAY

Facebook Technologies, LL...

1. A liquid crystal display (LCD) device, comprising:an LCD panel including at least a first portion and a second portion adjacent to the first portion along a width dimension, the first portion having a first width along the width dimension and the second portion having a second width along the width dimension smaller than the first width; and
a backlight for illuminating the LCD panel, the backlight disposed behind the LCD panel and including:
a first light guide portion of a light guide disposed behind the first portion of the LCD panel, the first light guide portion having the first width along the width dimension;
a first light emitting diode (LED) disposed along a side surface of the first light guide portion to emit first light in a first direction along the first width of the first light guide portion, the first light guide portion receiving the first light from the first LED and directing the first light in a second direction toward the first portion of the LCD panel;
a second light guide portion of the light guide disposed behind the second portion of the LCD panel adjacent to the first light guide portion along the width dimension, the second light guide having the second width along the width dimension; and
a second LED disposed along a side surface of the second light guide portion to emit second light in the first direction along the second width of the second light guide portion, the second light guide portion receiving the second light from the second LED and directing the second light in the second direction toward the second portion of the LCD panel, wherein:
the first light guide portion includes a first variable thickness along the first width and the second light guide portion includes a second variable thickness along the second width; and
the first variable thickness decreases along the first width in the first direction more gradually than the second variable thickness decreases along the second width in the first direction.

US Pat. No. 10,127,732

STEREO-BASED CALIBRATION APPARATUS

Facebook Technologies, LL...

1. A method comprising:capturing a plurality of images of a virtual reality (VR) headset in a plurality of orientations;
for each orientation of the plurality of orientations of the VR headset:
receiving a signal output by an inertial measurement unit (IMU),
calculating expected orientation of the VR headset based on the received signal output by the IMU,
determining an actual orientation of the VR headset based on the plurality of captured images, and
comparing the actual orientation of the VR headset and the expected orientation of the VR headset;
generating calibration parameters for the plurality of orientations based on the comparison; and
storing the calibration parameters for the plurality of orientations of the VR headset, the calibration parameters usable to identify orientations of the VR headset during use of the VR headset.

US Pat. No. 10,177,196

REDUNDANCY IN INORGANIC LIGHT EMITTING DIODE DISPLAYS

Facebook Technologies, LL...

1. A method for manufacturing a display device comprising pixels, each pixel comprising sub-pixels, each sub-pixel configured to provide light of a given wavelength, the method comprising:performing, using a pick up tool (PUT), a first placement cycle comprising:
picking up first light emitting diode (LED) dies, the first LED dies including a first LED die including at least one LED emitter; and
placing the first LED dies on a substrate of the display device at locations corresponding to the pixels of the display device, the at least one LED emitter of the first LED die is placed at a location corresponding to a sub-pixel of a pixel;
determining a number of subsequent placement cycles based on a model that defines the number of subsequent placement cycles based on predicted device yields of a fabrication process for the first LED dies; and
performing, using the PUT, one or more subsequent placement cycles, a subsequent placement cycle comprising:
picking up second LED dies, the second LED dies including a second LED die including at least one second LED emitter; and
placing the second LED dies on the substrate of the display device at the locations corresponding to the pixels of the display device, the at least one second LED emitter is placed at a second location corresponding to the sub-pixel of the pixel.

US Pat. No. 10,107,950

FLEXIBLE LIGHT COMBINER BACKLIGHT USED IN A HEAD MOUNTED DISPLAY

Facebook Technologies, LL...

1. A liquid crystal display (LCD) device, comprising:an LCD panel; and
a backlight for illuminating the LCD panel, the backlight including:
an LED assembly, including:
a first color LED emitting a first light at a first wavelength;
a second color LED emitting a second light at a second wavelength; and
a flexible light combiner, the flexible light combiner including a flexible core including: a first light channel to transmit first light generated by the first color LED, a first end of the first light channel optically coupled with the first color LED; a second light channel to transmit second light generated by the second color LED, a first end of the second light channel optically coupled with the second color LED; and a light output terminal defined by second ends of the first and second light channels to output the first light and the second light, respectively, in a first direction, the light output terminal disposed behind the LCD panel along an edge of the LCD panel; and
a light guide configured to:
combine the first light and second light received from the light output terminal of the flexible light combiner into combined light; and
direct the combined light to the pixels of the LCD panel in a second direction to illuminate the LCD panel;
wherein:
the first color LED includes a first emission response time and the second color LED includes a second emission response time different from the first emission response time; and
the display device further includes a controller configured to adjust for the first emission response time being different from the second emission response time based on providing a first control signal to drive the first color LED and a second control signal to drive the second color LED, the first control signal including a timing offset relative to the second control signal.

US Pat. No. 10,209,523

APPARATUS, SYSTEM, AND METHOD FOR BLUR REDUCTION FOR HEAD-MOUNTED DISPLAYS

Facebook Technologies, LL...

1. An apparatus comprising:a display that displays consecutive frames;
a backlight that intermittently illuminates the display, with variable timing to render visible each of the consecutive frames;
a prioritization element that for each given frame within the consecutive frames, determines a field of interest within the display;
a control element that, for each given frame within the consecutive frames and responsive to the field of interest determined by the prioritization element for the given frame, controls a timing with which the backlight illuminates the display, such that the backlight illuminates the display after a display response time has passed for the field of interest within the display for the given frame and finishes illuminating the display before the field of interest within the display is modified for a subsequent frame.

US Pat. No. 10,209,524

FACIAL INTERFACE ASSEMBLIES FOR USE WITH HEAD MOUNTED DISPLAYS

Facebook Technologies, LL...

1. A facial interface assembly for use with a head mounted display having a display housing, comprising:a contoured spacer frame removably connectable to the display housing, including:
a forehead interface portion,
a pair of cheek interface portions,
and
one or more attachment mounts configured to mate with a housing of the head mounted display; and
a face gasket removably attached to the contoured spacer frame, including:
at least one foam layer, and
a fabric layer over the at least one foam layer,
wherein the contoured spacer frame has a depth for adjusting a distance between a user's face and the display housing.

US Pat. No. 10,203,566

ENHANCED SPATIAL RESOLUTION USING A SEGMENTED ELECTRODE ARRAY

Facebook Technologies, LL...

1. A device, comprising:a light intensity modulator array defining a two-dimensional array of pixels, the light intensity modulator comprising:
a first substrate with a two-dimensional array of electrodes, wherein:
the two-dimensional array of electrodes is arranged on the first substrate in a first direction and a second direction that is not parallel to the first direction; and
a respective electrode of the two-dimensional array of electrodes on the first substrate is distinct and separate from a first adjacent electrode and a second adjacent electrode of the two-dimensional array of electrodes on the first substrate, the first adjacent electrode being adjacent to the respective electrode in the first direction and the second adjacent electrode being adjacent to the respective electrode in the second direction;
a second substrate with one or more electrodes, wherein the second substrate is distinct and separate from the first substrate;
liquid crystal located between the first substrate and the second substrate, wherein the light intensity modulator array has a first surface and a second surface that is opposite to the first surface;
one or more light sources located on the first surface of the light intensity modulator; and
one or more detectors located on the first surface of the light intensity modulator, wherein a respective pixel of the two-dimensional array of pixels is configured to transmit light based on voltages applied to the two-dimensional array of electrodes arranged on the first substrate and the one or more electrodes for the second substrate so that light emitted by the one or more light sources is transmitted through the respective pixel from the one or more light sources located on the first surface of the light intensity modulator array to the second surface of the light intensity modulator array and light is transmitted through the respective pixel from the second surface of the light intensity modulator array to the one or more detectors located on the first surface of the light intensity modulator.

US Pat. No. 10,185,393

WAVEGUIDE DISPLAY WITH SPATIALLY SWITCHABLE GRATING

Facebook Technologies, LL...

1. A near-eye-display (NED) system comprising:an eye tracking system configured to track a location of an eye of a user of the NED;
a light source configured to emit an image light;
an output waveguide comprising:
an input grating configured to receive the image light emitted from the light source and expand the received image light in at least one dimension to transmit an expanded image light, and
a dynamic output grating comprising a plurality of liquid crystal (LC) pixels that are arranged in a two-dimensional array, the plurality of LC pixels including an active subset of LC pixels that are configured to out-couple the expanded image light from the output waveguide to the tracked location in accordance with switching instructions; and
a controller configured to generate the switching instructions and provide the switching instructions to the dynamic output grating.

US Pat. No. 10,110,330

RELAY SYSTEM CALIBRATION FOR WIRELESS COMMUNICATIONS BETWEEN A HEAD-MOUNTED DISPLAY AND A CONSOLE

Facebook Technologies, LL...

1. A calibration system for calibrating a relay coupled to a console and a head mounted device, comprising:a first path coupling a first antenna array of the relay and a second antenna array of the relay, the first antenna array for coupling with the console and the second antenna array for coupling with the head mounted display, the first path including a variable gain amplifier;
a second path between a single tone generator and the second antenna array,
a frequency mixer configured to combined a first signal on the first path and a second signal on the second path to generate a combined signal;
a baseband processor configured to measure a difference between the combined signal and the second signal, the difference between the combined signal and the second signal for controlling a gain of the variable gain amplifier.

US Pat. No. 10,254,507

DEVICES AND METHODS FOR ADJUSTING AN INTERPUPILLARY DISTANCE BASED ON ENCODED LIGHT PATTERNS

FACEBOOK TECHNOLOGIES, LL...

1. A device, comprising:a first light source device configured to transmit a first light in a first direction and a second light in a second direction that is distinct from the first direction; and
a first set of one or more lenses configured for directing the first light and the second light from the first light source device toward a first eye of a user, wherein the first light is spatially offset from the second light and one or more of the first light and the second light provide a cue for adjusting a location of the first set of one or more lenses.

US Pat. No. 10,203,506

APPARATUS, SYSTEM, AND METHOD FOR ADJUSTING HEAD-MOUNTED DISPLAY STRAPS WITH TELESCOPING ASSEMBLIES

Facebook Technologies, LL...

1. A head-mounted-display adjustment apparatus comprising:a telescoping assembly comprising:
a track;
a boss element that bears upon the track and that is loosely coupled to the track such that the boss element is liftable from the track by a limited distance; and
a slide that moves along the track, the slide comprising a catch that restrains the slide from moving along the track when the boss element bears upon the track;
a mount that couples the telescoping assembly to a head-mounted display; and
a strap comprising a distal section coupled to the head-mounted display and a proximal section coupled to the slide, such that the strap is extendable, via movement of the slide, away from the head-mounted display.

US Pat. No. 10,203,504

SCANNING WAVEGUIDE DISPLAY

Facebook Technologies, LL...

1. A waveguide display, comprising:a first light source configured to emit first image light within a first band of light in accordance with scanning instructions;
a second light source configured to emit second image light within a second band of light in accordance with the scanning instructions, the second band of light different from the first band of light;
a first source waveguide including a first entrance area and a first exit area, the first source waveguide configured to receive the first image light from the first light source at the first entrance area, expand the first image light in at least one dimension, and output a first expanded image light from the first exit area;
a second source waveguide including a second entrance area and a second exit area, the second source waveguide configured to receive the second image light from the second light source at the second entrance area, expand the second image light in at least one dimension, and output a second expanded image light from the second exit area,
an output waveguide including an input area and an output area, the output waveguide positioned to receive the first expanded image light emitted from the first source waveguide and the second expanded image light from the second source waveguide at the input area, and to output the first expanded image light combined with the second expanded image light as a polychromatic image from the output area; and
a controller configured to generate the scanning instructions and provide the scanning instructions to the first light source and the second light source.

US Pat. No. 10,198,978

VIEWING OPTICS TEST SUBSYSTEM FOR HEAD MOUNTED DISPLAYS

Facebook Technologies, LL...

1. An optical evaluation workstation comprising:an enclosure that encloses the workstation and is configured to block light from entering the workstation;
a contrast test target;
a light source configured to backlight the contrast test target with diffuse light, the light source comprising a light panel and a light diffuser, the light panel configured to generate light and positioned to illuminate at least a portion of the light diffuser, the light diffuser configured to substantially and evenly diffuse light received from the light source;
an optical element feed assembly configured to:
receive an optical element of a head mounted display (HMD), and
position the optical element at a first distance from the contrast test target, the first distance corresponding to a distance between an optics block in the HMD and an electronic display in the HMD;
a camera configured to capture one or more images of the contrast test target through the optical element, the camera at a second distance from the contrast test target, the second distance corresponding to a distance between an exit pupil of the HMD and the electronic display in the HMD, wherein the contrast test target is positioned between the light source and the camera such that the contrast test target is illuminated with diffuse light from the light diffuser; and
a control module configured to evaluate optical contrast of the optical element using the one or more images of the contrast test target.

US Pat. No. 10,180,720

HAND-HELD CONTROLLER WITH PRESSURE-SENSING SWITCH FOR VIRTUAL-REALITY SYSTEMS

Facebook Technologies, LL...

15. A virtual-reality system, comprising:a head-mounted display (HMD) configured to display an image of a hand; and
a hand-held controller, wherein:
the hand-held controller comprises a grip, a user-input surface, and a cage;
the user-input surface includes a user-input key that is mounted, at least in part, on the grip, wherein the user input key includes an analog pressure sensor;
the cage has a ring shape that is coupled to the user-input surface at first and second points, without the grip being interposed between the cage and the first point, and without the grip being interposed between the cage and the second point, wherein the cage includes a plurality of illumination sources on an outer surface of the cage; and
the hand-held controller is configured to sense pressure applied to the analog pressure sensor by a user holding the hand-held controller and wearing the HMD, wherein the HMD displays a degree of closing of the image of the hand in proportion to the pressure applied to the analog pressure sensor.

US Pat. No. 10,182,284

CONNECTOR ASSEMBLY FOR DETACHABLE AUDIO SYSTEM

Facebook Technologies, LL...

17. A connector assembly for use with an audio module mountable to a head strap, comprising:an outer plate structure having a first planar portion and a first strap supporting portion, the outer plate structure having an outer rim portion and a recessed receiving area, and a threaded attachment member projecting from the first planar portion;
a non-conductive insert in the recessed receiving area with a second planar portion substantially coplanar with the outer rim portion at the first planar portion, and a second strap supporting portion substantially coplanar with the outer rim portion at the first strap supporting portion, the second planar portion having a first aperture having the threaded attachment member extending through the first aperture and projecting beyond the second planar portion, the second planar portion having a spaced apart first and second hollow cylindrical bosses on opposing sides of the first aperture and projecting away from the second planar portion, wherein the first and second bosses and the threaded attachment member are arranged linearly;
a flex circuit in the receiving area between the first and second planar portions, the flex circuit having a first electrical contact portion aligned with the first boss, and a second electrical contact portion aligned with the second boss;
first and second spring-biased pogo pin connectors connected to the flex circuit, the first pogo pin connector electrically engaging the first electrical contact portion and having a retractable first tip portion projecting from the first boss, and the second pogo pin connector electrically engaging the second electrical contact portion and having a retractable second tip portion projecting from the second boss; and
a flexible strain relief member having a first relief portion connected to the outer plate structure adjacent to the a portion of the flex circuit and the first strap supporting portion, and a second relief portion extending away from the outer plate structure, the strain relief member having an internal channel extending through the first and second relief portions and configure to receive an electrical wire that can connect to the flex circuit.

US Pat. No. 10,152,121

EYE TRACKING THROUGH ILLUMINATION BY HEAD-MOUNTED DISPLAYS

Facebook Technologies, LL...

1. A headset comprising:a display element configured to display content to a user wearing the headset, the display element comprising a plurality of pixels including one or more tracking pixels and a plurality of content pixels, the one or more tracking pixels configured to provide tracking light and the plurality of content pixels configured to provide light corresponding to the displayed content, wherein the plurality of content pixels are further configured to provide the light corresponding to the displayed content during a first time period of an image frame, the first time period different from a second time period of the image frame when the one or more tracking pixels are configured to provide the tracking light;
an optics block configured to direct light from the display element to an exit pupil of the headset; and
a camera configured to capture one or more images of an eye of the user in response to projecting the tracking light on the eye, the one or more captured images comprising a distortion of the projected tracking light and used in determining an orientation of the eye at a time of capturing the one or more images of the eye.

US Pat. No. 10,257,507

TIME-OF-FLIGHT DEPTH SENSING FOR EYE TRACKING

Facebook Technologies, LL...

1. An eye tracking system comprising:an illumination source configured to illuminate an eye with an irradiance pattern producing a distorted illumination pattern after reflection of the irradiance pattern from one or more surfaces of the eye;
a detector including a plurality of pixels, the detector configured to capture the distorted illumination pattern at one or more pixels of the plurality of pixels, each pixel having a plurality of storage units that capture light signals related to the distorted illumination pattern over a plurality of time instants; and
a controller configured to:
determine one or more phase differences between the distorted illumination pattern and the irradiance pattern, based on the light signals captured in the storage units of the one or more pixels,
calculate one or more distances from the detector to the one or more surfaces of the eye, based on the determined one or more phase differences, and
estimate a position and orientation of the eye based on the determined one or more distances.

US Pat. No. 10,209,412

DISPLAY WITH MULTILAYER DIFFRACTIVE OPTICAL ELEMENTS

Facebook Technologies, LL...

1. A display headset comprising:an electronic display configured to emit image light in a first direction toward an exit pupil corresponding to a location of an eye of a user; and
an optics block configured to direct the image light from the electronic display to the exit pupil, the optics block comprising:
a first diffractive optical element between the exit pupil and the electronic display having a first diffractive surface facing away from the electronic display;
a second diffractive optical element positioned between the first diffractive optical element and the exit pupil, and having a second diffractive surface facing the first diffractive surface and away from the exit pupil;
a first protective layer to protect the first diffractive optical element, disposed on and covering the first diffractive surface of the first diffractive optical element facing the second diffractive optical element; and
a second protective layer to protect the second diffractive optical element, disposed on and covering the second diffractive surface of the second diffractive optical element facing the first diffractive optical element, the first protective layer and the second protective layer to compensate for a variation in a diffraction efficiency at different wavelengths and incident angles of the image light, and
wherein each of the first diffractive optical element, the second diffractive optical element, the first protective layer, and the second protective layer at least partially overlap with each other along a second direction substantially parallel to the electronic display, and intersect with center line that is substantially perpendicular to a surface of the electronic display extending from the surface of the electronic display to the exit pupil,
such that the image light emitted from the electronic display travels through the components of the optics block in the order of the first diffractive optical element, the first protective layer, the second protective layer, and the second diffractive optical element to reach the exit pupil.

US Pat. No. 10,207,403

ROBOTIC PLATFORM AND ASSEMBLY

Facebook Technologies, LL...

1. A robotic platform, comprising:a chassis having oppositely disposed top and bottom sides, a fore end and an aft end;
a drive assembly arranged on the chassis, the drive assembly comprising a drive motor and a drive belt that is controlled by the drive motor; and
a pair of fore wheel assemblies disposed on the fore end of the chassis and a pair of aft wheel assemblies disposed on the aft end of the chassis, each of the fore and aft wheel assemblies comprising:
a caster wheel mounted to an axle for rotation about a drive axis and steering about a substantially vertical steering axis, and
a drive shaft extending along the steering axis from a first drive shaft end to a second drive shaft end, the first drive shaft end being connected to the axle and the second drive shaft end being wrapped by the drive belt such that the drive belt controls rotation of the drive shaft about the steering axis.

US Pat. No. 10,209,202

OPTICAL CHARACTERIZATION SYSTEM FOR WIDE FIELD OF VIEW DIFFRACTIVE OPTICAL ELEMENTS

Facebook Technologies, LL...

1. An optical characterization system comprising:a camera assembly including a plurality of optical heads, the optical heads including a camera and an integrating sphere, the camera assembly configured to measure different portions of a structured light pattern in accordance with imaging instructions, the structured light pattern generated by a diffractive optical element (DOE) under test, and the structured light pattern having a field of view that is larger than a field of view of the camera assembly, and each measured different portion of the structured light pattern is captured at a same radial distance from a reference point on the DOE under test; and
a workstation configured to:
provide the imaging instructions to the camera assembly, the imaging instructions causing the camera assembly to use the camera head to capture images of the different portions of the structured light pattern,
stitch the captured images together to form a pattern image, wherein the pattern image is a single image of the entire structured light pattern, and
characterize performance of the DOE under test using the pattern image and a performance metric.

US Pat. No. 10,209,738

APPARATUS, SYSTEM, AND METHOD FOR ADJUSTING HEAD-MOUNTED-DISPLAY STRAPS

Facebook Technologies, LL...

1. A head-mounted-display adjustment apparatus comprising:a spring with a restoring force that is, within an elastic limit of the spring, substantially disproportional to deflection of the spring;
a mount that couples the spring to a head-mounted display; and
a strap comprising a distal section coupled to the head-mounted display and a proximal section coupled to the spring such that:
the strap is extendable, via deflection of the spring, away from the head-mounted display, and
when a user is wearing the head-mounted display, the restoring force of the spring holds, via the strap, the head-mounted display against the user's face.

US Pat. No. 10,198,032

PASSIVE LOCATORS FOR A VIRTUAL REALITY HEADSET

Facebook Technologies, LL...

1. A virtual reality (VR) headset comprising:an electronic display configured to present content to a user of the VR headset; and
a plurality of marker groups, each marker group corresponding to a different location on the VR headset and comprising one or more passive locators having positions relative to each other, each passive locator having a respective reflectance type, that identities a band of light of a plurality of different bands of light, and the band of light is reflected by the passive locator, and each marker group has a unique reflectance configuration that describes a spatial configuration of the one or more passive locators within the marker group and one or more reflectance types of the one or more passive locators within the marker group.

US Pat. No. 10,191,565

ALIGNING COORDINATE SYSTEMS OF TWO DEVICES BY TAPPING

Facebook Technologies, LL...

1. An apparatus for aligning coordinate systems of interacting devices, the apparatus comprising:a first interface circuit configured to receive a first sensor signal from a first accelerometer of a head mounted display that is configured to display images in accordance with a first coordinate system, the first sensor signal representing a first impact on the head mounted display responsive to tapping of the head mounted display and a controller;
a second interface circuit configured to receive a second sensor signal from a second accelerometer of the controller that is configured to receive at least one user input associated with a second coordinate system, the second coordinate system misaligned with the first coordinate system prior to the tapping, the second sensor signal representing a second impact on the second device responsive to the tapping; and
a processor configured to:
determine a direction of the first impact represented by the first sensor signal;
determine a direction of the second impact represented by the second sensor signal; and
adjust at least one of the first coordinate system of the head mounted display or the second coordinate system of the controller according to the direction of the first impact and the direction of the second impact to reduce misalignment of the second coordinate system with the first coordinate system.

US Pat. No. 10,175,417

THICK BACKLIGHT FOR RGB LED OF A LIQUID CRYSTAL DISPLAY USED IN A VIRTUAL REALITY HEAD MOUNTED DISPLAY

Facebook Technologies, LL...

1. A liquid crystal display (LCD) device, comprising:an LCD panel;
a backlight for illuminating the LCD panel, the backlight including:
a plurality of light emitting diodes (LEDs) stacked vertically and disposed behind the LCD panel along one or more edges of the LCD panel, the plurality of LEDs including at least a first color LED and a second color LED emitting first light and second light at a first direction, respectively, at a first wavelength and a second wavelength, respectively, the first color LED including a first emission response time and the second color LED including a second emission response time that is different from the first emission response time; and
a light guide disposed behind the LCD panel and adjacent to the plurality of LEDs, the light guide configured to:
combine the first light and the second light received from the plurality of LEDs into combined light to illuminate the LCD panel; and
direct the combined light to the pixels of the LCD panel in a second direction; and
a controller configured to:
drive a lower efficiency color LED of the first and second color LEDs with a first current level and drive a higher efficiency color LED of the first and second color LEDs with a second current level lower than the first current level; and
drive the first color LED with a first pulsed signal and drive the second color LED with a second pulsed signal including a timing offset from the first pulsed signal to adjust for the first emission response time being different from the second emission response time and match timing of light emission output from the first color LED and the second color LED.

US Pat. No. 10,168,531

LIGHTFIELD WAVEGUIDE INTEGRATED EYE TRACKING

Facebook Technologies, LL...

1. An eye tracker comprising:one or more waveguides, wherein each of the one or more waveguides comprises an array of grating structures configured to selectively out couple light from that waveguide;
an array of light sources coupled to the one or more waveguides;
a detector coupled to the one or more waveguides; and
a controller coupled to the array of grating structures, the array of light sources, and the detector, the controller configured to:
instruct at least one light source in the array of light sources to emit at least one light beam that propagates through the one or more waveguides, and
activate at least one grating structure of the array of grating structures to out-couple the at least one light beam from the one or more waveguides toward an eye,
wherein the one or more waveguides in-couple one or more light signals reflected from at least one surface of the eye that originates from the at least one light beam out-coupled from the one or more waveguides, and the detector detects the one or more reflected light signals, and
the controller is further configured to
calculate one or more magnitudes of the one or more reflected light signals detected by the detector to obtain a signature of converted light signals, and
determine a position of the eye based on the signature of converted light signals.

US Pat. No. 10,163,360

NAVIGATION CONTROLLER FOR VIRTUAL-REALITY SYSTEMS

Facebook Technologies, LL...

1. A virtual-reality navigation controller, comprising:a base;
a seating portion, including:
a seat for supporting a weight of a user seated thereon; and
a back-rest coupled to the seat to move integrally with the seat and to support the user's back;
a displacement connector between the seating portion and the base to reciprocate the seating portion upwards and downwards, wherein the displacement connector includes a piston, a first check-valve, in the piston, having a first cross-sectional area, and a second check-valve, in the piston, having a second cross sectional area smaller than the first cross-sectional area;
wherein:
when the user ascends from the seat, the first check-valve is configured to open and the second check-valve is configured to close, thereby moving the seating portion upwards at a first speed as a compressible fluid in the displacement connector moves through the first check-valve in a first direction; and
when the user's body rests back on the seat, the first check-valve is configured to close and the second check-valve is configured to open, thereby moving the seat portion downwards at a second speed as the compressible fluid moves through the second check-valve in a second direction, opposite the first direction, the second speed being slower than the first speed.

US Pat. No. 10,154,254

TIME-OF-FLIGHT DEPTH SENSING FOR EYE TRACKING

Facebook Technologies, LL...

1. A head-mounted display (HMD) comprising:an electronic display configured to display content to a user wearing the HMD;
an optical assembly configured to direct light from the electronic display to an exit pupil of an eye of the user;
an illumination source configured to illuminate the eye with a temporally varying irradiance pattern producing a temporally distorted illumination pattern on at least a portion of the eye;
an imaging device configured to capture the temporally distorted illumination pattern that is associated with the portion of the eye, the imaging device including a detector comprising a plurality of pixels, each pixel is associated with multiple storage units for capturing light signals related to the temporally distorted illumination pattern captured in multiple time instants; and
a controller coupled to the imaging device, the controller configured to:
determine one or more phase differences between the temporally distorted illumination pattern and the temporally varying irradiance pattern, based on the light signals captured in the storage units associated with one or more pixels of the detector,
calculate one or more distances from the detector to one or more surfaces of the eye, based on the determined one or more phase differences,
update a model of the eye based on the determined one or more distances, and
estimate a position and orientation of the eye based on the updated model.

US Pat. No. 10,149,039

AUDIO HEADPHONES FOR VIRTUAL REALITY HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. An audio headphone to couple to a strap for a head-mounted display, the audio headphone comprising:a headphone speaker;
a strap connector; and
a four-bar linkage coupled to the strap connector to provide movement of the headphone speaker with respect to a user's ear, the four-bar linkage comprising:
a first member with a first end portion coupled to the strap connector via a first joint;
a second member with a first end portion coupled to a second end portion of the first member via a second joint;
a third member with a first end portion coupled to a second end portion of the second member via a third joint; and
a fourth member with a first portion coupled to a second end portion of the third member, and with first and second sides that are connected by the first portion and that extend to a second portion of the fourth member, wherein the first member is further coupled to the first and second sides of the fourth member via a fourth joint.

US Pat. No. 10,133,168

COMPACT LIGHT PROJECTION SYSTEM INCLUDING AN ANAMORPHIC REFLECTOR ASSEMBLY

Facebook Technologies, LL...

1. A light projection system comprising:a light source configured to emit image light;
a correction element configured to mitigate aberration; and
an anamorphic reflector assembly including a first surface and a second surface, the first surface configured to reflect the image light toward the second surface which reflects the reflected image light to output it from the anamorphic reflector assembly, and the first surface and the second surface are both curved and non-rotationally symmetric such that the light output from the anamorphic reflector assembly is collimated image light; and
wherein the collimated image light is optically corrected based in part on mitigation of aberration by the correction element.

US Pat. No. 10,121,823

LIGHT EMITTING DIODE CHIP

Facebook Technologies, LL...

1. An electronic display device, comprising:a light emitting diode (LED) chip, including:
a substrate; and
an array of LEDs on the substrate arranged in a plurality of rows along a longitudinal direction of the substrate, adjacent LEDs in a row of the array longitudinally offset by a longitudinal pitch that corresponds to multiples of a diameter of an LED in the row, LEDs in the row longitudinally offset from LEDs in an adjacent row of LEDs.

US Pat. No. 10,209,775

USING A MAGNETIC ACTUATION MECHANISM TO PROVIDE TACTILE FEEDBACK TO A USER INTERACTING WITH A VIRTUAL ENVIRONMENT

Facebook Technologies, LL...

1. A system comprisinga console coupled to an electronic display in a head mounted display, the console configured to provide content to the electronic display for presentation to a user; and
an input control comprising:
a glove configured to be worn on a hand of the user and coupled to the console, the glove including at least one joint portion configured to contain a joint of a finger of the hand of the user, the glove including a tendon extending across the joint portion of the glove, one or more magnets coupled to the tendon along a length of the tendon, the one or more magnets comprising electromagnets configured to be activated in response to receiving an instruction from the console, a strength of a magnetic field of an activated magnet specified by the instruction from the console based on a position of the finger of the hand of the user inserted into the glove relative to a reference position; and
one or more additional magnets fixed relative to the glove and oriented so magnetic fields from one or more magnets and from at least one or more of the additional magnets restrict movement of the tendon of the glove in a direction.

US Pat. No. 10,255,881

PRODUCTION CHARACTERIZATION OF PANEL AGING

Facebook Technologies, LL...

1. A method comprising:drive an electronic display under an input setting;
measure a first measurement of luminance of the electronic display while driving the electronic display under the input setting;
drive the electronic display with an input sequence;
drive the electronic display under a same input setting;
measure a second measurement of luminance of the electronic display while driving the electronic display under the same input setting;
determine one or more compensation factors for each subpixel of the electronic display by extrapolating a degradation curve based on the first luminance measurement, the second luminance measurement, and a previous characterization of a subpixel on a second electronic display; and
store the one or more compensation factors for use by a head-mounted display.

US Pat. No. 10,191,561

TRACKING CONTROLLERS OF A VIRTUAL REALITY SYSTEM

Facebook Technologies, LL...

1. A method comprising:receiving a first real-world image captured by an image tracking system remote to a user, the first real-world image including a first real-world view of a controller held by a user from a first perspective;
receiving a second real-world image captured by an imaging device located on a virtual reality (VR) headset worn by the user, the VR headset displaying a virtual environment to the user, the second real-world image captured at substantially the same time as the first real-world image, the second real-world image including a second real-world view of the controller from a second perspective different from the first perspective;
identifying a first set of features of the controller in the first real-world image, the first set of features representing locators on the controller depicted in the first real-world image;
identifying a second set of features of the controller in the second real-world image, the second set of features representing locators on the controller depicted in the second real-world image;
determining a pose of the controller using the first set of features and the second set of features, the pose specifying a location of the controller and further specifying a rotational orientation of the controller, wherein determining the pose of the controller comprises:
identifying a plurality of candidate poses of a virtual model of the controller,
performing a first set of comparisons between the first set of features in the first real-world image with each of a first plurality of virtual feature sets, each of the first plurality of virtual feature sets associated with one of the candidate poses from the first perspective,
performing a second set of comparisons between the second set of features in the second real-world image with each of a second plurality of virtual feature sets, each of the second plurality of virtual feature sets associated with one of the candidate poses from the second perspective,
identifying, based on both the first set of comparisons and the second set of comparisons, one of the plurality of candidate poses of the virtual model as being consistent with both the first set of features in the first real-world image and the second set of features in the second real-world image, and
determining that the pose of the controller is the identified candidate pose of the virtual model; and
responsive to determining the pose of the controller, performing an action within the virtual environment to update a position and orientation of a virtual object in the virtual environment controlled by the determined pose of the controller.

US Pat. No. 10,133,076

HYBRID FRESNEL LENS WITH REDUCED ARTIFACTS

FACEBOOK TECHNOLOGIES, LL...

1. A display device, comprising:a lens, defined by a first lens surface and a second lens surface opposite to the first lens surface, wherein:
a first portion of the first lens surface is defined by a smooth surface profile function;
a second portion of the first lens surface is defined by a Fresnel surface profile function;
the second portion of the first lens surface is around the first portion of the first lens surface;
the first portion and the second portion of the first lens surface are defined by a sum of two surface profile functions;
a first surface profile function of the two surface profile functions defines a smooth surface profile across the first portion and the second portion of the first lens surface;
the smooth surface profile defined by the first surface profile function corresponds to an aspheric curve; and
a second surface profile function of the two surface profile functions defines:
a smooth surface profile across the first portion of the first lens surface; and
a Fresnel surface profile across the second portion of the first lens surface; and
an array of light emitting devices coupled with the lens for outputting light through the lens.

US Pat. No. 10,161,791

MEASUREMENT OF DISPLAY CHARACTERISTICS OF ELECTRONIC DISPLAY PANEL USING OPTICAL TAPERS

Facebook Technologies, LL...

1. An apparatus for measuring characteristics of a display panel, the apparatus comprising:an array of optical elements, each of the optical elements comprising:
a first surface configured to receive light from a plurality of pixels of the display panel, the first surface facing the display panel and having a first area;
a second surface configured to emit light, the emitted light corresponding to a combined version of the light received by the first surface, the second surface facing away from the display panel and having a second area smaller than the first area; and
a light sensor facing the second surface of each of the optical elements to measure one or more parameters of the emitted light.

US Pat. No. 10,162,182

ENHANCED PIXEL RESOLUTION THROUGH NON-UNIFORM OCULAR PROJECTION

Facebook Technologies, LL...

1. A display device, comprising:a two-dimensional array of tiles, each tile comprising:
a two-dimensional array of pixels, wherein each pixel is configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light; and
a lens, of a two-dimensional array of lenses, configured to direct at least a portion of the respective pattern of light from the two-dimensional array of pixels to a pupil of an eye of a user; and
one or more processors coupled with the two-dimensional array of tiles and configured to:
obtain a transformed image for projecting a non-transformed image on a retina of the eye of the user, wherein the transformed image is distinct from the non-transformed image in that a first portion of the non-transformed image and a second portion of the non-transformed image have a same size and a first portion of the transformed image that corresponds to the first portion of the non-transformed image and a second portion of the transformed image that corresponds to the second portion of the non-transformed image have distinct sizes;
activate a first subset of the two-dimensional array of tiles for projecting, from the first subset of the two-dimensional array of tiles, the first portion of the transformed image on the retina of the eye of the user; and
activate a second subset of the two-dimensional array of tiles, that is distinct from the first subset of the two-dimensional array of tiles, for projecting, from the second subset of the two-dimensional array of tiles, the second portion of the transformed image, that is distinct from the first portion of the transformed image, on the retina of the eye of the user, wherein:
the two-dimensional array of lenses is configured to project, from the first subset of the two-dimensional array of tiles, the first portion of the transformed image with a first demagnification ratio and project, from the second subset of the two-dimensional array of tiles, the second portion of the transformed image with a second demagnification ratio that is distinct from the first demagnification ratio so that the first portion of the transformed image, when projected on the retina of the eye, has a first pixel resolution and the second portion of the transformed image, when projected on the retina of the eye, has a second pixel resolution that is distinct from the first pixel resolution.

US Pat. No. 10,231,053

BONE-CONDUCTION HEADSET WITH CROSSTALK CANCELATION FUNCTION

Facebook Technologies, LL...

1. A head-mounted display (HMD) comprising:a first bone conduction transducer configured to contact a user's first patch of skin in a first ear region, the first bone conduction transducer configured to transmit first vibrations responsive to receiving a first bone conduction signal;
a second bone conduction transducer configured to contact the user's second patch of skin in a second ear region, the second bone conduction transducer configured to transmit second vibrations;
a first vibration sensor separated from the first bone conduction transducer and configured to detect crosstalk vibrations responsive to transmitting of the first vibrations; and
a bone conduction signal generator configured to generate or update at least one parameter for modifying at least one of a second bone conduction signal for the first bone conduction transducer or a third bone conduction signal for the second bone conduction transducer.

US Pat. No. 10,197,459

INDEXABLE STRAIN SENSOR

Facebook Technologies, LL...

1. A deformation sensing system comprising:an elastic dielectric substrate;
a conductive element comprising
a plurality of conductive joints and a plurality of resolving elements positioned on a surface of the elastic dielectric substrate along a length of the conductive element, each conductive joint corresponding to a segment of the conductive element and separated from another conductive joint by a resolving element of the plurality of resolving elements;
an additional conductive element formed on the elastic dielectric substrate; and
a measurement circuit coupled to the conductive element and configured to:
apply a generated stimulus signal to the conductive element resulting in a capacitance between a conductive joint of the conductive element and the additional conductive element for each segment, and
measure a response signal corresponding to a change in the capacitance between one or more conductive joints of the conductive element and the additional conductive element in response to a strain being applied to one or more segments of the conductive element.

US Pat. No. 10,162,254

COMPACT LIGHT PROJECTION SYSTEM INCLUDING AN ANAMORPHIC REFLECTOR ASSEMBLY

Facebook Technologies, LL...

1. A system comprising:an anamorphic reflector assembly including a first reflective surface and a second reflective surface of a monolithic optical element, the first reflective surface configured to reflect image light toward the second reflective surface which reflects the reflected image light to output it from the anamorphic reflector assembly, and the first reflective surface and the second reflective surface are both curved and non-rotationally symmetric such that the light output from the anamorphic reflector assembly is collimated image light; and
a correction element configured to mitigate chromatic aberration based in part on the correction element having an Abbe number that is opposite in sign to an Abbe number of the monolithic optical element, and
wherein the collimated image light is optically corrected based in part on mitigation of chromatic aberration by the correction element.

US Pat. No. 10,228,727

ADJUSTABLE FRONT ASSEMBLY IN HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. A head-mounted display, comprising:a front end assembly located at a front portion of the head-mounted display;
a back end assembly located behind the front end assembly, wherein the back end assembly includes a facial interface assembly attached to a rear portion of the back end assembly, the facial interface assembly contoured to contact a user's face; and
a first adjustable arm between the front end assembly and the back end assembly, the first adjustable arm comprising:
a front end assembly link attached to the front end assembly to adjust tilting of the front end assembly relative to the back end assembly,
a back end assembly link rotatably coupled to the back end assembly, and
an interlink having an end coupled to the front end assembly link and another end rotatably coupled to the back end assembly link, the interlink adjusting a height of the front end assembly relative to the back end assembly.

US Pat. No. 10,228,565

VARIABLE FOCUS WAVEGUIDE DISPLAY

Facebook Technologies, LL...

1. A waveguide display, comprising:a light source configured to emit image light in accordance with scanning instructions;
a first source waveguide including a first entrance area and a first exit area, the first source waveguide configured to receive the image light from the light source at the entrance area, expand the image light in at least one dimension, and output a first expanded image light from the first exit area, a first curvature of the first source waveguide being adjustable;
an output waveguide including an input area and an output area, the output waveguide positioned to receive the first expanded image light emitted from the first source waveguide at the input area, and output the first expanded image light from the output area, a second curvature of the output waveguide being adjustable and orthogonal to the first curvature;
an actuator assembly including a first set of actuators and a second set of actuators and configured to adjust the first curvature of the first source waveguide and the second curvature of the second source waveguide, the first set of actuators configured to adjust the first curvature of the first source waveguide and the second set of actuators configured to adjust the second curvature of the second source waveguide; and
a controller configured to generate the scanning instructions and provide the scanning instructions to the light source and the actuator assembly.

US Pat. No. 10,194,225

STRAP ARM OF HEAD-MOUNTED DISPLAY WITH INTEGRATED AUDIO PORT

Facebook Technologies, LL...

1. A head-mounted display (HMD), comprising:a front rigid body;
a strap arm attached to a strap that secures the front rigid body to a user's head, the strap arm including:
a body portion defining a boss at a side of the body portion, the boss having an aperture, the boss rotatably connecting the strap arm to the front rigid body, the body portion further defining an audio passage to transmit sound from the aperture and an audio port to output the sound, the audio passage being defined along the body portion between the aperture of the boss and the audio port; and
a speaker positioned to emit the sound through the audio passage and to the audio port.

US Pat. No. 10,185,151

WAVEGUIDE DISPLAY WITH A SMALL FORM FACTOR, A LARGE FIELD OF VIEW, AND A LARGE EYEBOX

Facebook Technologies, LL...

1. An output waveguide comprising:a single waveguide body that includes a first surface and a second surface that is opposite to the first surface, the first surface and the second surface are parallel to the first dimension and the second dimension;
at least a first coupling element configured to receive an image light emitted from a light source assembly configured to emit image light and couple the received image light into the waveguide body, and the waveguide body expands the received image light in at least one dimension to transmit a first expanded image light;
a second decoupling element included as part of the waveguide body, and
a third decoupling element included as part of the waveguide body, and positioned opposite to the second decoupling element, each of the second decoupling element and the third decoupling element configured to expand the first expanded image light along a different dimension to form second expanded image light and output the second expanded image light to an eyebox at a distance from the waveguide body along a third dimension, the outputted image light encompassing the first angular range and the second angular range throughout the eyebox along the first dimension and the second dimension; and
a controller configured to generate display instructions and provide the display instructions to each of the one or more projectors of the light source assembly.

US Pat. No. 10,183,217

HAND-HELD CONTROLLER USING SEGMENTED CAPACITIVE TOUCH TRIGGER

Facebook Technologies, LL...

1. A hand-held controller comprising:a handle extending in a longitudinal direction, the handle shaped and dimensioned to be grasped by a user's hand; and
a trigger protruding from an outer surface of the handle and configured to move relative to the handle responsive to pressing of the trigger by a finger of the user's hand, the trigger comprising a touch surface configured to come into contact with the finger of the user's hand to detect sliding of the finger of the user's hand on the touch surface, wherein the touch surface comprises a plurality of segmented tracks configured to generate distinct sensor signals indicating which of the segmented tracks come in contact with the finger.

US Pat. No. 10,311,808

DISPLAY LATENCY CALIBRATION FOR LIQUID CRYSTAL DISPLAY

Facebook Technologies, LL...

1. A system comprising:a liquid crystal display (LCD) having a plurality of pixels;
a plurality of temperature sensors coupled to at least a portion of the plurality of pixels, each temperature sensor of the plurality of temperature sensors configured to measure a current temperature associated with at least one pixel in at least the portion of the plurality of pixels;
a storage medium configured to store transition information about latencies for a pixel of the LCD, each latency corresponds to a time period for transition from a defined start state to a defined end state for one temperature associated with the pixel, wherein the defined start state is related to an intensity of light emitted from the pixel in a first time instant and the defined end state is related to another intensity of light emitted from the pixel in a second time instant consecutive to the first time instant; and
a controller coupled to the plurality of temperature sensors and the storage medium, the controller configured to:
obtain frame information related to at least two consecutive frames of video content to be displayed on at least the portion of the plurality of pixels,
determine, based on the current measured temperature, the transition information and the frame information, a transition time for each pixel in at least the portion of the plurality of pixels to transition from a start state to an end state for the current measured temperature of that pixel, wherein the start state is related to a first intensity of light emitted from that pixel for a first frame of the at least two consecutive frames and the end state is related to a second intensity of light emitted from that pixel for a second frame of the at least two consecutive frames,
compute an effective liquid crystal (LC) transition time for at least the portion of the plurality of pixels as a longest time period of the determined transition times for all pixels in at least the portion of the plurality of pixels, and
calibrate at least the portion of the plurality of pixels of the LCD based on the effective LC transition time when the video content is displayed on at least the portion of the plurality of pixels.

US Pat. No. 10,241,545

DYNAMIC DISTORTION CORRECTION FOR OPTICAL COMPENSATION

Facebook Technologies, LL...

1. A head mounted display (HMD) comprising:an electronic display configured to present images to a user of the HMD;
an eye tracking unit configured to determine eye tracking information for one or more eyes of the user as the user views the images presented by the electronic display;
an optics block configured to modify the images presented by the electronic display when viewed by the user;
a distortion correction module configured to:
estimate one or more distortion values by inputting the eye tracking information and a state of the HMD into an optical model, wherein the HMD includes a plurality of states, and each state is associated with a different image plane for the electronic display,
determine an adjusted state of the HMD using one or more of the estimated distortion values, the eye tracking information, and the optical model, the adjusted state being different from the state, and
adjust the optical element in accordance with the adjusted state.

US Pat. No. 10,241,569

FOCUS ADJUSTMENT METHOD FOR A VIRTUAL REALITY HEADSET

Facebook Technologies, LL...

1. A method comprising:determining, using at least one image capturing element inside a head-mounted display (HMD), an eye position for each eye of a user, the HMD including an optics block configured to focus light from a display presenting a virtual scene to the user and a varifocal element configured to change a focal length of the optics block based on a viewing location within the virtual scene of the user;
determining gaze lines for each eye of the user based at least in part on each eye position, the determined gaze lines identifying the viewing location within the virtual scene;
estimating a vergence depth for the viewing location of the user based on an estimated intersection of the gaze lines;
comparing the estimated vergence depth to a depth associated with the viewing location identified by scene geometry data of the virtual scene;
replacing the estimated vergence depth with the depth of the viewing location based on a difference between the estimated vergence depth and the depth of the viewing location being greater than a threshold;
adjusting the focal length of the optics block based on the depth of the viewing location identified by the scene geometry data to provide accommodation for the user using the varifocal element; and
displaying the virtual scene on the display of the HMD.

US Pat. No. 10,235,914

CAMERA COLORIMETER SYSTEM FOR DISPLAY CHARACTERIZATION

Facebook Technologies, LL...

1. A system for characterizing a display panel, the system comprising:a plurality of band-pass filters, each band-pass filter configured to pass light within a different range of wavelengths;
a plurality of imaging devices, each of the plurality of imaging devices configured to capture an image covering a plurality of pixels in the display panel through a different one of the plurality of band-pass filters to generate a plurality of captured filtered signals, wherein the image is generated at the display panel by turning on a plurality of subpixels of a plurality of colors;
a color measurement instrument positioned to determine a spectrum of light from one or more of the plurality of pixels of the display panel; and
a computing device configured to receive the plurality of captured filtered signals from the plurality of imaging devices and the determined spectrum of light, the computing device configured to:
regenerate a plurality of spectral curves corresponding to the plurality of pixels by extending the plurality of captured filter signals beyond predetermined ranges of wavelengths of corresponding band-pass filters based on the determined spectrum of light, wherein a portion of a first regenerated spectral curve of the regenerated plurality of spectral curves overlaps with a portion of a second regenerated spectral curve of the regenerated plurality of spectral curves; and
reconstruct display characteristics of the plurality of pixels in the display panel using the regenerated plurality of spectral curves.

US Pat. No. 10,311,824

MULTIPLE DRIVER IC BACK LIGHT UNIT AND LIQUID CRYSTAL RESPONSE TIMING FOR LCD FOR VIRTUAL REALITY

Facebook Technologies, LL...

1. A display device comprising:a liquid crystal (LC) panel including a plurality of rows of pixels in a pixel area including a first row and a last row;
a back light unit (BLU) configured to emit light, the BLU emitting light during an illumination portion of a frame period and not emitting light during a remaining portion of the frame period;
a first data driver configured to write data to a first portion of the pixels of the LC panel; and
a second data driver configured to write data to a second portion of the pixels of the LC panel, wherein the first and second data drivers write data at an overlapping time during a write portion of the frame period, the write portion overlapping in time with the remaining portion of the frame period during which the BLU does not emit light, wherein liquid crystal material in one or more rows of the pixels transitions during the illumination portion of the frame period at an end of the frame period.

US Pat. No. 10,274,651

MANUFACTURING THREE-DIMENSIONAL DIFFRACTION GRATINGS BY SELECTIVE DEPOSITION OR SELECTIVE ETCHING

Facebook Technologies, LL...

1. A method for generating a three-dimensional diffraction grating, comprising:depositing a first material onto a side of a substrate to form a first structure;
depositing a second material onto the side of the substrate to form a second structure;
depositing a third material onto the substrate, the first structure and the second structure; and
etching the third material after depositing the third material to form the three-dimensional diffraction grating with a third structure on the first structure, the third material having surface properties allowing portions of the third material on the substrate and the second structure to be etched away but retain portions of the third material on the first structure.

US Pat. No. 10,240,622

SWITCHABLE FLUIDIC DEVICE

Facebook Technologies, LL...

1. A fluidic device comprising:a channel conduit including a fluid entrance to the channel conduit and a fluid exit from the channel conduit, the channel conduit bounded by an inner surface that includes a protrusion that protrudes into the channel conduit;
a flexible element inside the channel conduit, the flexible element having at least one edge coupled to the inner surface of the channel conduit on a different side of the inner surface as the protrusion, the flexible element having an adjustable position; and
a deformable surface that is part of the inner surface of the channel conduit;
a gate configured to impart an amount of deformation to the deformable surface in accordance with an applied fluid pressure at the gate, and the amount of deformation controls the adjustable position of the flexible element via a cross member that couples the flexible element to the deformable surface.

US Pat. No. 10,237,481

EVENT CAMERA FOR GENERATION OF EVENT-BASED IMAGES

Facebook Technologies, LL...

1. An imaging device comprising:an event sensor comprising a plurality of photodiodes, the event sensor configured to operate in a mode of a plurality of modes, the plurality of modes including an event mode that causes the plurality of photodiodes to asynchronously output data values, wherein a data value output by each respective photodiode, of the plurality photodiodes, is based at least in part on a difference of a value previously output by the photodiode and an intensity value captured by the photodiode relative to a threshold intensity value; and
a controller configured to:
populate an event matrix based in part on data values asynchronously received from the sensor and positions of photodiodes associated with the received data values over a first time period,
populate a change matrix based in part on the threshold intensity value and the photodiodes associated with the received data values over the first time period, and
generate an image for the first time period using the event matrix and the change matrix, based in part on solving for an intensity matrix using the equation:
Ax=y
where A is the event matrix,
y is the change matrix, and
x is the intensity matrix.

US Pat. No. 10,231,046

CARTILAGE CONDUCTION AUDIO SYSTEM FOR EYEWEAR DEVICES

Facebook Technologies, LL...

1. An audio system comprising:a transducer assembly configured to be coupled to a first portion of a back of an auricle of an ear of a user, the transducer assembly including at least one transducer that is configured to vibrate the auricle over a frequency range to cause the auricle to create an airborne acoustic pressure wave in an ear canal of the user in accordance with vibration instructions, and the airborne acoustic pressure wave corresponds to and is for presentation of audio content to the user;
an acoustic sensor configured to detect the airborne acoustic pressure wave at an entrance of the ear of the user; and
a controller configured to:
dynamically adjust a frequency response model based in part on the detected airborne acoustic pressure wave;
update the vibration instructions using the adjusted frequency response model; and
provide the updated vibration instructions to the transducer assembly.

US Pat. No. 10,228,240

DEPTH MAPPING USING STRUCTURED LIGHT AND TIME OF FLIGHT

Facebook Technologies, LL...

1. An apparatus comprising:a light emitter configured to emit temporally modulated structured light;
a detector comprising a plurality of pixel groups configured to capture, at different offset times, intensities of the temporally modulated structured light reflected from one or more objects in a local area; and
a processor configured to:
determine temporal information based on a portion of the captured intensities,
determine spatial information based on the captured intensities, and
determine depth information for the one or more objects in the local area based on the temporal information and the spatial information.

US Pat. No. 10,226,710

NAVIGATION CONTROLLER FOR VIRTUAL-REALITY SYSTEMS

FACEBOOK TECHNOLOGIES, LL...

1. A virtual-reality navigation controller, comprising:a base;
a seat including a back-rest;
a vertical support to support the seat on the base;
a rotatable connector between the seat and the vertical support to tilt the seat about a rotational center of the rotatable connector in response to directional forces exerted by a user seated on the seat; and
a motion-detection controller to measure, through sensors coupled to the back-rest, pitch corresponding to the tilt of the seat resulting from the directional forces.

US Pat. No. 10,261,542

DISTRIBUTED AUGMENTED REALITY SYSTEM

Facebook Technologies, LL...

1. A neckband device comprising:a first arm and a second arm coupled together to form a shape such that the neckband device conforms to a neck of a user; and
a plurality of compartments within the neckband device, the plurality of compartments including a battery compartment for a battery that is configured to power an eyewear device and a computation compartment configured to hold a processor that is configured to compute at least one value from a sensor of the eyewear device, and the first arm includes at least one of the plurality of compartments,
wherein the neckband device is communicatively coupled with the eyewear device.

US Pat. No. 10,216,272

STRAIN MEASUREMENT RING

Facebook Technologies, LL...

1. A device comprising:a semi-rigid band shaped to form a first portion of a strain measurement ring that is configured to be worn on a user's finger, the semi-rigid band having a first coupling end and a second coupling end;
a deformable band shaped to form a second portion of the strain measurement ring, the deformable band having a third coupling end and a fourth coupling end, the third coupling end coupled to the first coupling end and the fourth coupling end coupled to the second coupling end to form the strain measurement ring, the deformable band including:
a strain-sensitive element configured to output strain information in response to a deformation of the strain-sensitive element, wherein the strain information describes the deformation and the deformation is associated with a movement of the user's finger; and
wherein the semi-rigid band includes an actuator configured to move one of the coupling ends of the deformable band in response to a haptic command signal from a console.

US Pat. No. 10,281,728

CONSTANT-FORCE HEAD MOUNTED DISPLAY RESTRAINT SYSTEM

Facebook Technologies, LL...

1. A restraint system for use with a head mounted article, the system comprising:at least one tensioner mechanism, including:
a housing having an anchor portion connectable to a head mounted article;
a slider positioned in the housing for axial movement between a retracted position and an extended position; and
a tension element comprising a ribbon of spring metal having:
a first end portion rolled around a rotatable spool that is coupled to the housing such that the rotatable spool is circumferentially surrounded by the ribbon of spring metal when the slider is in the retracted position; and
a second end portion that is unrolled and coupled to the slider, wherein the ribbon of spring metal applies a substantially constant urging force toward the retracted position throughout the axial movement between the retracted position and the extended position; and
a strap coupled to the slider and configured to support the head mounted article on a user's head.

US Pat. No. 10,248,842

FACE TRACKING USING STRUCTURED LIGHT WITHIN A HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. A head mounted display (HMD) comprising:a display element configured to:
display content to a user wearing the HMD,
sequentially illuminate a portion of a face of the user inside the HMD with monochromatic light of different colors, and
wherein the content is displayed by the display element to the user for a content frame having a first time period, the monochromatic light being emitted for a second time period after the first time period has elapsed, and prior to display of additional content for a subsequent content frame; and
an optics block configured to direct light from the display element to an exit pupil of the HMD;
a camera assembly configured to:
capture images of the portion of the face illuminated by the display element with the monochromatic light of different colors; and
a controller configured to:
update a facial model that describes the portion of the face based at least in part on the captured images including the monochromatic light of different colors.

US Pat. No. 10,248,198

VARIABLE DISPLAY CLOCK FOR REDUCED BANDWIDTH IN A HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. A head-mounted display (HMD), comprising:a display panel including a plurality of display lines, pixels of the display panel defined at intersections of the display lines, the display lines including gate lines;
a display driver coupled to the display panel, including:
a gate signal duplicator configured to:
receive a stream of gate signal values;
in a first mode of the gate signal duplicator, provide a first gate signal value to a first gate line and a second gate line adjacent to the first gate line; and
in a second mode of the signal duplicator, provide a second gate signal value to the first gate line and a third gate signal value to the second gate line, the third gate signal value being subsequent to the second gate signal value in the stream of gate signal values; and
a programmable oscillator coupled to the gate signal duplicator, the programmable oscillator configured to generate a gate clock signal for the gate lines defining a row time for programming each row of a frame based on a frame time for programming the frame, a first pixel row size defining a number of rows included in a focus area of a user's eye within the frame, and a second pixel row size defining a number of rows included in the frame.

US Pat. No. 10,330,887

FLEXIBLE MEMBRANES CONNECTED TO MOVABLE LENSES OF HEAD-MOUNTED DISPLAY SYSTEMS AND RELATED TECHNOLOGY

Facebook Technologies, LL...

1. A head-mounted display system, comprising:a display housing;
one or more displays within the display housing;
a first lens and a second lens operably associated with the one or more displays, wherein a lateral distance between the first and second lenses is adjustable such that an adjustment of the lateral distance changes dimensions of internal areas around the first lens and second lens;
a perimeter frame coupled to a proximal perimeter portion of the display housing; and
a flexible membrane having a region extending between the first and second lenses, wherein:
the region of the membrane is configured to resiliently expand as the lateral distance between the first and second lenses increases and to resiliently contract as the lateral distance between the first and second lenses decreases, rather than leaving the internal areas around the first lens and second lens exposed, such that the flexible membrane shields the one or more displays of the display housing from at least one of light, dust, and impact;
the flexible membrane is configured to cover a user's nose when the user is wearing the display system;
the flexible membrane is made at least primarily of fabric or polymeric material;
the region of the membrane is a first region of the membrane;
the membrane has a second region extending between the first lens and the perimeter frame; and
the second region of the membrane is configured to resiliently contract as the lateral distance between the first and second lenses increases and to resiliently expand as the lateral distance between the first and second lenses decreases.

US Pat. No. 10,311,584

ESTIMATION OF ABSOLUTE DEPTH FROM POLARIZATION MEASUREMENTS

Facebook Technologies, LL...

1. A head-mounted display (HMD) comprising:an eye tracking system that includes:
one or more illumination sources configured to illuminate an eye of a user with light, and
an optical detector comprising an array of a plurality of polarization sensitive pixels configured to:
capture one or more images of the eye, and
determine intensity and polarization information associated with the one or more images; and
a controller configured to:
determine, for each polarization sensitive pixel in a subset of the plurality of polarization sensitive pixels, one or more estimation parameters associated with the eye tracking system,
determine, for the subset of the plurality of polarization sensitive pixels, depth information for one or more glints associated with one or more surfaces of a plurality of surfaces of the eye, based in part on the determined polarization information and the one or more estimation parameters,
update a model of the eye based in part on the determined depth information, and
determine eye tracking information associated with the updated model of the eye, the eye tracking information including an eye orientation of the eye.

US Pat. No. 10,277,893

CHARACTERIZATION OF OPTICAL DISTORTION IN A HEAD MOUNTED DISPLAY

Facebook Technologies, LL...

1. An optical profiling system comprising:a camera assembly including a characterization camera configured to capture one or more images of content presented by a head-mounted display (HMD) under test in accordance with imaging instructions, the characterization camera positioned in an eye box region of the HMD under test and configured to imitate movement of a human eye; and
a controller configured to:
generate the imaging instructions, the imaging instructions describing one or more positions of the characterization camera and providing instruction for a number of exposures at each of the one or more positions,
instruct the HMD under test to present a test pattern,
provide the imaging instructions to the camera assembly, and
measure distortion of one or more optical elements in the HMD under test using one or more images captured by the camera assembly.

US Pat. No. 10,276,130

DISPLAY LATENCY CALIBRATION FOR ORGANIC LIGHT EMITTING DIODE (OLED) DISPLAY

Facebook Technologies, LL...

1. A system comprising:a display having a plurality of illumination elements;
a controller configured to:
obtain, for an illumination element of the plurality of illumination elements, information about brightness levels associated with light emitted from the illumination element for at least two consecutive video frames,
retrieve information about a latency for the illumination element emitting light of a specific brightness, based on the information about brightness levels,
retrieve information about a time period for the illumination element to reach the specific brightness, and
determine a driving signal for the illumination element based on the latency, the time period and the brightness levels; and
a driver configured to apply the determined driving signal to the illumination element.

US Pat. No. 10,269,781

ELASTOMERIC LAYER FABRICATION FOR LIGHT EMITTING DIODES

Facebook Technologies, LL...

1. A method, comprising:depositing a photoresist including an elastomeric material over and between light emitting diode (LED) dies on a carrier substrate;
applying light through the carrier substrate towards the LED dies and the deposited photoresist, the light being absorbed by first portions of the photoresist between the LED dies to cause the first portions of the photoresist including first elastomeric material to be soluble, the light being absorbed by the LED dies to mask insoluble second portions of the photoresist including second elastomeric material over the LED dies from the light; and
dissolving the soluble first portions of the photoresist to remove the first portions of the photoresist including the first elastomeric material between the LED dies, the second elastomeric material over the LED dies being retained to form elastomeric interface layers over the LED dies.

US Pat. No. 10,247,858

LIQUID CRYSTAL HALF-WAVE PLATE LENS

FACEBOOK TECHNOLOGIES, LL...

1. A method for making a lens, comprising:applying a respective pattern of an electric field on a liquid containing liquid crystals so that the liquid crystals are aligned to focus at least a portion of impinging light, wherein:
the liquid containing liquid crystals is located between two substrates;
a first substrate of the two substrates includes a first set of multiple electrodes;
a second substrate of the two substrates, distinct from the first substrate, includes a second set of multiple electrodes distinct from the first set of multiple electrodes;
a respective electrode of the first set of multiple electrodes on the first substrate and a corresponding electrode of the second set of multiple electrodes on the second substrate have a same size and are arranged in a same orientation;
the liquid crystals in a first region are aligned in a first orientation;
the liquid crystals in a second region, located between the first region and a third region and adjacent to the first region and the third region, are aligned in a second orientation that is distinct from the first orientation;
the liquid crystals in the third region, located between the second region and a fourth region and adjacent to the second region and the fourth region, are aligned in the first orientation;
the liquid crystals in the fourth region, located adjacent to the third region, are aligned in the second orientation; and
applying the respective pattern of the electric field on the liquid containing liquid crystals includes applying a first voltage to the first set of multiple electrodes on the first substrate and applying a second voltage distinct from the first voltage to the second set of multiple electrodes on the second substrate so that
a portion of light impinging on the first region is directed to a particular focal point;
a portion of light impinging on the second region is directed to the particular focal point;
a portion of light impinging on the third region is directed to the particular focal point; and
a portion of light impinging on the fourth region is directed to the particular focal point.

US Pat. No. 10,310,272

LIGHT SOURCE ARRAY HAVING PLURAL SUPER LUMINOUS OR LUMINESCENT DIODE (SLED) ARRAYS

Facebook Technologies, LL...

1. A source element array comprising:a first superluminous light emitting diode (SLED) array of SLEDs that are arranged on a single chip, the first SLED array configured to emit light in a first optical band; and
a second SLED array of SLEDs that are arranged on a single chip, the second SLED array configured to emit light in a second optical band,
wherein the light emitted from the first SLED array and the light emitted from the second SLED array are combined to form combined light.

US Pat. No. 10,310,804

MODIFYING HAPTIC FEEDBACK PROVIDED TO A USER TO ACCOUNT FOR CHANGES IN USER PERCEPTION OF HAPTIC FEEDBACK

Facebook Technologies, LL...

1. A system comprising:an input interface configured to provide haptic feedback to a user in accordance with haptic data; and
a console configured to:
identify haptic data for communication to the input interface that causes the input interface to provide haptic feedback to the user,
determine an estimated amplitude of haptic feedback corresponding to a portion of the haptic data,
responsive to the estimated amplitude of the haptic feedback exceeding a threshold value, determine that a refractory period can occur after haptic feedback corresponding to the portion of the haptic data is applied to the user,
provide the portion of the haptic data to the input interface,
compare haptic feedback associated with times within a duration of the refractory period to user training data,
responsive to the comparison indicating that characteristics of a set of haptic data associated with the times within the duration of the refractory period are within ranges of characteristics that are not perceived by the user in the user training data, remove the set of haptic data associated with the times within the duration of the refractory period from the identified haptic data to form an adjusted haptic data set, and
provide to the input interface the adjusted haptic data set, wherein the input interface provides haptic feedback to the user in accordance with the adjusted haptic data set.

US Pat. No. 10,290,154

STEREO-BASED CALIBRATION APPARATUS

Facebook Technologies, LL...

1. A method comprising:capturing a plurality of images of a virtual reality (VR) headset while the VR headset is rotated around one or more axes;
receiving a signal output by a inertial measurement unit (IMU) while the VR headset is rotated around the one or more axes;
calculating an expected rotation of the VR headset based on the received signal output by the IMU;
determining an actual rotation of the VR headset based on the plurality of captured images;
comparing the actual rotation of the VR headset and the expected rotation of the VR headset;
generating one or more dynamic calibration parameters based on the comparison; and
storing the dynamic calibration parameters for the VR headset, the calibration parameters usable to identify rotation of the VR headset during use of the VR headset.

US Pat. No. 10,283,232

ENHANCING DIELECTRIC CONSTANTS OF ELASTOMERS USING ELECTRIC FIELDS

Facebook Technologies, LL...

1. A method comprising:receiving an elastomer doped with dielectric ceramic particulates, the elastomer doped with the dielectric ceramic particulates having a value of a first dielectric constant;
curing the elastomer doped with the dielectric ceramic particulates for an interval of time and at a temperature that is at least a melt temperature of the doped elastomer, the curing performed within a mold having an anode and a cathode; and
for at least a portion of the interval of time during the curing, applying a Direct Current (DC) voltage to the anode and to the cathode of the mold including the elastomer doped with the dielectric ceramic particulates while a temperature within the mold is within a threshold amount of the temperature of the doped elastomer, the applied DC voltage generating an electric field causing electrostatic poling of the dielectric ceramic particulates such that a second dielectric constant of the elastomer doped with the dielectric ceramic particulates after application of the DC voltage is greater than the first dielectric constant.

US Pat. No. 10,283,053

DISPLAY WITH CELL VOLTAGE COMPENSATION

Facebook Technologies, LL...

1. A display, comprising:a matrix including a plurality of cells;
a scan driver coupled to the matrix to provide scan line signals to the plurality of cells; and
a data driver connected to the matrix to provide data driver signals to the plurality of cells, wherein a cell of the plurality of cells includes:
a light emitting device;
a driving thin-film transistor (TFT) connected to the light emitting device to drive the light emitting device with a bias current, the driving TFT having a gate and a threshold voltage; and
a circuit connected with the data driver and the gate of the driving TFT, the circuit configured to:
generate a gate voltage based on a voltage of the data driver signals from the data driver and the threshold voltage of the driving TFT; and
provide the gate voltage to the gate of the driving TFT such that the bias current that drives the light emitting device is independent of the threshold voltage of the driving TFT;
wherein:
the circuit includes a first TFT connected in series with a second TFT;
the first TFT has a drain connected to a high supply line and the second TFT has a source connected to a low supply line;
a gate of the first TFT is selectively connected to a first data driver signal from the data driver under control of a scan line signal from the scan driver;
a gate of the second TFT is selectively connected to a second data driver signal from the data driver under control of the scan line signal; and
the gate of the driving TFT is connected to a node joining the first and second TFTs.

US Pat. No. 10,268,290

EYE TRACKING USING STRUCTURED LIGHT

Facebook Technologies, LL...

1. An eye tracking unit comprising:a structured light emitter configured to illuminate an eye of a user with a structured light pattern, the structured light pattern producing an illumination pattern on a portion of a surface of the eye;
a camera configured to capture an image of the illumination pattern on the portion of the surface of the eye; and
an eye orientation estimation module configured to estimate a foveal axis of the eye based on the image captured by the camera and a model of the eye, the foveal axis defining an orientation of the eye.

US Pat. No. 10,261,324

REMOVABLE LENS ASSEMBLY FOR A HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. A lens assembly comprising:a corrective lens customized to correct a vision error of an eye of a user of a head-mounted display (HMD), the corrective lens comprising:
a front surface,
a rear surface, and
a side surface connecting the front surface and the rear surface; and
a frame configured to attach to a body of the HMD, the frame comprising:
an inner surface onto which the corrective lens is attached, and
a wall extending at a front portion of the frame and configured to receive a peripheral wall at a rear side of the body of the HMD for removably securing the lens assembly to the body of the HMD.

US Pat. No. 10,261,592

OPTICAL HAND TRACKING IN VIRTUAL REALITY SYSTEMS

Facebook Technologies, LL...

1. A tracking device comprising:an illumination source integrated with a tracking glove coupled to a virtual reality console, the illumination source configured to illuminate a portion of skin on a finger of a user, wherein a location on the tracking glove is in contact with a corresponding location of a hand of the user;
an optical sensor integrated with the glove and configured to capture a plurality of images of the illuminated portion of skin; and
a controller configured to:
identify differences between some of the plurality of images, the differences corresponding to movement of the tracking glove with respect to the illuminated portion of skin,
determine estimated position data for the tracking glove based in part on the identified differences, and
determine that the location on the tracking glove has moved with respect to the corresponding location of the hand of the user based on the estimated positions.

US Pat. No. 10,261,595

HIGH RESOLUTION TRACKING AND RESPONSE TO HAND GESTURES THROUGH THREE DIMENSIONS

Facebook Technologies, LL...

1. A system comprising:an electronic display configured to display one or more simulated objects in accordance with display instructions;
an imaging sensor configured to capture images of a user's hands; and
a console configured to:
receive the captured images from the imaging sensor;
extract joint information of the user's hands from the captured images;
determine one or more poses based on the extracted joint information; and
in response to the determination that the poses indicate the user's index finger positioned orthogonally to the user's thumb, and the thumb is in contact with the index finger, detect a directional pad display gesture; and
in response to the detection of the direction pad display gesture, update the display instructions to cause the electronic display to generate a simulated directional pad adjacent to the user's thumb in a simulated environment that is presented to the user via the electronic display, the simulated directional pad indicating each of one or more selection directions each with a simulated arrow, the selection of the one or more selection directions detected based on a detection of further determined poses indicating a movement of a distal end of the user's thumb.

US Pat. No. 10,262,977

COLOUR INORGANIC LED DISPLAY FOR DISPLAY DEVICES WITH A HIGH NUMBER OF PIXEL

Facebook Technologies, LL...

1. An image generator for use in a display device, the image generator comprising:a plurality of inorganic light emitting diode (ILED) array chips each comprising a plurality of ILED emitters and arranged in an array such that each of a plurality of pixels of the image generator comprises an ILED emitter from each of a plurality of adjacent ILED array chips,
and wherein the total area of ILED emitter material of each pixel is less than 50% of the area of each pixel.

US Pat. No. 10,248,001

VARIFOCAL STRUCTURE COMPRISING A LIQUID LENS STRUCTURE IN OPTICAL SERIES WITH A LIQUID CRYSTAL LENS IN A HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. A varifocal block comprising:a liquid crystal (LC) lens that has a plurality of optical states, the plurality of optical states including an additive state that adds optical power to the LC lens and a subtractive state that removes optical power from the LC lens; and
a liquid lens structure in optical series with the LC lens, comprising:
a transparent substrate layer,
a deformable membrane, wherein the deformable membrane has an adjustable range of optical power that is based in part on adjusting a curvature of the deformable membrane, and
a volume of liquid enclosed between the transparent substrate layer and the deformable membrane; and
wherein the plurality of optical states of the LC lens and the adjustable range of optical power of the liquid lens structure together provide a continuous range of adjustment of optical power for the varifocal block.

US Pat. No. 10,330,789

PROXIMITY SENSOR SYSTEM WITH AN INFRARED OPTICAL ELEMENT

Facebook Technologies, LL...

1. A proximity sensor system for detecting presence of an object proximate to the proximity sensor system, the proximity sensor system comprising:a light emitter configured to project light in a first direction;
an optical element configured to steer the light from the light emitter from the first direction to a second direction that is non-parallel to the first direction, the optical element having:
a first surface configured to receive the light from the light emitter;
a second surface that is non-parallel to the first surface, the second surface configured to transmit a first portion of the light in the second direction and internally reflect a second portion of the light from the light emitter that is distinct from the first portion of the light from the light emitter; and
a third surface configured to prevent internal reflection of the second portion of the light by the third surface; and
a sensor configured to detect at least a portion of the first portion of the light returned from the object and transmitted through the second surface and the first surface of the optical element.

US Pat. No. 10,330,936

FOCAL SURFACE DISPLAY

Facebook Technologies, LL...

1. A system comprising:at least one processor;
an electronic display element configured to display a virtual scene; and
memory including instructions that, when executed by the at least one processor, cause the at least one processor to:
segment the virtual scene into a set of focal surfaces in the virtual scene based on scene geometry obtained for the virtual scene, each focal surface being associated with a set of nearest scene points;
adjust a shape of each focal surface to minimize a distance between each scene point of the set of nearest scene points to the focal surface and the focal surface;
generate, for each focal surface, a phase function for adjusting a wavefront of light of the virtual scene consistent with the adjusted shape of the focal surface; and
an optics block including a spatially programmable focusing element configured to:
receive the wavefront of light of the virtual scene from the electronic display element;
adjust, for each focal surface of the set of focal surfaces, the wavefront based on the phase function associated with the focal surface; and
provide the adjusted wavefront of the light of the virtual scene for each focal surface to a user via an exit pupil of the system.

US Pat. No. 10,317,999

VIBROTACTILE DRIVER CIRCUIT FOR HAPTIC DEVICES

Facebook Technologies, LL...

1. A haptic glove comprising:a glove body configured to cover a hand;
a vibrotactile actuator coupled to the glove body and configured to provide haptic feedback in accordance with a drive signal;
a driver circuit that is electrically coupled to the vibrotactile actuator and is configured to provide the drive signal to the vibrotactile actuator, the driver circuit comprising:
an alternating current (AC) voltage source assembly that includes a first AC voltage source and a second AC voltage source, each having a terminal, wherein the terminal of the first AC voltage source is electrically coupled to the vibrotactile actuator,
a capacitive element electrically coupled to the terminal of the second AC voltage source, and
a regulating element that includes a first coupling point and a second coupling point, the first coupling point is electrically coupled to the capacitive element and the vibrotactile actuator, and the second coupling point is grounded.

US Pat. No. 10,310,610

HAPTIC DEVICE FOR ARTIFICIAL REALITY SYSTEMS

Facebook Technologies, LL...

1. A haptic device comprising:a haptic plate including a center portion and an outer portion that circumscribes the center portion; and
a plurality of actuators coupled to the outer portion of the haptic plate, the plurality of actuators including:
one or more actuators configured to generate, in accordance with haptic instructions, a haptic wave that converges to a specific waveform at a specific region of the center portion of the plate, wherein a shape of the specific waveform and a location of the specific region on the center portion of the haptic plate are based in part on the haptic instructions, and
another actuator configured to generate a damping response to the specific waveform of the haptic wave.

US Pat. No. 10,274,728

STACKED DISPLAY PANELS FOR IMAGE ENHANCEMENT

Facebook Technologies, LL...

17. A head-mounted display (HMD) comprising:an electronic display element comprising a plurality of display panels that together output image light, the plurality of panels including a first display panel and a second display panel, the first display panel including a first plurality of sub-pixels, the first plurality of sub-pixels separated from each other by a non-emission area, the second display panel including a second plurality of sub-pixels, the second display panel positioned offset from the first display panel such that the second plurality of sub-pixels emit light through the non-emission area of the first display panel, wherein the first plurality of sub-pixels are configured to operate over a first range of luminosities, and the second plurality of sub-pixels are configured to operate over a second range of luminosities that is higher than the first range of luminosities, and the electronic display element is configured to:
receive an image having a dynamic range;
divide the dynamic range into “n” number of reduced dynamic ranges, wherein “n” is a number of display panels, and each reduced dynamic range corresponds to a different range of luminosities that different display panels are configured to operate over;
provide each display panel a respective reduced dynamic range;
display, by the first display panel, a first portion of the image in accordance with the first range of luminosities and a first reduced dynamic range;
display, by the second display panel, a second portion of image in accordance with the second range of luminosities and a second reduced dynamic range; and
an optics block configured to:
correct one or more optical aberrations in the image light;
magnify the image light; and
direct the image light to an exit pupil of the HMD corresponding to a location of an eye of a user of the HMD.

US Pat. No. 10,274,730

DISPLAY WITH AN EMBEDDED EYE TRACKER

FACEBOOK TECHNOLOGIES, LL...

1. A display device, comprising:a two-dimensional array of tiles, each tile comprising:
a two-dimensional array of pixels, wherein each pixel is configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light; and
a lens, of a two-dimensional array of lenses, configured to direct at least a portion of the respective pattern of light from the two-dimensional array of pixels to a pupil of an eye of a user;
one or more sensors for determining a location of the pupil of the eye of the user, and
one or more emitters configured to emit non-visible light, wherein
the one or more sensors and the one or more emitters are located on a first substrate;
the two-dimensional array of pixels is located on a second substrate that is distinct from the first substrate, separate from the first substrate, and located between the first substrate and the two-dimensional array of lenses;
the two-dimensional array of pixels, configured to output the pattern of light, is configured to transmit at least a portion of non-visible light emitted by the one or more emitters to the eye of the user and to transmit at least a portion of non-visible light from the eye of the user toward the one or more sensors; and
the two-dimensional array of lenses is configured to transmit at least a portion of non-visible light emitted by the one or more emitters to the eye of the user and to transmit at least a portion of non-visible light from the eye of the user toward the one or more sensors.

US Pat. No. 10,274,758

OPTICAL LINKED SENSOR NETWORK

FACEBOOK TECHNOLOGIES, LL...

1. An apparatus being part of a wearable device, the apparatus comprising:a first waveguide configured to propagate light originated from a light source;
a first modulator coupled with the first waveguide;
an image sensor coupled with the first modulator;
a second waveguide coupled with the first waveguide to form a propagation path for the light between the light source and a receiver device;
a second modulator coupled with the second waveguide; and
a motion sensor coupled with the second modulator,
wherein the image sensor is configured to generate image data of an environment in which the apparatus is located;
wherein the first modulator is configured to modulate the light propagating in the first waveguide based on the image data;
wherein the motion sensor is configured to generate motion data of the wearable device;
wherein the second modulator is configured to modulate the light propagating in the second waveguide based on the motion data; and
wherein the second waveguide is configured to propagate the light modulated by at least one of the first modulator or the second modulator towards the receiver device, to enable the receiver device to obtain at least one of the image data or the motion data and to enable the wearable device to determine output content based on the at least one of the image data or the motion data.

US Pat. No. 10,268,268

WAVEGUIDE INTEGRATED EYE TRACKING

Facebook Technologies, LL...

18. A head-mounted display (HMD) comprising:a display configured to emit image light;
an optical assembly that provides optical correction to the image light;
a waveguide;
a plurality of switchable Bragg gratings (SBGs) configured to selectively out-couple light from the waveguide;
an array of light sources coupled to the waveguide;
a detector coupled to a return path of the waveguide; and
a controller coupled to the SBGs, the array of light sources, and the detector, the controller configured to:
instruct, in a first operational mode of the eye tracker, a subset of the light sources to emit light beams that propagate through the waveguide,
activate, in the first operational mode, a subset of the SBGs to out-couple the light beams from different emission portions of the waveguide toward an eye,
determine, in the first operational mode, a position of the eye using light reflected from at least one surface of the eye and in-coupled by the waveguide,
instruct, in a second operational mode of the eye tracker based on the determined eye position, at least one light source in the array of light sources to emit at least one light beam that propagates through the waveguide, and
activate, in the second operational mode based on the determined eye position, at least one SBG of the plurality of SBGs to out-couple the at least one light beam from the waveguide toward the eye, wherein, in the second operational mode,
the waveguide in-couples at least one reflected light signal reflected from at least one surface of the eye that originates from the at least one light beam out-coupled from the waveguide,
the detector detects the at least one reflected light signal, and
the controller is further configured to determine an updated position of the eye using the detected at least one reflected light signal.

US Pat. No. 10,331,206

KINESTHETIC SENSORS FOR DETERMINING ANGULAR DISPLACEMENTS

Facebook Technologies, LL...

1. A kinesthetic sensor comprising:a flexible tube comprising an outer surface, a first end surface, and a second end surface, the flexible tube containing a first substance between the first end surface and the second end surface;
an injector coupled to the first end surface, the injector configured to inject discrete volumes of a second substance into the tube at the first end surface so each discrete volume of the second substance traverses the flexible tube from the first end surface to the second end surface and adjacent discrete volumes of the second substance are separated by the first substance;
a transmitter positioned on a side of an outer surface of the flexible tube and configured to transmit a signal through the flexible tube towards an opposite side of the outer surface that is parallel to the side of the outer surface; and
a receiver positioned on a side of the opposite side of the outer surface and configured to receive the signal after the signal propagates from the side of the outer surface through an intervening substance included in the flexible tube between the transmitter and the receiver and to generate a detection signal indicating a density of the intervening substance included in the tube between the transmitter and the receiver based on the signal received by the receiver, wherein the density of the intervening substance corresponds to an angular displacement of the kinesthetic sensor.

US Pat. No. 10,310,288

DISPLAY ALIGNMENT USING DIFFRACTION

Facebook Technologies, LL...

1. A method comprising:transmitting coherent light through a display of a head-mounted display to produce a diffraction pattern on a detector;
detecting, with the detector, the diffraction pattern;
determining a first orientation of the display based in part on the detected diffraction pattern;
determining an adjustment to the first orientation of the display using the determined first orientation and a target orientation; and
adjusting the display to a second orientation based on the determined adjustment.

US Pat. No. 10,310,608

WEARABLE ACCESSORY FOR FORCE FEEDBACK

Facebook Technologies, LL...

1. A wearable device comprising:a wearable structure configured to be worn by a user;
one or more actuator assemblies attached to the wearable structure, each actuator assembly configured undergo a change in stiffness in response to an applied stimulus pattern, wherein each of the one or more actuator assemblies comprises:
a flexible tube includes a carrier fluid and a plurality of light activated elements, and
a lamp coupled to the flexible tube, the lamp configured to illuminate the flexible tube with one or more wavelengths of light;
a controller coupled to the actuator assembly, the controller configured to:
receive one or more instructions from a host system,
determine one or more forces to be applied on each of the one or more actuator assemblies based on the received one or more instructions,
generate one or more stimulus patterns based at least in part on the determined forces, and
provide the generated stimulus patterns to the one or more actuator assemblies.

US Pat. No. 10,290,156

DISPLAY DEVICE WITH DUAL DATA DRIVERS

Facebook Technologies, LL...

1. A display device comprising:a display screen including:
a first pixel row of first pixels having respective storage capacitors, the first pixels connected to a first scan line;
a second pixel row of second pixels having respective storage capacitors, the second pixels connected to a second scan line;
a third pixel row of third pixels having respective storage capacitors, the third pixels connected to a third scan line;
first data lines connected to the first pixel row and the third pixel row, but not to the second pixel row; and
second data lines connected to the second pixel row, but not to the first and third pixel rows; and
a first data driver circuit to drive the first pixel row via the first data lines over a first time period, and to drive the third pixel row via the first data lines over a third time period not overlapping with the first time period;
a second data driver circuit to drive the second pixel row via the second data lines over a second time period, the second time period overlapping with both the first time period and the third time period; and
a scan driver circuit to drive a first scan pulse onto the first scan line over a portion of the first time period to scan data voltages of the first data lines onto the first pixel row, a second scan pulse onto the second scan line over a portion of the second time period to scan data voltages of the second data lines onto the second pixel row, and a third scan pulse onto the third scan line over a portion of third time period to scan data voltages of the first data lines onto the third pixel row, wherein the second scan pulse overlaps in time with both the first scan pulse and the third scan pulse.

US Pat. No. 10,288,884

DIRECTED DISPLAY ARCHITECTURE

Facebook Technologies, LL...

1. A head mounted display (HMD) comprising:an electronic display composed of a plurality of sub-pixels and each sub-pixel is configured to emit image light according to respective emission distribution;
a microlens array coupled to the electronic display, the microlens array including a plurality of microlenses coupled to a microlens array spacer, the microlens array configured to concentrate the emission distributions of the sub-pixels to form concentrated image light and direct the concentrated image light towards a target region, wherein the microlens array is separated from a surface of the electronic display by an air gap, wherein the plurality of microlenses each have a respective shape, and the respective shapes of the plurality of microlenses vary with position of the plurality of microlenses relative to the electronic display such that each of the plurality of microlenses direct light toward the target region; and
an optics block positioned in the target region, the optics block configured to direct the concentrated image light from the microlens array to an exit pupil of the HMD corresponding to a location of an eye of a user of the HMD.

US Pat. No. 10,281,978

PERCEPTION BASED PREDICTIVE TRACKING FOR HEAD MOUNTED DISPLAYS

Facebook Technologies, LL...

1. A method comprising:determining a first three-dimensional orientation of an input device, the input device comprising one or more inertial measurement units (“IMUs”) and one or more markers on an outside surface of the input device;
detecting a movement of the input device;
obtaining, from the one or more IMUs, first data representative of the detected movement of the input device;
obtaining, from one or more cameras external to the input device, second data representative of the detected movement of the input device based on a movement determined by the one or more cameras of the one or more markers;
predicting a second three-dimensional orientation of the input device based on both the first data representative of the detected movement and the second data representative of the detected movement; and
generating a rendered image corresponding to the predicted second three-dimensional orientation of the input device for presentation by a head mounted display.

US Pat. No. 10,281,982

INFLATABLE ACTUATORS IN VIRTUAL REALITY

Facebook Technologies, LL...

1. A haptic glove comprising:a glove body including a first portion, a second portion, and a third portion, the first portion corresponding to a first phalanx of a hand, the second portion corresponding to a second phalanx of the hand, and the third portion corresponding to a joint between the first phalanx and the second phalanx of the hand;
an expandable bladder coupled to the glove body such that the expandable bladder abuts the third portion of the glove body, the expandable bladder having an adjustable size that controls an amount of relative movement between the first portion and the second portion of the glove body relative to a rest of the glove body; and
a pressure source coupled to the glove body, wherein the pressure source is configured to adjust the size of the expandable bladder.

US Pat. No. 10,433,307

DIVERSITY BASED RELAY FOR WIRELESS COMMUNICATIONS BETWEEN A HEAD-MOUNTED DISPLAY AND A CONSOLE

Facebook Technologies, LL...

1. A method, comprising:receiving, by a head-mounted display, a first set of data packets from a console, the head-mounted display in direct communication with the console;
detecting a degradation in quality of wireless communication between the console and the head-mounted display;
identifying a relay with which the head-mounted display can wirelessly communicate, the relay configured to wirelessly communicate with the head-mounted display using a first communication channel and configured to wirelessly communicate with the console using a second communication channel that is isolated from the first communication channel;
initiating wireless communication between the head-mounted display and the relay using the first communication channel; and
receiving, by the head-mounted display, a second set of data packets from the relay via the first wireless communication channel, the second set of data packets received at the relay from the console using the second communication channel, wherein the console is in direct communication with the relay via the second communication channel.

US Pat. No. 10,358,264

HANG TAG FOR THE DISPLAY OF BOXED ITEMS

Facebook Technologies, LL...

1. A hang tag comprising:a frame defining an opening dimensioned to receive a fixture for displaying a package, the frame being secured to a first part of the package that is separable from a second part of the package;
a flap coupled to the frame, wherein the flap:
is adapted to fold over an edge of the frame and through the opening; and
attaches to the second part of the package, thereby forming a seal between the first part of the package and the second part of the package; and
a strip disposed between, and removably coupled to, the flap and the frame, wherein the seal between the first and second parts of the package is broken when the strip is removed, thereby enabling the first and second parts of the package to be separated.

US Pat. No. 10,345,517

CURVED ELECTRONIC DISPLAY ELEMENT

Facebook Technologies, LL...

1. A curved electronic display comprising:a cylindrically curved display panel including at least a cylindrically concave surface configured to emit image light, wherein the cylindrically curved display panel is one among a liquid crystal display and an organic light emitting diode display; and
a fiber optic taper including a mounting surface and a display surface, the mounting surface being cylindrically convex in shape and affixed to the cylindrically concave surface of the cylindrically curved display panel, and the mounting surface configured to receive the image light from the cylindrically curved display panel, and the display surface having a curved shape being a portion of a spherically concave shape that emits the image corrected for optical distortion in the image light received from the cylindrically curved display panel.

US Pat. No. 10,338,451

DEVICES AND METHODS FOR REMOVING ZEROTH ORDER LEAKAGE IN BEAM STEERING DEVICES

Facebook Technologies, LL...

1. A display device, comprising:one or more light sources; and
a beam steering device configured to steer light from the one or more light sources, the beam steering device including:
a first active deflector, wherein the first active deflector includes:
a first substrate with one or more electrodes;
a second substrate with one or more electrodes, wherein the second substrate is distinct from the first substrate; and
liquid crystals located between the first substrate and the second substrate; and
a passive deflector positioned parallel to the first active deflector to receive the light from the one or more light sources transmitted through the first active deflector, wherein the passive deflector includes:
a third substrate;
a fourth substrate that is distinct from the third substrate; and
liquid crystals located between the third substrate and the fourth substrate,
wherein the one or more light sources and the beam steering device are configured so that a zeroth order light from the passive deflector is directed away from an optical axis of the display device.

US Pat. No. 10,317,680

OPTICAL ABERRATION CORRECTION BASED ON USER EYE POSITION IN HEAD MOUNTED DISPLAYS

Facebook Technologies, LL...

1. A head mounted display (HMD) comprising:a processor;
an electronic display configured to display a virtual scene to a user wearing the HMD;
an optics block configured to direct light from the electronic display to an exit pupil of the HMD;
an eye tracking system configured to determine an eye position of an eye of the user wearing the HMD; and
memory including instructions that, when executed by the processor, cause the processor to:
determine, for one or more frames of the virtual scene, a viewing angle for the eye of the user based on the determined eye position;
determine, for the determined viewing angle and the determined eye position, optical aberration information corresponding to one or more known optical aberrations caused by the optics block observable from the determined viewing angle at the determined eye position of the eye of the user, one or more optical imperfections of the optics block causing the one or more known optical aberrations as the light from the electronic display passes through the optics block to the exit pupil of the HMD;
determine a gaze point of the user within the virtual scene based at least in part on the determined viewing angle and the determined eye position of the user;
determine, using depth information for the virtual scene, a focus state for the optics block of a plurality of different possible focus states of the optics block based on the determined gaze point for the eye of the user and the optical aberration information for the determined viewing angle, the depth information for the virtual scene providing a focus depth corresponding to providing accommodation for the eye of the user, the focus state corresponding to a combination of the focus depth and viewing angle;
determine an optical correction for the determined optical aberration information and the determined focus state for the optics block, at the determined viewing angle and determined eye position, the optical correction corresponding to the one or more frames of the virtual scene being displayed on the electronic display with pre-distortion that is canceled by the one or more optical imperfections of the optics block as light for the one or more frames of the virtual scene with the pre-distortion passes through the optics block; and
provide, for the determined optical aberration information for the determined focus state of the optics block, at the determined viewing angle and the determined eye position of the user wearing the HMD, the one or more frames of the virtual scene for display with the determined optical correction.

US Pat. No. 10,310,598

VARIFOCAL HEAD-MOUNTED DISPLAY INCLUDING MODULAR AIR SPACED OPTICAL ASSEMBLY

Facebook Technologies, LL...

1. A head-mounted display (HMD) comprising:a display;
an optical assembly comprising a front optical element sharing an optical axis with a back optical element and the display, the back optical element adjacent to the display with an air gap between the front optical element and the back optical element, wherein the optical assembly is configured to change an optical power of at least one of the front optical element and the back optical element;
an eye tracker comprising an illumination source located in the air gap, the eye tracker configured to:
obtain information about the optical power,
output light generated by the illumination source, and
determine a position of a user's eye relative to the optical axis, based at least in part on a modified version of the output light, the output light being modified by the optical power prior to reflection from the user's eye; and
a varifocal module configured to adjust focus of one or more images displayed on the display by adjusting a focal distance of the optical assembly, based on at least one of the determined position of the user's eye and the optical power.

US Pat. No. 10,304,706

MICRO-LED PICK AND PLACE USING METALLIC GALLIUM

Facebook Technologies, LL...

1. A method, comprising:forming an array of light emitting diode (LED) dies, each of the LED dies including a gallium semiconductor layer;
forming, for each of the LED dies, a gallium material converted from a portion of the gallium semiconductor layer; and
attaching a pick-up-tool (PUT) to the gallium material of one or more LED dies of the array of LED dies to pick up the one or more LED dies, wherein the PUT directly contacts the gallium material.

US Pat. No. 10,297,180

COMPENSATION OF CHROMATIC DISPERSION IN A TUNABLE BEAM STEERING DEVICE FOR IMPROVED DISPLAY

Facebook Technologies, LL...

1. A display device, comprising:a plurality of pixels, each pixel comprising two or more subpixels, wherein the plurality of pixels includes a first subpixel configured to transmit light of a first color and a second subpixel configured to transmit light of a second color that is distinct from the first color;
a beam steering device; and
one or more compensators located between the plurality of pixels and the beam steering device and configured to change a direction of the light from the first subpixel based on a color of the light from the first subpixel and transmit the light toward the beam steering device and change a direction of the light from the second subpixel based on a color of the light from the second subpixel and transmit the light toward the beam steering device, wherein:
the light of the first color impinges on the one or more compensators at a first angle;
the light of the second color impinges on the one or more compensators at the first angle;
the one or more compensators change the direction of the light of the first color so that the light of the first color impinges on the beam steering device at a second angle;
the one or more compensators change the direction of the light of the second color so that the light of the second color impinges on the beam steering device at a third angle that is distinct from the second angle; and
each compensator includes at least one selected from a group consisting of an achromatic circular polarizer and one or more liquid crystal polarization gratings.

US Pat. No. 10,345,599

TILE ARRAY FOR NEAR-OCULAR DISPLAY

Facebook Technologies, LL...

11. A method, comprising:at a display device with a two-dimensional array of tiles, each tile including a two-dimensional array of pixels, wherein each pixel is configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light, and each tile further including an electro-optic element, of a two-dimensional array of electro-optic elements, optically coupled with the two-dimensional array of pixels, the electro-optic element configured to refract the respective pattern of light from the two-dimensional array of pixels:
selecting a subset, less than all, of the two-dimensional array of tiles for activation; and
subsequent to selecting the subset of the two-dimensional array of tiles, activating a subset of the two-dimensional array of electro-optic elements in the selected subset of the two-dimensional array of tiles for refracting light from pixels in the selected subset of the two-dimensional array of tiles.

US Pat. No. 10,349,194

AUDITORY MASKING FOR A COHERENCE-CONTROLLED CALIBRATION SYSTEM

FACEBOOK TECHNOLOGIES, LL...

1. A method, comprising:generating a first auditory masking pattern based on a frequency spectrum of at least a first frame of a first audio signal;
generating a first calibration signal based on the first auditory masking pattern;
producing a combined input signal based on the first audio signal and the first calibration signal; and
performing one or more calibration operations based on the combined input signal.

US Pat. No. 10,338,379

LENSES WITH CONSISTENT DISTORTION PROFILE

Facebook Technologies, LL...

1. A head-mounted display device, comprising:a display; and
a lens that includes an optically transparent substrate having a first lens surface and a second lens surface that is opposite to the first lens surface, wherein:
the lens is separate from the display;
the first lens surface includes a convex surface without Fresnel structures;
the second lens surface is defined by a convex base curvature and a plurality of Fresnel structures;
the lens is configured to focus light from a first location of the display on a pupil of an eye of a wearer in a first rotational position at a first time and focus light from a second location, distinct from the first location, of the display on the pupil of the eye of the wearer in a second rotational position that is distinct from the first rotational position at a second time that is distinct from the first time;
the first location of the display is located at a first distance from an optical axis of the lens and the second location of the display is located at a second distance, distinct from the first distance, from the optical axis of the lens;
the light from the first location of the display to the pupil of the eye of the wearer in the first rotational position and the light from the second location of the display to the pupil of the eye of the wearer in the second rotational position have a same optical path length; and
the optical path length is determined based in part on a refractive index of the optically transparent substrate.

US Pat. No. 10,338,410

EYEGLASS PRESCRIPTION CORRECTION FOR OPTICS BLOCKS IN HEAD-MOUNTED DISPLAYS

Facebook Technologies, LL...

1. A computer-implemented method for modifying an optical component of a head-mounted display (HMD), the method comprising:receiving, at a first server, an identifier uniquely identifying a user of the HMD;
obtaining, at the first server, an eyeglass prescription data corresponding to the unique identifier, the eyeglass prescription data comprising data for correcting eye defects of the user associated with the identifier, wherein the eyeglass prescription data is encrypted using a cryptographic key including at least one among a digital signature and biometric data before the first server obtains the eyeglass prescription data;
decrypting, at the first server, the obtained eyeglass prescription data; and
applying, by the first server, the decrypted eyeglass prescription data to modify an optical property of the optical component of the HMD, the modified optical component providing corrected vision to the user while viewing content displayed on the HMD, wherein the optical component of the HMD is a tunable lens, wherein the tunable lens is at least one among a pressurized liquid between two membranes, a liquid crystal lens, and an Alvarez lens.

US Pat. No. 10,321,820

MEASURING OPTICAL PROPERTIES OF AN EYEWEAR DEVICE

Facebook Technologies, LL...

1. A device comprising:an imaging device configured to capture one or more images of a test pattern presented by a display surface through a lens of an eyewear device and the test pattern not through the lens of the eyewear device in accordance with imagining instructions; and
a controller configured to:
generate imaging instructions and provide the imaging instructions to the imaging device, and
determine one or more optical parameters of the eyewear device based on the captured one or more images of the test pattern as seen through the lens and the test pattern not seen through the lens, the one or more optical parameters of the eyewear device including an optical power of the lens.

US Pat. No. 10,326,977

MULTIFOCAL TEST SYSTEM

Facebook Technologies, LL...

1. A system comprising:a plurality of displays configured to emit image light, wherein:
at least two of the displays are located at a different focal distance from one another, and the plurality of displays include a plurality of pixels, each pixel in the plurality of pixels has a pixel intensity value;
an eye tracking system configured to determine eye tracking information about a position of the eye relative to the plurality of displays; and
a controller configured to determine the pixel intensity value for each pixel in at least a portion of the plurality of pixels to generate content for presentation to a user, based in part on decomposition of a scene related to the content displayed across the plurality of displays and the position of the eye.

US Pat. No. 10,326,235

ELECTROMAGNETIC CONNECTIONS FOR DYNAMICALLY MATING AND UN-MATING A WIRED HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. An apparatus for electrically connecting electronic devices, comprising:a first connector including an electromagnet;
a second connector, which includes a magnetic element and is detachably coupleable to the first connector, wherein the electromagnet of the first connector is energizeable to selectively couple or decouple the first and second connectors;
a force transducer coupleable to the electromagnet to measure a coupling force between the first and second connectors and transmit a signal based on the coupling force; and
a controller coupleable to the force transducer to:
receive the signal from the force transducer; and
control supply of current from a power source to the electromagnet, wherein the controller reduces the supply of current to the electromagnet when the signal indicates the coupling force is below a predetermined threshold.

US Pat. No. 10,323,930

SYSTEMS AND METHODS FOR A MOVABLE STRUCTURED LIGHT PROJECTOR

Facebook Technologies, LL...

1. A system comprising:a light projector assembly that receives a light control signal and projects structured light into a local area based on the light control signal;
an imaging device that receives a capture control signal and captures a reflection of the structured light from the local area based on the capture control signal, wherein the imaging device defines an imaging plane at which the reflection of the structured light is captured; and
an actuator, coupled to the light projector assembly, that receives an actuator control signal and moves the light projector assembly relative to the imaging device along a plane parallel to the imaging plane based on the actuator control signal.

US Pat. No. 10,326,500

POSITIONAL TRACKING ASSISTED BEAM FORMING IN WIRELESS VIRTUAL REALITY SYSTEMS

Facebook Technologies, LL...

1. A head-mounted display (HMD) comprising:a transceiver configured to:
communicate directly with a console via a wireless channel, in accordance with communication instructions, the communication instructions causing the transceiver to wirelessly communicate with the console over one directional beam of a plurality of directional beams, and
receive, from the console, a feedback signal with information about a change in a position of the HMD relative to a reference point on the console, the position of the HMD being tracked over a time period by the console; and
a beam controller configured to:
determine a directional beam, of the plurality of directional beams, based in part on the information about the change in the position of the HMD relative to the reference point on the console,
generate the communication instructions identifying the determined directional beam, and
provide the communication instructions to the transceiver.

US Pat. No. 10,326,040

WASHABLE MOLD FOR CONFORMABLE LAYER FORMATION ON SEMICONDUCTOR DEVICES

Facebook Technologies, LL...

1. A method, comprising:forming a conformable material at side surfaces and over a light emitting surface of an LED die on a carrier substrate;
applying a mask over the conformable material to selectively cover the conformable material;
exposing portions of the conformable material to light to selectively cure the conformable material over the light emitting surface of the LED die; and
removing the conformable material at the side surfaces that is not cured after exposing the portions of the conformable material to light to form a conformable interface layer over the light emitting surface of the LED die from the conformable material over the LED die.

US Pat. No. 10,325,791

FORMATION OF ELASTOMERIC LAYER ON SELECTIVE REGIONS OF LIGHT EMITTING DEVICE

Facebook Technologies, LL...

1. A method comprising:forming an elastomeric material on a portion of a light emitting surface of a light emitting diode (LED), the portion of the light emitting surface being smaller than the light emitting surface;
picking up the LED by attaching the elastomeric material to a pick-up head; and
placing the LED attached to the pick-up head via the elastomeric material on a display substrate of an electronic display.

US Pat. No. 10,326,052

LIGHT EMITTING DIODE WITH FIELD ENHANCED CONTACT

Facebook Technologies, LL...

1. A light emitting structure comprising:a light emitting diode (LED) comprising a mesa-shaped body of transparent semiconductor material, the mesa-shaped body comprising a top surface and a light emitting region below the top surface, the light emitting region configured to emit light in response to passing current through the light emitting region, the emitted light passing through the mesa-shaped body of the LED and through a bottom surface of the LED;
a first contact connected to the top surface of the mesa-shaped body, the first contact of a spiral shape to induce an electromagnetic field that shapes the light emitted from the light emitting region and passing through the mesa-shaped body of the LED; and
a second contact connected to a surface of the light emitting structure, wherein a voltage difference can be applied across the first contact and the second contact to generate the current through the light emitting region.

US Pat. No. 10,324,530

HAPTIC DEVICES THAT SIMULATE RIGIDITY OF VIRTUAL OBJECTS

Facebook Technologies, LL...

1. A haptic assembly comprising:a glove body configured to cover a hand;
a haptic apparatus coupled to the glove body, the haptic apparatus comprising three or more plates and a malleable sheet, the malleable sheet coupled to the three or more plates and the glove body, a portion of the three or more plates to contact the hand according to a shape of the malleable sheet; and
an actuator coupled to the malleable sheet, the actuator configured to actuate, based in part on a rigidity of a virtual object, the malleable sheet to transform the shape of the malleable sheet to adjust an amount of direct contact area generated between a subportion of the three or more plates and at least a portion of the hand, wherein the haptic assembly comprises an operation mode wherein a subset of the three or more plates does not contact the portion of the hand based in part on the rigidity of the virtual object.

US Pat. No. 10,321,751

DETACHABLE STRAP HINGE MECHANISM FOR HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. A head-mounted display, comprising:an end piece rotatably connected to a head strap connector;
a cap formed with a cavity extending in a longitudinal direction to receive the end piece, the cap secured to a frame of the head-mounted display; and
at least one cap pin configured to protrude inward into the cavity of the cap to engage with the end piece for securing the end piece to the cap, the end piece rotatable relative to the cap after moving in the longitudinal direction to disengage the end piece from the cap for removal of the head strap connector from the cap.

US Pat. No. 10,319,266

DISPLAY PANEL WITH NON-VISIBLE LIGHT DETECTION

Facebook Technologies, LL...

1. A display panel, comprising:a substrate;
a plurality of visible light emitting diodes (LEDs) positioned on a side of the substrate, each of the visible LEDs configured to transmit quasi-collimated visible light propagating away from the side of the substrate;
a plurality of non-visible LEDs positioned on the side of the substrate and configured to emit invisible light propagating away from the side of the substrate; and
a plurality of light detectors positioned on the side of the substrate configured to capture the invisible light propagating towards the side of the substrate, wherein the plurality of visible LEDS, a light detector of the plurality of light detectors, and a non-visible LED of the plurality of non-visible LEDs form a pixel on the substrate around a hexagonal region of the substrate; and wherein:
the plurality of visible LEDs, the light detector, and the non-visible LED each include a p-contact and an n-contact coupled to the substrate; and
the plurality of visible LEDs, the light detector, and the non-visible LED surround a common earth sub-pixel defining the hexagonal region of the pixel including the n-contact of the plurality of visible LEDs, the light detector, and the non-visible LED.

US Pat. No. 10,317,772

SWITCHABLE BRAGG GRATINGS FOR CHROMATIC ERROR CORRECTION OF PANCHARATNAM BERRY PHASE (PBP) COMPONENTS

Facebook Technologies, LL...

1. A Pancharatnam Berry Phase (PBP) color corrected structure comprising:a plurality of switchable gratings that are each configured to have an inactive mode to diffract light of a specific color channel not being propagated, of a set of color channels, and propagate light of other color channels in the set of color channels, wherein the specific color channel is different for each of the plurality of switchable gratings, and to have an active mode to propagate light that is inclusive of the set of color channels; and
a plurality of PBP active elements that receive light from at least one of the plurality of switchable gratings, and the plurality of PBP active elements are each configured to adjust light of a different color channel of the set of color channels by a same amount.

US Pat. No. 10,319,705

ELASTOMERIC LAYER FABRICATION FOR LIGHT EMITTING DIODES

Facebook Technologies, LL...

1. A method, comprising:depositing a photoresist material on and between light emitting diode (LED) dies on a carrier substrate;
applying light through the carrier substrate towards the LED dies and the deposited photoresist material, responsive to depositing the photoresist material;
absorbing a portion of the light incident on the LED dies to retain soluble first portions of the photoresist material on the LED dies;
exposing portions of photoresist material between the LED dies to another portion of the light to render second portions of the photoresist material between the LED insoluble;
removing the first portions of photoresist material, responsive to applying the light;
depositing an elastomeric material on each LED die and between the second portions of photoresist, responsive to removing the first portions; and
removing the second portions of the photoresist material responsive to depositing the elastomeric material, the elastomeric material forming elastomeric interface layers on the LED dies.

US Pat. No. 10,317,682

FRICTION JOINT FOR A HEAD MOUNTED DISPLAY

Facebook Technologies, LL...

1. A head mounted display for use with a virtual reality system, comprising:a front display module shaped to rest against a forehead region and a cheek region of a user's face, the front display module comprising:
a display housing shaped to substantially eliminate light bleed from external light sources from reaching the user's eyes and having opposing lateral sides each having a first frictional joint member;
optics housed within the display housing between the opposing lateral sides; and
one or more virtual-reality displays housed within the display housing between the opposing lateral sides and coupleable to the virtual reality system; and
an adjustable strap assembly configured to apply, when worn by the user, a retaining force to the front display module, the adjustable strap assembly comprising:
one or more head straps; and
opposing first and second connector arms connected to the one or more head straps and positioned adjacent to the lateral sides of the front display module, each of the first and second connector arms having a second frictional joint member attached to a respective one of the first frictional joint member and pivotal about an axis of rotation relative to the respective one of the first frictional joint member;
wherein the front display module is pivotally movable about the axis of rotation relative to the strap assembly between first and second positions, and wherein frictional engagement between the first and second frictional joint members retains the front display module in the first selected position while the retaining force applied by the adjustable strap assembly retains the front display module against the forehead region and the cheek region of the user's face until the front display module is manually moved away from the first selected position toward the second position.

US Pat. No. 10,312,656

WAVELENGTH TUNING FOR DIFFRACTIVE OPTICAL ELEMENTS OF STRUCTURED LIGHT PROJECTORS

Facebook Technologies, LL...

17. A wavelength tuning system comprising:a camera configured to capture, in accordance with tuning instructions, images of one or more structured light patterns projected by a structured light projector in accordance with the tuning instructions, the structured light projector comprising a laser light source, a wavelength regulator that regulates temperature of the laser light source, and a diffractive optical element (DOE) that generates structured light patterns using light from the laser light source, and the captured images include images of structured light patterns captured at different temperature values of the light laser source; and
a controller configured to:
generate the tuning instructions that cause the wavelength regulator to set the laser light source to different temperatures of a set of temperatures, and the camera to capture images of the structured light pattern generated by the structured light projector at each of the different temperatures,
determine a temperature calibrated to the DOE using one or more of the captured images, wherein the temperature calibrated to the DOE corresponds to a wavelength of light emitted by the laser light source that results in at least one performance metric meeting a corresponding threshold value.

US Pat. No. 10,303,211

TWO PART CONE DISPLAY USING FLEXIBLE SUBSTRATES

Facebook Technologies, LL...

1. A method of manufacturing an organic light emitting diode (OLED) display, comprising:fabricating an OLED panel portion having peripheral display surfaces, adjacent peripheral display surfaces being connected by bending regions;
bending the OLED panel portion along the bending regions to form a conic OLED panel portion, the peripheral display surfaces of the conic OLED panel portion forming a truncated conic shape with an open base region around a center of the conic OLED panel portion;
fabricating a base OLED panel portion having a base display surface, the base OLED panel portion being separate from the OLED panel portion; and
positioning the base OLED panel portion to cover the open base region of the conic OLED panel portion such that the peripheral display surfaces surround the base display surface.

US Pat. No. 10,303,251

VARIABLE DISPLAY CLOCK FOR REDUCED BANDWIDTH IN A HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. An electronic display,comprising:
a display panel including display lines; and
a display driver coupled to the display panel, the display driver including a programmable oscillator configured to:
generate a clock signal for the display lines defining a row time for programming each row of a frame based on a frame time for programming the frame, a first pixel row size defining a number of rows included in a high resolution area within the frame, and a second pixel row size defining a number of total rows in the frame, the total rows including the high resolution area and at least one low resolution area; and
update the clock signal including the row time based on a change in the first pixel row size.

US Pat. No. 10,295,723

2D PUPIL EXPANDER USING HOLOGRAPHIC BRAGG GRATING

FACEBOOK TECHNOLOGIES, LL...

1. A device comprising:a waveguide configured to guide light from an input element to an output element;
the input element is configured to couple light from a source into the waveguide; and
the output element is configured to out couple light from the waveguide, wherein:
the output element comprises a first super grating;
the first super grating comprises a first plurality of gratings;
each grating of the first plurality of gratings is defined by a grating vector;
grating vectors of the first plurality of gratings are oriented in a first direction;
the output element comprises a second super grating;
the second super grating comprises a second plurality of gratings;
each grating of the second plurality of gratings is defined by a grating vector;
grating vectors of the second plurality of gratings are oriented in a second direction; and
the first direction is different from the second direction to out couple light from the waveguide.

US Pat. No. 10,295,827

DIFFRACTIVE OPTICS BEAM SHAPING FOR STRUCTURED LIGHT GENERATOR

Facebook Technologies, LL...

1. A depth camera assembly (DCA) comprising:a structured light generator configured to illuminate a local area with structured light in accordance with emission instructions, the structured light generator comprising:
an illumination source configured to emit an optical beam,
an acousto-optic device that generates a structured light pattern from the optical beam, the acousto-optic device is configured to function as a dynamic diffraction grating that diffracts the optical beam to form the structured light pattern, and parameters of the dynamic diffraction grating are based in part on the emission instructions;
a projection assembly configured to:
modify a general intensity envelope of the structured light pattern to increase uniformity of the general intensity envelope in a projection of the structured light pattern in the far field, and
project the modified structured light pattern into the local area;
an imaging device configured to capture one or more images of the local area into which the structured light pattern is projected; and
a controller configured to:
generate the emission instructions;
provide the emission instructions to the structured light generator, and
determine depth information for an object in the local area using the captured one or more images.

US Pat. No. 10,381,513

ENHANCED LIGHT EXTRACTION

Facebook Technologies, LL...

1. A light emitting device, comprising:a light emitting structure configured to generate light, the light emitting structure including a first side and a second side, the second side including a light emitting surface through which the light is emitted, the light emitting structure further including a sidewall between the first and second sides; and
an ohmic contact to the light emitting structure, including:
a transparent electrically conductive layer above the light emitting structure at the first side; and
a metal layer above the transparent electrically conductive layer, the light generated by the light emitting structure being transmitted through the transparent electrically conductive layer in first directions and reflected by the metal layer in second directions back through the transparent electrically conductive layer and the light emitting structure to the light emitting surface, wherein the transparent electrically conductive layer over the light emitting structure and the sidewall of the light emitting structure include a domed cross-section shape.

US Pat. No. 10,373,294

RENDERING COMPOSITE CONTENT ON A HEAD-MOUNTED DISPLAY INCLUDING A HIGH RESOLUTION INSET

Facebook Technologies, LL...

1. A method comprising:dividing an image into a high resolution (HR) inset portion, a peripheral portion, and a transitional portion between the HR inset portion and the peripheral portion, wherein the HR inset portion is at a first resolution, and the transitional portion has an inner boundary between the transitional portion and the HR inset portion and an outer boundary between the transitional portion and the peripheral portion, wherein the peripheral portion is at a second resolution that is lower than the first resolution;
blending the transitional portion of the image such that there is a smooth change in resolution from the inner boundary at the first resolution to the outer boundary at the second resolution;
generating an inset region using the HR inset portion of the image and the blended transitional portion of the image; and
providing, for display, the inset region and a background region to a display.

US Pat. No. 10,373,556

ORGANIC LIGHT EMITTING DIODE DISPLAY DEVICE INCLUDING SEGMENTED POWER LINES

Facebook Technologies, LL...

1. A display device, comprising:a display panel including:
a plurality of pixel circuits disposed on an active area of the display panel for emitting light,
at least two lines including a first line and a second line disposed on the active area, the first line coupled to a first group of pixel circuits of the plurality of pixel circuits, the second line coupled to a second group of pixel circuits of the plurality of pixel circuits, and
a first switching circuit, the first switching circuit coupled to the first line, and configured to:
(i) in a first state, supply power at a first power level to the first group of pixel circuits coupled to the first line, and
(ii) in a second state, supply power at a second power level to the first group of pixel circuits coupled to the first line; and
a second switching circuit, the second switching circuit coupled to the second line, and configured to:
(i) in the first state, supply power at the first power level to the second group of pixel circuits coupled to the second line, and
(ii) in the second state, supply power at the second power level to the second group of pixel circuits coupled to the second line; and
wherein a pixel circuit of the plurality of pixel circuits is configured to receive at least a first pulse along a data line to program a value for the pixel circuit, and a second pulse corresponding to an emission control signal to enable the pixel circuit to emit light based upon the programmed value, wherein the first and second pulses are received during a time period when the corresponding switching circuit is operating in the first state.

US Pat. No. 10,373,592

ADAPTIVE PARAMETERS IN IMAGE REGIONS BASED ON EYE TRACKING INFORMATION

Facebook Technologies, LL...

1. A method comprising:receiving eye tracking information comprising at least one image of an eye of a user viewing a screen of a display device;
determining, based on the eye tracking information, a first screen region corresponding to a region of the screen, the first screen region containing a point of regard of the user, the point of regard representing a point on the screen at which the user is looking at the time the eye tracking information was captured;
determining, based on the eye tracking information, a second screen region corresponding to a region of the screen that is separate from the first screen region;
determining, based on the eye tracking information, a user's depth of focus;
encoding an image for display on the screen, the image comprising an object with at least, a portion of the object to be displayed within the first screen region, the encoding comprising:
encoding a first image region of the image based on a first set of encoding parameters, the first image region comprising a portion of the image to be displayed in the first screen region,
encoding a second image region of the image based on a second set of encoding parameters, the second image region separate from the first image region and to be displayed in the second screen region, the second set of encoding parameters resulting in a lower quality than the first set of encoding parameters, and
responsive to a difference between a depth of the object in the image and the user's depth of focus exceeding a threshold value, encoding the object, including the portion to be displayed within the first screen region, with the second set of encoding parameters; and
transmitting the encoded image to the display device to be displayed on the screen.

US Pat. No. 10,372,213

COMPOSITE RIBBON IN A VIRTUAL REALITY DEVICE

Facebook Technologies, LL...

1. A haptic glove comprising:a glove body including a glove digit corresponding to a phalange of a user hand, the glove digit having:
a first ribbon layer of a first average width configured to be positioned on a first surface of the glove digit and formed lengthwise along a bend centerline of the glove digit that bisects a surface of the glove digit, the first ribbon layer comprising a first extendible material having a first range of elastic extensibility, and
a second ribbon layer of a second average width greater than the first average width, the second ribbon layer configured to be positioned on the first surface of the glove digit and formed lengthwise along the bend centerline of the glove digit, a central axis of the second ribbon layer aligned with a central axis of the first ribbon layer, the second ribbon layer comprising a second extendible material having a second range of elastic extensibility greater than the first range of elastic extensibility of the first ribbon layer,
wherein an actuator coupled to the glove body and the first and second ribbon layers is configured to control movement of the glove digit by actuating one or more control wires that are coupled to the first and second ribbon layers.

US Pat. No. 10,372,219

PNEUMATICALLY CONTROLLED HAPTIC MECHANISMS WITH NESTED INTERNAL STRUCTURES FOR HAPTIC FEEDBACK

FACEBOOK TECHNOLOGIES, LL...

1. An apparatus for creating haptic stimulations, comprising:one or more pods coupled to a garment, each pod including:
(i) an outer internal structure that defines an opening;
(ii) an inner internal structure disposed in the opening defined by the outer internal structure; and
(iii) an airtight bladder, pneumatically coupled with a pneumatic device, surrounding the inner and outer internal structures, the pneumatic device being configured to control a pressure inside the bladder,
wherein:
when a bladder of a respective pod is at a first pressure, respective top surfaces of the inner and outer internal structures contact a first portion of a user's body, said contact with the first portion of the user's body having a first surface area; and
when the bladder of the respective pod is at a second pressure different from the first pressure, the top surface of the inner internal structure and/or the top surface of the outer internal structure contact a second portion of the user's body, said contact with the second portion of the user's body having a second surface area different from the first surface area.

US Pat. No. 10,343,059

HANDHELD CONTROLLER WITH THUMBSTICK GUARD

Facebook Technologies, LL...

1. A handheld controller, comprising:a body with a control opening;
a control member pivotally coupled to the body, the control member comprising a shaft portion extending through the control opening and an upper surface positioned to confront a finger of a user's hand; and
a guard connected to the body and the control member, the guard comprising:
a tubular neck with a top region connected to the shaft portion of the control member and having a bottom region, the shaft portion of the control member extending through the neck;
a skirt extending outwardly from a bottom region of the neck and away from a central longitudinal axis of the neck, wherein an outer circumference of the skirt is sealably connected to an interior portion of the body of the handheld controller around the control opening; and
a flexible joint portion extending around the circumference of the bottom region of the neck, wherein the joint connects the neck to the skirt and is configured to bend to allow the neck to move relative to the skirt upon pivoting the control member relative to the body.

US Pat. No. 10,349,038

DYNAMIC CONTROL OVER STRUCTURED ILLUMINATION INTENSITY

Facebook Technologies, LL...

1. A depth camera assembly comprising:a structured light illuminator configured to illuminate a scene with a variable intensity structured light (SL) pattern, the SL pattern including a plurality of portions and at least one of the portions has a different intensity value than another portion of the plurality of portions, the structured light illuminator comprising:
a source assembly that generates light,
a structured light element that generates a SL pattern using the light,
a liquid crystal array including a plurality of addressable liquid crystal cells, each liquid crystal cell configured to, respectively,
receive a portion of the SL pattern, and
modify a polarization state of the portion of the SL pattern in accordance with adjustment instructions,
a polarizer configured to attenuate portions of the SL pattern based on the polarization of the portions of the SL pattern to generate the variable intensity SL pattern;
a camera configured to capture an image of the scene illuminated with the variable intensity SL pattern; and
a controller coupled to the camera and the structured light illuminator, the controller configured to:
for each of a plurality of portions of the image, determining a saturation factor,
increase an attenuation factor in response to a saturation factor of a portion of the image being greater than a first threshold value,
decrease the attenuation factor in response to the saturation factor of the portion of the image being smaller than a second threshold value, and
control the liquid crystal array based on the attenuation factor.

US Pat. No. 10,345,600

DYNAMIC CONTROL OF OPTICAL AXIS LOCATION IN HEAD-MOUNTED DISPLAYS

Facebook Technologies, LL...

1. A head-mounted display (HMD) comprising:an electronic display configured to emit image light;
an eye tracker configured to determine a gaze vector of an eye of a user; and
an optical assembly including a dynamic optical axis component (DOAC) positioned in front of the electronic display, the DOAC configured to:
refract the image light received from the electronic display, and
dynamically adjust a location of an optical axis of the DOAC, based on the determined gaze vector, wherein
the optical assembly is further configured to direct the refracted image light to an eye box of the HMD corresponding to a location of the user's eye.

US Pat. No. 10,341,803

HEAD-RELATED TRANSFER FUNCTION (HRTF) PERSONALIZATION BASED ON CAPTURED IMAGES OF USER

Facebook Technologies, LL...

1. A method comprising:obtaining, by a computing device, a set of anatomical features describing physical characteristics of a user's body relevant to a personalized head-related transfer function (HRTF) of the user, the set of anatomical features identified from one or more images of the user;
constructing, by the computing device, the personalized HRTF of the user from the set of anatomical features of the user; and
providing, by the computing device, the personalized HRTF for generating audio signals using the personalized HRTF.

US Pat. No. 10,341,637

FULL FRAME UNIFORMITY ACROSS PANELS

Facebook Technologies, LL...

1. A method of providing display uniformity in a display apparatus, the method comprising:retrieving first calibration data representing display characteristics of a display panel of the display apparatus, the first calibration data representing luminance responses or color responses of both left and right panel regions of the display panel when corresponding pixels of both the left and right panel regions are supplied same input image data;
retrieving second calibration data representing characteristics of optical components of the display apparatus, the second calibration data representing optical responses of the optical components as a function of 2 dimensional (2D) spatial positions spanning the left and right fields of view responsive to uniform optical inputs provided to the optical components across the left and right fields of view;
receiving stereoscopic image data comprising left image data to be supplied to the left panel region and right image data to be supplied to the right panel region; and
modifying the received stereoscopic image data in accordance with the first calibration data to display a stereoscopic image with a substantially same luminance response or substantially same color response in both the left panel region and right panel region when the first calibration data indicates discrepancy between the luminance response or color responses between corresponding pixels of the left and right panel regions; and
further adjusting the modified stereoscopic image data in accordance with the second calibration data to display a stereoscopic image with a substantially uniform optical response across both the left and right fields of view when the second calibration data indicates non-uniformity in the optical responses of the optical components as a function of 2D spatial positions across the left and right fields of view.

US Pat. No. 10,339,897

DISPLAY LATENCY CALIBRATION FOR ORGANIC LIGHT EMITTING DIODE (OLED) DISPLAY

Facebook Technologies, LL...

1. A system comprising:a display having a plurality of illumination elements; and
a controller configured to:
obtain, for at least one illumination element of the plurality of illumination elements, information about one or more brightness levels of light to be emitted from the at least one illumination element,
retrieve information about a latency for the at least one illumination element to emit the light, based on the information about one or more brightness levels,
retrieve information about a time period for the at least one illumination element to reach the one or more brightness levels from one or more other brightness levels, and
determine a signal for driving the at least one illumination element to emit the light, based at least in part on the latency and the time period.

US Pat. No. 10,338,637

ADJUSTABLE STRAP ASSEMBLY FOR A HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. A strap assembly comprising:an axial strap, connected to a display device, configured to be worn around the circumference of a user's head in a manner that holds the display device against the user's face, the axial strap comprising:
a left axial section, coupled to a left side of the display device, configured to be worn around the left side of the user's head; and
a right axial section, coupled to a right side of the display device, configured to be worn around the right side of the user's head;
an adjustable attachment mechanism configured to removably attach the right axial section to the left axial section such that the right axial section overlaps the left axial section or the left axial section overlaps the right axial section; and
a top strap, configured to be worn along the top of the user's head, comprising:
a ventral end coupled to a medial section of the display device; and
a dorsal end that splits into a left dorsal end and a right dorsal end, each of which couples to the axial strap, wherein:
the left dorsal end is configured to be worn against the left side of the user's head and the right dorsal end is configured to be worn against the right side of the user's head;
the right dorsal end of the top strap connects to the left axial section of the axial strap; and
the left dorsal end of the top strap connects to the right axial section of the axial strap.

US Pat. No. 10,338,675

SELECTIVE COLOR SENSING FOR MOTION TRACKING

Facebook Technologies, LL...

1. An electronic device in communication with a first portable device and one or more optical sensors, the electronic device comprising:one or more processors; and
memory storing one or more programs, the one or more programs including instructions, which, when executed by the one or more processors, cause the electronic device to:
receive information identifying respective intensities of light, detected by the one or more optical sensors, for a plurality of distinct wavelengths;
select a first set of one or more distinct wavelengths for tracking the first portable device based on the respective intensities of light, detected by the one or more optical sensors, for the plurality of distinct wavelengths, wherein the first set of one or more distinct wavelengths is distinguishable from ambient light; and,
subsequent to selecting the first set of one or more distinct wavelengths for tracking the first portable device:
initiate the first portable device to emit light of the first set of one or more selected wavelengths;
receive information identifying one or more respective intensities of light, detected by the one or more optical sensors, for the first set of one or more selected wavelengths; and
determine a position of the first portable device based on the information identifying the one or more respective intensities of light, detected by the one or more optical sensors, for the first set of one or more selected wavelengths.

US Pat. No. 10,379,583

SYSTEM FOR DISCHARGING HEAT OUT OF HEAD-MOUNTED DISPLAY BASED ON HYBRID FAN AND HEAT PIPE

Facebook Technologies, LL...

1. A head-mounted display (HMD) comprising:a fan having a center axis extending from a rear side of the HMD to a front side of the HMD, the fan configured to pull air from a rear side of the HMD;
a printed circuit board (PCB) with one or more electronic components;
a heat pipe having an end coupled to the PCB, the heat pipe at least partially surrounding a periphery of the fan and transferring heat away from the PCB; and
an integrated metal frame onto which the PCB is directly mounted, the integrated metal frame in contact with the heat pipe and configured to function as a heat sink that receives the heat from the heat pipe and dissipates the heat, the integrated metal frame formed with a hole to receive the fan.

US Pat. No. 10,379,348

HYBRID FRESNEL LENS WITH INCREASED FIELD OF VIEW

FACEBOOK TECHNOLOGIES, LL...

1. A lens, defined by a first lens surface and a second lens surface opposite to the first lens surface, including:a first portion; and
a second portion that is distinct from the first portion and is located around the first portion, wherein:
the first lens surface for the first portion of the lens is defined by a Fresnel surface profile;
the second lens surface for the first portion of the lens is defined by a smooth surface profile;
the first lens surface for a second portion of the lens is defined by a Fresnel surface profile;
the second lens surface for the second portion of the lens is defined by a Fresnel surface profile; and
a derivative of the smooth surface profile defining the second lens surface for the first portion of the lens adjacent to a junction between the first portion of the lens and the second portion of the lens is substantially the same as a derivative of the Fresnel surface profile defining the second lens surface for the second portion of the lens adjacent to the junction between the first portion of the lens and the second portion of the lens.

US Pat. No. 10,379,356

ACCOMMODATION BASED OPTICAL CORRECTION

Facebook Technologies, LL...

1. A head mounted display (HMD) comprising:at least one processor;
an electronic display element configured to display a virtual scene to a user wearing the HMD;
an optics block configured to direct light from the electronic display element to an exit pupil of the HMD;
an eye tracking system configured to determine an eye position of each eye of the user; and
memory including instructions that, when executed by the at least one processor, cause the at least one processor to:
determine a position and orientation of the HMD worn by the user;
identify, for a frame of the virtual scene, an image for rendering based on the determined position and orientation of the HMD;
determine an accommodative state of a plurality of accommodative states for an eye of the user based on the eye position of each eye of the user;
determine optical aberration information for the determined eye position of each eye of the user for the determined accommodative state, the optical aberration information corresponding to one or more optical aberrations caused by the optics block as the light from the electronic display element passes through the optics block to the exit pupil, the optical aberration information being different for at least one eye position relative to other eye positions within at least one of the plurality of accommodative states;
determine a focus state for the optics block corresponding to a combination of the accommodative state and the determined eye position of the user, the determined focus state being mapped to a distortion correction of a plurality of distortion corrections, each distortion correction adding pre-distortion to the content for the determined focus state; and
display the identified image for the frame of the virtual scene on the electronic display element with the pre-distortion of the distortion correction for the determined focus state, the light of the image displayed with the pre-distortion being complementarily distorted by the optics block.

US Pat. No. 10,379,360

FRESNEL LENS WITH DYNAMIC DRAFT FOR VARIABLE GAZE

FACEBOOK TECHNOLOGIES, LL...

1. A display device, comprising:an electronic display; and
a lens configured for transmitting light in a first medium to a first reference pupil, comprising:
an optically transparent substrate having a first lens surface and a second lens surface opposite to the first lens surface, wherein:
the electronic display is coupled with the lens for outputting light through the lens;
the first lens surface includes a plurality of Fresnel structures, wherein a respective Fresnel structure of the plurality of Fresnel structures includes a slope facet and a draft facet, and the draft facet is characterized by a draft angle, relative to an optical axis of the lens, that is between a first angle for the respective Fresnel structure and a second angle for the respective Fresnel structure,
the first angle for the respective Fresnel structure corresponding to an angle between the optical axis of the lens and a direction of a chief ray, in the first medium, incident upon the slope facet of the respective Fresnel structure, wherein the chief ray:
is transmitted from a reference off-axis position on the electronic display, located away from the optical axis of the lens, and
is transmitted through the slope facet of the respective Fresnel structure and propagates toward a center of a second reference pupil; and
the second angle for the respective Fresnel structure corresponding to an angle between the optical axis of the lens and a direction of the chief ray, in the optically transparent substrate, that is transmitted through the slope facet of the respective Fresnel structure and propagates toward the center of the second reference pupil;
the draft angle of the respective Fresnel structure is distinct from the first angle and the second angle for the respective Fresnel structure, and the draft angle of the respective Fresnel structure is a predefined weighted average of the first angle and the second angle;
the first reference pupil is located at a first distance from the optically transparent substrate;
the second reference pupil is located at a second distance from the optically transparent substrate; and
the second distance is greater than the first distance.

US Pat. No. 10,379,366

APPARATUS, SYSTEM, AND METHOD FOR ADJUSTING HEAD-MOUNTED-DISPLAY STRAPS

Facebook Technologies, LL...

1. A head-mounted-display adjustment apparatus comprising:a spring assembly comprising a compression spring with a restoring force;
a strap comprising a distal section coupled to a head-mounted display and a proximal section coupled to the spring assembly such that:
the strap is extendable, via deflection of the spring, away from the head-mounted display, and
when a user is wearing the head-mounted display, the restoring force of the spring holds, via the strap, the head-mounted display against the user's face;
a projection assembly that couples the spring assembly to the head-mounted display and via which the spring assembly is extendable away from the head-mounted display, wherein extending the spring assembly away from the head-mounted display via the projection assembly decompresses the spring; and
a mount that couples the projection assembly to the head-mounted display.

US Pat. No. 10,379,419

FOCUS ADJUSTING PANCHARATNAM BERRY PHASE LIQUID CRYSTAL LENSES IN A HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

11. A head-mounted display (HMD) comprising:a varifocal block that receives content from an electronic display, and presents the content over a plurality of image planes that are associated with different optical powers of the varifocal block, the varifocal block comprising:
a switchable half waveplate (SHWP) that outputs circularly polarized light, and a handedness of the circularly polarized light is controlled by the SHWP being in an active state or a non-active state,
a plurality of liquid crystal (LC) lenses and each LC lens of the plurality of LC lenses is arranged in optical series with each other and the SHWP and each LC lens of the plurality of LC lenses has a plurality of optical states, the plurality of optical states including an additive state that adds optical power to the LC lens and a subtractive state that removes optical power from the LC lens, and
wherein the handedness of the circularly polarized light and the plurality of optical states of each of the plurality of the LC lenses together provide a range of adjustment of optical power for the varifocal block, and each value of optical power over the range of adjustment of optical power corresponds to a different image plane of the plurality of image planes.

US Pat. No. 10,371,872

VARIFOCAL STRUCTURE COMPRISING A LIQUID LENS STRUCTURE IN OPTICAL SERIES WITH A LIQUID CRYSTAL LENS IN A HEAD-MOUNTED DISPLAY AND METHOD OF ADJUSTING AN OPTICAL POWER OF THE VARIFOCAL STRUCTURE

Facebook Technologies, LL...

1. A varifocal block comprising:a liquid crystal (LC) lens that has an additive state that adds optical power to the LC lens and a subtractive state that removes optical power from the LC lens; and
a liquid lens structure in optical series with the LC lens, the liquid lens structure having an adjustable range of optical power;
wherein a range of adjustment of optical power for the varifocal block is based in part on the additive state of the LC lens, the subtractive state of the LC lens, and the adjustable range of optical power of the liquid lens structure.

US Pat. No. 10,373,936

PIXEL ELEMENTS INCLUDING LIGHT EMITTERS OF VARIABLE HEIGHTS

Facebook Technologies, LL...

1. A head-mounted display, comprising:a light source comprising a plurality of pixel elements configured to emit image light that includes at least two different optical bands of light, the light source further comprising:
a first sub-pixel mounted on a first set of microbumps at a first height from a substrate and configured to emit light within a first optical band, and
a second sub-pixel mounted on a second set of microbumps at a second height from the substrate that is different from the first height, and the second sub-pixel is configured to emit light over a second optical band that is different than the first optical band, each of the first sub-pixel and the second sub-pixel comprising a plurality of light emitting elements; and
an optical block configured to receive the image light from the light source, and direct the image light to an eyebox, wherein the first height and the second height are configured to mitigate longitudinal chromatic aberration in the optical block.

US Pat. No. 10,371,952

FRESNEL LENS WITH DYNAMIC PITCH

FACEBOOK TECHNOLOGIES, LL...

1. A lens for directing light from an electronic display toward a first reference pupil through a first medium, the lens comprising:an optically transparent substrate having a first lens surface and a second lens surface opposite to the first lens surface, wherein:
the first lens surface includes a plurality of Fresnel structures, wherein a respective Fresnel structure of the plurality of Fresnel structures is characterized by a representative pitch;
the representative pitch of the respective Fresnel structure is based on a distance of the respective Fresnel structure from a reference axis of the lens;
the respective Fresnel structure of the plurality of Fresnel structures includes a slope facet and a draft facet;
the draft facet is characterized by a draft angle, relative to an optical axis of the lens, that is between a first angle for the respective Fresnel structure and a second angle for the respective Fresnel structure,
the first angle for the respective Fresnel structure corresponding to an angle between the optical axis of the lens and a direction of a chief ray, in the first medium, incident upon the slope facet of the respective Fresnel structure, wherein the chief ray:
is transmitted from a reference off-axis position on the electronic display, located away from the optical axis of the lens, and
is transmitted through the slope facet of the respective Fresnel structure and propagates toward a center of the first reference pupil;
the second angle for the respective Fresnel structure corresponding to an angle between the optical axis of the lens and a direction of the chief ray, in the optically transparent substrate, that is transmitted through the slope facet of the respective Fresnel structure and propagates toward the center of the first reference pupil;
the draft angle of the respective Fresnel structure is distinct from the first angle and the second angle for the respective Fresnel structure; and
the draft angle of the respective Fresnel structure is a predefined weighted average of the first angle and the second angle.

US Pat. No. 10,347,094

SKIN STRETCH INSTRUMENT

Facebook Technologies, LL...

1. A method comprising:receiving information from sensors of a haptic device worn by a user;
determining that the user is interacting with a virtual object in an environment according to at least the received information;
retrieving, based on a type of the virtual object, skin stretch information from a database, the database including a plurality of skin stretch information mapped to types of objects, the plurality of skin stretch information generated from previous interactions of users with physical objects associated with the types of objects; and
responsive to determining that the user is interacting with the virtual object, providing an instruction to the haptic device to physically stretch skin of the user to simulate interaction with a physical object according to the retrieved skin stretch information, the physical object associated with the type of the virtual object.

US Pat. No. 10,409,392

HAND-HELD CONTROLLER TRACKED BY LED MOUNTED UNDER A CONCAVED DOME

Facebook Technologies, LL...

1. A handheld controller, comprising:a handle shaped and dimensioned to be grasped by a user's hand;
a body attached to an end of the handle, the body having:
an inner surface formed with a plurality of concaved domes, and
an outer surface facing away from the inner surface; and
a plurality of light emitting diodes (LEDs) emitting light, each of the LEDs mounted under each of the plurality of concaved domes and facing the concaved dome to emit light into the concaved dome,
wherein the light emitted by the LEDs is spread at the concaved domes and transmitted out of the body through the outer surface for capturing by an imaging device to track a position or orientation of the handheld controller.

US Pat. No. 10,366,674

DISPLAY CALIBRATION IN ELECTRONIC DISPLAYS

Facebook Technologies, LL...

16. A system comprising:a one-dimensional photo-detector configured to measure luminance parameters of pixels of an electronic display, wherein the electronic display includes a plurality of columns of pixels and the luminance parameters include a brightness level and a color for each of the measured pixels, wherein each pixel is composed of a plurality of sub-pixels types, where different types of sub-pixels are configured to emit light at different colors of light; and
a controller configured to:
instruct the electronic display to activate sub-pixels of the same color type in the pixels of the electronic display using a plurality of sparse patterns and each sparse pattern describes a respective subset of sub-pixels within a single respective column, and for each sparse pattern:
there is a fixed number of inactive pixels between adjacent active pixels in the single respective column,
the respective subset of sub-pixels within the respective column is sequentially presented in a rolling manner such that no two sub-pixels of the electronic display are active over a same time period, and
the respective subset of pixels in the single respective column described by the sparse pattern are activated before advancing to another sparse pattern that describes a subset of pixels in an adjacent column,
instruct the one-dimensional photo-detector to measure luminance parameters for each of the pixels in each of the plurality of sparse patterns, and
generate calibration data based on the measured luminance parameters of the pixels in each of the plurality of sparse patterns, the calibration data including a brightness level adjustment to one or more of the pixels such that brightness levels of corresponding pixels are within a range of brightness levels, and a color adjustment to one or more of the pixels is such that colors of corresponding pixels are within a range of colors.

US Pat. No. 10,367,122

INTEGRATED COLOUR LED MICRO-DISPLAY

Facebook Technologies, LL...

1. An integrated light emitting diode (LED) micro-display, comprising:a color converter configured to change wavelength of light, the color converter including:
a color conversion layer; and
a long pass filter on the color conversion layer, wherein the long pass filter allows converted light by the color conversion layer to pass from the color conversion layer, and recycles unconverted light;
a micro-LED array connected to the color converter, the LED array configured to form electrical connections and pump light into the color converter; and
a backplane controller for the micro-LED array including an electronic drive layer, the color conversion layer of the color converter producing light at a longer wavelength than the pumped light from the micro-LED array.

US Pat. No. 10,430,939

FULL DISPLAY PANEL GRID-BASED VIRTUAL IMAGE DISTANCE TEST SUBSYSTEM FOR EYECUP ASSEMBLIES OF HEAD MOUNTED DISPLAYS

Facebook Technologies, LL...

1. An optical evaluation workstation comprising:an eyecup assembly feeder configured to receive an eyecup assembly of a head mounted display (HMD), the eyecup assembly comprising an optics block and an electronic display panel, and the electronic display panel is presenting one or more test patterns;
a lens assembly positioned at a fixed distance from the eyecup assembly along an alignment axis passing through the optics block and electronic display panel of the eyecup assembly;
an imaging sensor assembly positioned along the alignment axis and configured to capture one or more images of the one or more test patterns presented by the electronic display panel through the optics block and the lens assembly; and
a processor configured to:
instruct the imaging sensor assembly to move along a back focus adjustment path, the back focus adjustment path being a path along the alignment axis from a first position to a second position; and
instruct the imaging sensor assembly to capture a plurality of images when the imaging sensor assembly is at different positions along the back focus adjustment path;
determine, for multiple of the plurality of images captured by the imaging sensor assembly, a level of sharpness for one or more color channels of each image of the multiple images;
select, for each color channel, an image having a highest level of sharpness for that color channel;
determine, for each selected image, a respective position of the imaging sensor assembly associated with the selected image; and
determine one or more virtual image distances for the eyecup assembly based on the determined positions of the imaging sensor assembly for each selected image, a virtual image distance being a distance from a position of the exit pupil of the eyecup assembly to a virtual image of the electronic display panel, as viewed through the optics block.

US Pat. No. 10,426,338

SCLERAL COIL EYE TRACKING SYSTEM

Facebook Technologies, LL...

1. An eye tracking system comprising:a first body enclosing a first area;
a second body enclosing a second area parallel to the first area, the second area facing the first area in a first direction;
an auxiliary body coupled to the first body and enclosing a third area, the third area facing the first area in a second direction offset from the first direction;
a first looping coil coupled to a perimeter of the first body;
a second looping coil coupled to a perimeter of the second body, the first looping coil and the second looping coil configured to generate substantially uniform magnetic fields; and
an auxiliary looping coil coupled to a perimeter of the auxiliary body, the auxiliary looping coil configured to generate divergent magnetic fields; and
a scleral lens configured to be worn on an eye of a user, the scleral lens placed within the substantially uniform magnetic fields and the divergent magnetic fields, the scleral lens including a scleral coil, the substantially uniform magnetic fields and the divergent magnetic fields inducing currents in the scleral coil that are used to determine an orientation of the eye.

US Pat. No. 10,429,927

EYE TRACKING FOR A HEAD MOUNTED DISPLAY INCLUDING A PANCAKE LENS BLOCK

Facebook Technologies, LL...

1. A head mounted display (HMD) comprising:at least one processor;
an electronic display screen configured to display a virtual scene to a user wearing the HMD;
a lens block comprising:
a back curved optical element that includes a partially reflective layer configured to transmit a portion of light incident on the partially reflective layer and to reflect another portion of the light back towards the electronic display screen; and
a front curved optical element in optical series with the back curved optical element configured to reflect the portion of the light from the electronic display screen transmitted through the partially reflective layer of the back curved optical element back towards the back curved optical element, the partially reflective layer of the back curved optical element reflecting a second portion of the light from the front curved optical element back to the front curved optical element for transmission to an exit pupil of the HMD; and
an eye tracking system comprising:
a dichroic coating on a transmission surface of the electronic display screen configured to transmit light from the electronic display and reflect near-infrared spectrum light;
an image capturing element configured to receive the near-infrared spectrum light from the eye of the user that has been reflected off the dichroic coating on the electronic display screen; and
an infrared (IR) emitter configured to emit the near-infrared spectrum light towards the dichroic coating to illuminate the eye of the user wearing the HMD, wherein the lens block and the dichroic coating are configured in combination to cause the near-infrared spectrum light reflected from the eye of the user to be:
transmitted, by the partially reflective layer of the back optical element, toward the dichroic coating,
reflected, by the dichroic coating, back towards the partially reflective layer of the back optical element,
reflected, at least one second time by the partially reflective layer of the back optical element, back toward the dichroic coating, and
reflected, by the dichroic coating, to the image capturing element.

US Pat. No. 10,427,366

MANUFACTURING MICROLENS ARRAYS USING A PROGRESSIVE INDENT SYSTEM

Facebook Technologies, LL...

1. A system comprising:a die comprising a plurality of protrusions that protrude outwards from a surface of the die, each of the protrusions having a different priority that is based on a relative size of each protrusion, wherein the die is a unitary die;
an actuator coupled to the die, the actuator configured to stamp a substrate with one or more of the plurality of protrusions on the die in accordance with actuation instructions; and
a controller configured to:
generate actuation instructions that cause the actuator to stamp out a plurality of microlens molds into the substrate, where each microlens mold is generated by stamping, in a specific order based on priority, each of the plurality of protrusions on a same corresponding location on the substrate, and
provide the actuation instructions to control the actuator.

US Pat. No. 10,430,988

FACIAL ANIMATION USING FACIAL SENSORS WITHIN A HEAD-MOUNTED DISPLAY

Facebook Technologies, LL...

1. A method comprising:causing, inside a head mounted display (HMD), a plurality of light sources to emit light by a single light source at a time in a particular sequence to illuminate a portion of a face of a user wearing the HMD, wherein the portion of the face includes the eyes of the user and portions of an eyebrow and a cheek of the user;
capturing a plurality of facial data of the portion of the face using one or more facial sensors located inside the HMD, wherein the plurality of facial data describes a plurality of frames of an image including a plurality of pixels, each pixel associated with a different coordinate location of the image, each of the plurality of frames captured when a different single light source of the plurality of light sources illuminated the portion of the face;
for each coordinate location of the image:
identifying a frame of the plurality of frames having the greatest intensity value based on reflected light from the portion of the face at the coordinate location;
identifying a position of a light source of the plurality of light sources illuminating the portion of the face when the frame was captured, the reflected light originating from the light source;
determining a planar section of the portion of the face based on the position of the light source and the coordinate location; and
determining a normal vector to the planar section based on the position of the light source illuminating the portion of the face when the frame of the plurality of frames having the greatest intensity value was captured;
generating a virtual surface describing orientation of the portion of the face by aggregating the normal vectors for the planar sections;
mapping the virtual surface to one or more landmarks of the face; and
generating facial animation information based at least in part on the mapping and the virtual surface, the facial animation information describing a portion of a virtual face corresponding to the portion of the face.

US Pat. No. 10,429,210

BIREFRINGENCE DEFORMATION SENSING APPARATUS HAVING A CONTROLLER TO INSTRUCT THE FUNCTION OF A TRANSMITTER AND A RECEIVER

Facebook Technologies, LL...

1. A deformation sensing apparatus comprising:a propagation channel that is deformable;
a transmitter coupled to a first end of the propagation channel;
a receiver coupled to a second end of the propagation channel; and
a controller configured to instruct the transmitter to transmit a signal, instruct the receiver to capture one or more measurements of the transmitted signal, and determine a bend in the propagation channel based on the one or more measurements.

US Pat. No. 10,432,908

REAL-TIME MULTIFOCAL DISPLAYS WITH GAZE-CONTINGENT RENDERING AND OPTIMIZATION

Facebook Technologies, LL...

1. A method comprising:determining a first pixel intensity value for each pixel in at least a portion of a plurality of pixels of a plurality of displays by modifying an initial intensity value for the pixel using at least one numerical iteration applied on one or more correlation values related to at least the portion of the plurality of pixels;
determining a second pixel intensity value for each pixel in at least the portion of the plurality of pixels using the first intensity value and applying one or more numerical iterations;
determining information about a gaze direction for an eye relative to the plurality of displays;
modifying the second pixel intensity value based on the information about the gaze direction; and
determining a pixel intensity value for each pixel in at least the portion of the plurality of pixels to generate content for presentation, based on the modified second pixel intensity value.

US Pat. No. 10,422,362

FLUIDIC PUMP AND LATCH GATE

Facebook Technologies, LL...

1. A fluidic device comprising:a channel conduit configured to transport fluid from a first fluid entrance to a fluid exit, wherein the first fluid entrance is an input for the fluid in the channel conduit, and the fluid exit is an output for the fluid in the channel conduit;
a pump chamber configured to receive fluid from a second fluid entrance, wherein the second fluid entrance is an input for the fluid in the pump chamber, the pump chamber including a first inner surface and a second inner surface, a portion of the second inner surface of the pump chamber adjacent to the channel conduit and a gap in the portion of the second inner surface of the pump chamber forming the first fluid entrance of the channel conduit; and
a valve apparatus located within the pump chamber, the valve apparatus configured to change position to control a rate of fluid flow from the pump chamber into the channel conduit via the first fluid entrance of the channel conduit in accordance with a fluid pressure within the pump chamber, the valve apparatus configured to induce a first flow rate of fluid from the pump chamber into the channel conduit via the first fluid entrance of the channel conduit in accordance with a first fluid pressure within the pump chamber and a second flow rate of fluid from the pump chamber into the channel conduit via the first fluid entrance of the channel conduit in accordance with a second fluid pressure within the pump chamber, that is higher than the first fluid pressure.

US Pat. No. 10,422,637

WAVE REFLECTION DEFORMATION SENSING APPARATUS

Facebook Technologies, LL...

1. A deformation sensing apparatus comprising:a propagation channel;
a transmitter coupled to the propagation channel and configured to transmit a signal from a first end of the propagation channel along a length of the propagation channel; and
a receiver coupled to the propagation channel and configured to:
detect a first reflected signal corresponding to a first reflection of the signal along the length of the propagation channel, and
responsive to a bend in the propagation channel, detect a second reflected signal corresponding to a second reflection of the signal from a position of the bend along the length of the propagation channel.

US Pat. No. 10,425,762

HEAD-RELATED IMPULSE RESPONSES FOR AREA SOUND SOURCES LOCATED IN THE NEAR FIELD

FACEBOOK TECHNOLOGIES, LL...

1. A method comprising:at a virtual-reality device displaying a virtual scene:
generating audio data associated with an area source in the virtual scene, wherein the area source is located within a predefined near-field distance from the listener;
selecting a plurality of sample point sources from the area source;
projecting the audio data onto a virtual sphere surrounding the listener, the virtual sphere being divided into a plurality of concentric spherical shells that extend from the listener to the predefined near-field distance;
determining, for each sample point source, energy contributions of the sample point source to two respective successive shells of the plurality of spherical shells, that enclose the sample point source, wherein the determined energy contributions correspond to sound originating from the sample point source;
determining a head-related impulse response (HRIR) for each shell by combining energy contributions, from the determined energy contributions, that are associated with the respective shell;
determining an overall HRIR for the virtual scene by combining the determined HRIRs for the plurality of shells;
convolving the audio data with the overall HRIR; and
transmitting the convolved audio data to sound-producing devices of the virtual-reality device.

US Pat. No. 10,419,701

DIGITAL PIXEL IMAGE SENSOR

FACEBOOK TECHNOLOGIES, LL...

20. A method comprising:starting a single counter to output count values to a plurality of pixels of an image sensor;
exposing a photodiode of each pixel of the plurality of pixels to light during an exposure period;
controlling the each pixel to convert the light received by the photodiode of the each pixel into a voltage signal on a charge storage device of the each pixel;
controlling a comparator of the each pixel to compare the voltage signal with a ramp signal to generate a switching output, wherein a voltage level of the ramp signal increases or decreases linearly with a number of clock cycles, and wherein the switching output is generated based on the voltage level of the ramp signal reaching the voltage level of the voltage signal;
responsive to the switching output of the comparator, storing, at a pixel memory of the each pixel, a first count value of the count values received from the single counter, wherein the stored first count value corresponds to a digitized value of the voltage level of the voltage signal.

US Pat. No. 10,416,445

LENSES WITH CONSISTENT DISTORTION PROFILE

Facebook Technologies, LL...

1. A head-mounted display device, comprising:a display; and
a lens separate from the display, the lens having an optically transparent substrate, wherein:
the lens is configured to focus light from a first location of the display on a pupil of an eye of a wearer in a first rotational position and focus light from a second location, distinct from the first location, of the display on the pupil of the eye of the wearer in a second rotational position that is distinct from the first rotational position;
the first location of the display is located at a first distance from an optical axis of the lens and the second location of the display is located at a second distance, distinct from the first distance, from the optical axis of the lens;
the light from the first location of the display to the pupil of the eye of the wearer in the first rotational position and the light from the second location of the display to the pupil of the eye of the wearer in the second rotational position have a same optical path length; and
the optical path length is determined based in part on a refractive index of the optically transparent substrate.

US Pat. No. 10,416,454

COMBINATION PRISM ARRAY FOR FOCUSING LIGHT

Facebook Technologies, LL...

1. A beam deflector device, comprising:a single integrated substrate that has a planar entrance surface and a non-planar exit surface, wherein the single integrated substrate includes, on the non-planar exit surface:
a first array of light-steering components, a respective component of the first array of light-steering components located at a respective distance less than a predefined distance from a reference point and the respective component of the first array of light-steering components comprising an optical prism having an apex angle that is less than a critical angle corresponding to an angle of incidence beyond which light is reflected by total internal reflection, wherein the first array of light-steering components includes a first prism having a first apex angle and a second prism having a second apex angle that is distinct from the first apex angle, wherein the first prism is in contact with the second prism; and
a second array of light-steering components, a respective component of the second array of light-steering components located at a respective distance greater than the predefined distance from the reference point and the respective component of the second array of light-steering components comprising an optical prism having an apex angle that is greater than the critical angle, wherein the second array of light-steering components includes a third prism having a third apex angle that is distinct from the first apex angle and the second apex angle and a fourth prism having a fourth apex angle that is distinct from the first apex angle, the second apex angle, and the third apex angle, wherein the third prism is adjacent to, and separated by a distance, from the fourth prism.

US Pat. No. 10,416,461

PANCAKE LENS WITH LARGE FOV

Facebook Technologies, LL...

1. A head mounted display (HMD) comprising:an electronic display configured to display image light; and
a pancake lens block comprising:
a hybrid film configured to act as both a reflective polarizer and a quarter waveplate, wherein the hybrid film consists essentially of:
a plurality of first plastic sheets having an ordinary index along a first axis and an extraordinary index along a second axis, the first and second axis are 90 degrees from each other; and
a plurality of second plastic sheets having an ordinary index along a first axis and a second axis, and the axes of a portion of the plurality of first plastics sheets and a portion of the plurality of second plastic sheets are oriented 45 degrees to each other;
a back curved optical element that alters the image light, the back curved optical element including a back first surface and a back second surface, the back first surface configured to receive the image light, and the back second surface configured to output altered image light; and
a front curved optical element that further alters the altered image light, the front curved optical element including a front first surface and a front second surface, the front second surface coupled to the back second surface such that the back curved optical element and the front curved optical element form a monolithic optical element, wherein the hybrid film is between the back second surface and the front second surface, and a first portion of the altered image light is reflected by the front first surface of the front curved optical element toward the back curved optical element, and the hybrid film reflects a second portion of the first portion of the altered image light back to the front curved optical element and changes a polarization from circular to linear for transmission to an exit pupil of the HMD.