US Pat. No. 10,063,987

METHOD, APPARATUS, AND COMPUTER-READABLE MEDIA FOR FOCUSSING SOUND SIGNALS IN A SHARED 3D SPACE

NUREVA INC., Calgary (CA...

1. A method of focusing combined sound signals from a plurality of physical microphones in order to determine a processing gain for each of a plurality of virtual microphone locations in a shared 3D space, comprising:defining, by at least one processor, a plurality of virtual microphone bubbles in the shared 3D space, each bubble having location coordinates in the shared 3D space, each bubble corresponding to a virtual microphone;
receiving, by the at least one processor, sound signals from the plurality of physical microphones in the shared 3D space;
determining, by the at least one processor, a processing gain at each of the plurality of virtual microphone bubble locations, based on a received combination of sound signals sourced from each virtual microphone bubble location in the shared 3D space;
identifying, by the at least one processor, a sound source in the shared 3D space, based on the determined processing gains, the sound source having coordinates in the shared 3D space; and
focusing, by the at least one processor, combined signals from the plurality of physical microphones to the sound source coordinates by adjusting a weight and a delay for signals received from each of the plurality of physical microphones; and
outputting, by the at least one processor, a plurality of streamed signals comprising (i) real-time location coordinates, in the shared 3D space, of the sound source, and (ii) sound source processing gain values associated with each virtual microphone bubble in the shared 3D space.

US Pat. No. 10,338,713

METHOD, APPARATUS AND COMPUTER-READABLE MEDIA FOR TOUCH AND SPEECH INTERFACE WITH AUDIO LOCATION

Nureva, Inc., (CA)

1. Touch and speech input with audio location apparatus configured for one or more users to provide input to (i) a touch sensitive input device and (ii) a speech input device in a shared physical space, comprising:at least one memory storing a plurality of words in a global dictionary; and
at least one processor configured to:
receive an input from the touch sensitive input device in the shared physical space;
establish a touch time window with respect to the received input from the touch sensitive input device;
receive an input from the speech input device in the shared physical space;
determine whether the received input from the speech input device is present in the global dictionary;
determine a position location of a sound source in the shared physical space from the received input from the speech input device;
determine whether the received input from the touch sensitive input device and the position location of received input from the speech input device are both within a same region of the touch sensitive input device in the shared physical space;
if the received input from the speech input device is present in the global dictionary, determine whether the received input from the speech input device has been received within the established touch time window; and
if the received input from the speech input device has been received within the established touch time window, and the received input from the touch sensitive input device and the received input from the speech input device are both within a same region of the touch sensitive input device in the shared physical space, activate an action corresponding to both (i) the received input from the touch sensitive input device and (ii) the received input from the speech input device.