Qian HuangBrooklyn, NY

6405166, Jun 11, 2002

Oct 15, 2001

09/976023

Qian Huang - Ocean NJ
Ivan Magrin-Chagnolleau - Houston TX
Sarangarajan Parthasarathy - New Providence NJ
Aaron Edward Rosenberg - Berkeley Heights NJ

ATT Corp. - New York NY

G10L 1700

704246, 704243, 704247

A multimedia search apparatus and method for searching multimedia content using speaker detection to segment the multimedia content. The multimedia search apparatus receives a search request from a user device. The search request identifies the target speaker for which the search is to be conducted. Based on the search request, the multimedia search apparatus retrieves multimedia content from a multimedia database. The multimedia search apparatus retrieves models, such as Gaussian Mixture Models (GMMs), from a model storage device, corresponding to the target speaker and background data. Based on the retrieved models, the multimedia search device searches the multimedia data of the multimedia content and segments the multimedia data. The segments are identified by calculating an average normalized score for a block of frames of the multimedia data and determining if the average normalized score for the block of frames exceeds one or more predetermined thresholds.

6593936, Jul 15, 2003

Feb 1, 2000

09/495171

Qian Huang - Ocean NJ
Joern Ostermann - Morganville NJ
Atul Puri - Riverdale NY
Raj Kumar Rajendran - New York NY

ATT Corp. - New York NY

G06T 1500

345619

A method and system for description of synthetic audiovisual content makes it easier for humans, software components or devices to identify, manage, categorize, search, browse and retrieve such content. For instance, a user may wish to search for specific synthetic audiovisual objects in digital libraries, Internet web sites or broadcast media; such a search is enabled by the invention. Key characteristics of synthetic audiovisual content itself such as the underlying 2d or 3d models and parameters for animation of these models are used to describe it. More precisely, to represent features of synthetic audiovisual content, depending on the description scheme to be used, a number of descriptors are selected and assigned values. The description scheme instantiated with descriptor values is used to generate the description, which is then stored for actual use during query/search. Typically, a user, to search for a needed synthetic audiovisual content initiates a query that is passed on to a search engine that then retrieves the candidate content from one or more databases whose description closely matches the query criteria specified by the user.

6714909, Mar 30, 2004

Nov 21, 2000

09/716278

David Crawford Gibbon - Lincroft NJ
Qian Huang - Rockville MD
Zhu Liu - Middletown NJ
Aaron Edward Rosenberg - Berkeley Heights NJ
Behzad Shahraray - Freehold NJ

ATT Corp. - New York NY

G10L 1700

704246, 704251, 7042701, 707 3, 707102

The invention provides a system and method for automatically indexing and retrieving multimedia content. The method may include separating a multimedia data stream into audio, visual and text components, segmenting the audio, visual and text components based on semantic differences, identifying at least one target speaker using the audio and visual components, identifying a topic of the multimedia event using the segmented text and topic category models, generating a summary of the multimedia event based on the audio, visual and text components, the identified topic and the identified target speaker, and generating a multimedia description of the multimedia event based on the identified target speaker, the identified topic, and the generated summary.

6801895, Oct 5, 2004

Dec 6, 1999

09/455492

Qian Huang - Ocean NJ
Zhu Liu - Brooklyn NY

ATT Corp. - New York NY

G10L 2100

704270, 704256, 704233, 704500, 704246, 348468

The present invention provides for a method and apparatus for segmenting a multi-media program based upon audio events. In an embodiment a method of classifying an audio stream is provided. This method includes receiving an audio stream. Sampling the audio stream at a predetermined rate and then combining a predetermined number of samples into a clip. A plurality of features are then determined for the clip and are analyzed using a linear approximation algorithm. The clip is then characterized based upon the results of the analysis conducted with the linear approximation algorithm.

7184959, Feb 27, 2007

Oct 15, 2003

10/686459

David Crawford Gibbon - Lincroft NJ, US
Qian Huang - Rockville MD, US
Zhu Liu - Middletown NJ, US
Aaron Edward Rosenberg - Berkley Heights NJ, US
Behzad Shahraray - Freehold NJ, US

AT&T Corp. - New York NY

G10L 17/00
G06F 17/28
G06F 17/30

704270, 704246, 725 40

The invention provides a system and method for automatically indexing and retrieving multimedia content. The method may include separating a multimedia data stream into audio, visual and text components, segmenting the audio, visual and text components based on semantic differences, identifying at least one target speaker using the audio and visual components, identifying a topic of the multimedia event using the segmented text and topic category models, generating a summary of the multimedia event based on the audio, visual and text components, the identified topic and the identified target speaker, and generating a multimedia description of the multimedia event based on the identified target speaker, the identified topic, and the generated summary.

7185049, Feb 27, 2007

Feb 1, 2000

09/495175

Ana Belen Benitez - New York NY, US
Shih-Fu Chang - New York NY, US
Qian Huang - Ocean NJ, US
Seungyup Paek - New York NY, US
Atul Puri - Riverdale NY, US

AT&T Corp. - New York NY

G06F 15/16
G06F 7/00

709203, 707103

The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database.

7254285, Aug 7, 2007

Nov 5, 1999

09/831215

Ana Benitez - New York NY, US
Shih-Fu Chang - New York NY, US
Chung-Sheng Li - Ossining NY, US
John R. Smith - New York NY, US
Lawrence D. Bergman - Mt. Kisco NY, US
Atul Puri - Mountain View CA, US
Qian Huang - Rockville MD, US

G06K 9/60

382305, 382282, 382295, 358538, 358453

Systems and methods for describing image content establish image description records which include an object set (), an object hierarchy () and entity relation graphs (). For image content, image objects can include global objects (O) and local objects (O and O). The image objects are further defined by a number of features of different classes ( and ), which in turn are further defined by a number of feature descriptors. The relationships between and among the objects in the object set are defined by the object hierarchy () and entity relation graphs (). The image description records provide a standard vehicle for describing the content and context of image information for subsequent access and processing by computer applications such as search engines, filters, and archive systems.

7319964, Jan 15, 2008

Jun 7, 2004

10/862728

Qian Huang - Ocean NJ, US
Zhu Liu - Brooklyn NY, US

AT&T Corp. - New York NY

G10L 21/00

704278, 704270, 704254, 704255

The present invention provides for a method and apparatus for segmenting a multi-media program based upon audio events. In an embodiment a method of classifying an audio stream is provided. This method includes receiving an audio stream. Sampling the audio stream at a predetermined rate and then combining a predetermined number of samples into a clip. A plurality of features are then determined for the clip and are analyzed using a linear approximation algorithm. The clip is then characterized based upon the results of the analysis conducted with the linear approximation algorithm.