Maxim Zahariev Lazarov, Age 6928452 Rancho Cristiano, Laguna Beach, CA 92677

2022029, Sep 15, 2022

Jun 1, 2022

17/829907

- Santa Monica CA, US
Samuel Edward Hare - Los Angeles CA, US
Maxim Maximov Lazarov - Culver City CA, US
Tony Mathew - Los Angeles CA, US
Andrew James McPhee - Culver City CA, US
Daniel Moreno - Los Angeles CA, US
Wentao Shang - Los Angeles CA, US

H04N 5/262
H04L 51/046
H04N 5/272
H04L 51/10

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image from a camera of a user device; receiving input that selects a user-customizable effects option for activating a user-customizable effects mode; in response to receiving the input, displaying an array of a plurality of effect options together with the image proximate to the user-customizable effects option; and applying a first effect associated with a first effect option of the plurality of effect options to the image.

2022028, Sep 8, 2022

Nov 12, 2021

17/525612

- Santa Monica CA, US
Samuel Edward Hare - Los Angeles CA, US
Maxim Maximov Lazarov - Culver City CA, US
Tony Mathew - Los Angeles CA, US
Andrew James McPhee - Culver City CA, US
Daniel Moreno - Los Angeles CA, US
Dhritiman Sagar - Marina del Rey CA, US
Wentao Shang - Los Angeles CA, US

G06T 19/00
G06T 7/194
G06T 7/50
H04L 67/131

The subject technology receives image data and depth data. The subject technology selects an augmented reality content generator corresponding to a three-dimensional (3D) effect. The subject technology applies the 3D effect to the image data and the depth data based at least in part on the selected augmented reality content generator. The subject technology generates, using a processor, a message including information related to the applied 3D effect, the image data, and the depth data.

2023008, Mar 23, 2023

Dec 1, 2022

18/073280

- Santa Monica CA, US
Samuel Edward Hare - Los Angeles CA, US
Maxim Maximov Lazarov - Culver City CA, US
Tony Mathew - Las Angeles CA, US
Andrew James McPhee - Culver City CA, US
Daniel Moreno - Los Angeles CA, US
Wentao Shang - los Angeles CA, US

H04L 5/00
H04L 27/18

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.

2023007, Mar 9, 2023

Nov 16, 2022

18/056099

- Santa Monica CA, US
Samuel Edward Hare - Los Angeles CA, US
Maxim Maximov Lazarov - Culver City CA, US
Tony Mathew - Los Angeles CA, US
Andrew James McPhee - Culver City CA, US
Daniel Moreno - Los Angeles CA, US
Wentao Shang - Los Angeles CA, US

G06T 19/00
G06F 3/0482
G06F 3/0488
G06T 5/00
G06F 3/04815

The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.

2023003, Feb 2, 2023

Oct 10, 2022

17/963090

- Santa Monica CA, US
Samuel Edward Hare - Los Angeles CA, US
Maxim Maximov Lazarov - Culver City CA, US
Tony Mathew - Los Angeles CA, US
Andrew James McPhee - Culver City CA, US
Wentao Shang - Los Angeles CA, US

G06T 19/00
G06T 7/194
G06T 7/11
G06F 3/01
G06T 15/20
G06T 19/20

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for rendering virtual modifications to real-world environments depicted in image content. A reference surface is detected in a three-dimensional (3D) space captured within a camera feed produced by a camera of a computing device. An image mask is applied to the reference surface within the 3D space captured within the camera feed. A visual effect is applied to the image mask corresponding to the reference surface in the 3D space. The application of the visual effect to the image mask causes a modified surface to be rendered in presenting the camera feed on a display of the computing device.

2023001, Jan 19, 2023

Sep 22, 2022

17/950761

- Santa Monica CA, US
Samuel Edward Hare - Los Angeles CA, US
Maxim Maximov Lazarov - Culver City CA, US
Tony Mathew - Los Angeles CA, US
Andrew James McPhee - Culver City CA, US
Daniel Moreno - Los Angeles CA, US
Dhritiman Sagar - Marina del Rey CA, US
Wentao Shang - Los Angeles CA, US

H04N 13/128
G06T 7/571
H04N 13/111
H04L 67/131
H04N 13/239
G06T 19/00
G06T 7/593
H04N 13/00

The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.

2023001, Jan 19, 2023

Sep 23, 2022

17/952051

- Santa Monica CA, US
Samuel Edward Hare - Los Angeles CA, US
Maxim Maximov Lazarov - Culver City CA, US
Tony Mathew - Los Angeles CA, US
Andrew James McPhee - Culver City CA, US
Daniel Moreno - Los Angeles CA, US
Dhritiman Sagar - Marina del Rey CA, US
Wentao Shang - Los Angeles CA, US

G06T 19/00
G06F 3/04842
G06T 7/50
H04L 51/42

The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.

2023000, Jan 5, 2023

Aug 1, 2022

17/878635

- Santa Monica CA, US
Samuel Edward Hare - Los Angeles CA, US
Maxim Maximov Lazarov - Culver City CA, US
Tony Mathew - Los Angeles CA, US
Andrew James McPhee - Culver City CA, US
Daniel Moreno - Los Angeles CA, US
Dhritiman Sagar - Marina del Rey CA, US
Wentao Shang - Los Angeles CA, US

G06T 19/20
G06N 20/00
G06F 3/04842
G06F 3/04883
G06T 15/50
G06T 7/507
G06V 40/16

The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.