selfie video stabilization

Department: Computer Science & Engineering
Research Institute Affiliation: Center for Visual Computing
Faculty Advisor(s): Ravi Ramamoorthi

Primary Student
Name: Jiyang Yu
Phone: 858-699-7482
Grad Year: 2020

We propose a novel algorithm for stabilizing selfie videos. Our goal is to automatically generate stabilized video that has optimal smooth motion in the sense of both foreground and background. The key insight is that non-rigid foreground motion in selfie videos can be analyzed using a 3D face model, and background motion can be analyzed using optical flow. We use second derivative of temporal trajectory of selected pixels as the measure of smoothness. Our algorithm stabilizes selfie videos by minimizing the smoothness measure of the background, regularized by the smoothness measure of the foreground. Experiments show that our method outperforms state-of-the-art general video stabilization techniques in selfie videos.

Industry Application Area(s)
Internet, Networking, Systems | Software, Analytics

« Back to Posters or Search Results