MegaSaM

Accurate, Fast and Robust Structure and Motion from Casual Dynamic Videos

Zhengqi Li1, 4&nbsp&nbsp&nbsp&nbsp Richard Tucker1&nbsp&nbsp&nbsp&nbsp Forrester Cole 1&nbsp&nbsp&nbsp&nbsp Qianqian Wang1,2&nbsp&nbsp&nbsp&nbsp Linyi Jin1,3&nbsp&nbsp&nbsp&nbsp Vickie Ye2&nbsp&nbsp&nbsp&nbsp Angjoo Kanazawa2&nbsp&nbsp&nbsp&nbsp Aleksander Holynski1,2&nbsp&nbsp&nbsp&nbsp Noah Snavely1
1Google DeepMind &nbsp&nbsp&nbsp&nbsp 2UC Berkeley &nbsp&nbsp&nbsp&nbsp 3University of Michigan &nbsp&nbsp&nbsp&nbsp 4Adobe Research

CVPR 2025 (Best Paper Honorable Mention)

TL;DR: MegaSaM estimates cameras and dense structure, quickly and accurately, from any static or dynamic video.

Abstract

We present a system that allows for accurate, fast, and robust estimation of camera parameters and depth maps from casual monocular videos of dynamic scenes. Most conventional structure from motion and monocular SLAM techniques assume input videos that feature predominantly static scenes with large amounts of parallax. Such methods tend to produce erroneous estimates in the absence of these conditions. Recent neural network-based approaches attempt to overcome these challenges; however, such methods are either computationally expensive or brittle when run on dynamic videos with uncontrolled camera motion or unknown field of view. We demonstrate the surprising effectiveness of a deep visual SLAM framework: with careful modifications to its training and inference schemes, this system can scale to real-world videos of complex dynamic scenes with unconstrained camera paths, including videos with little camera parallax. Extensive experiments on both synthetic and real videos demonstrate that our system is significantly more accurate and robust at camera pose and depth estimation when compared with prior and concurrent work, with faster or comparable running times.


Interactive examples

Pick a scene below to explore in 3D! Press Space to play/pause, click and drag to change viewpoint.



[Demo requres browser with WebGL2 support.]


Loading...

(Note: scene geometry is downsampled for faster loading. Firefox may not properly render point clouds.)

Explainer video



Acknowledgements

Thanks to Rick Szeliski, Peter Hedman, Andrew Liu, Boyang Deng, and Lucy Chai for helpful proofreading, comments, and discussions.

BibTeX

@inproceedings{li2025megasam,
  title     = {{MegaSaM}: Accurate, Fast and Robust Structure and Motion from Casual Dynamic Videos},
  author    = {Li, Zhengqi and Tucker, Richard and Cole, Forrester and Wang, Qianqian and Jin, Linyi and Ye, Vickie and Kanazawa, Angjoo and Holynski, Aleksander and Snavely, Noah},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {2025}}