Epipolar Geometry | Uncalibrated Stereo

Epipolar Geometry | Uncalibrated Stereo

🎙 Shree Nayar 👥 96K 📅 April 25, 2021 ⏱ 14 min 👁 119K 📄 tutorial 🧭 2026-08-17
Available in: English (current) Français

Keywords

epipolar geometryessential matrixfundamental matrixstereo calibrationcomputer vision

Summary

This lecture from the ‘First Principles of Computer Vision’ series, presented by Shree Nayar, explains the epipolar geometry of a stereo camera system and how to calibrate an uncalibrated stereo rig. The goal is to determine the relative position and orientation (translation T and rotation R) between two cameras. The lecture introduces key concepts: epipoles (projections of camera centers onto the other image), epipolar planes, and the epipolar constraint. The epipolar constraint is derived using vector and matrix algebra, leading to the definition of the essential matrix E = T×R, which encodes the relative pose. The essential matrix has special properties: T is skew-symmetric and R is orthonormal, allowing decomposition via Singular Value Decomposition (SVD) to recover T and R. However, the essential matrix requires 3D point coordinates, which are unknown. To overcome this, the lecture incorporates image coordinates and known camera intrinsics (K matrices) to derive the fundamental matrix F, which relates corresponding image points. The fundamental matrix can be estimated from image correspondences alone, and then the essential matrix is obtained as E = K_r^T F K_l. Finally, SVD on E yields the desired T and R, calibrating the stereo system.

193 words

Critical Evaluation

Value of the Information & Strength of the Argument

The lecture provides a clear and rigorous derivation of the epipolar constraint and the essential and fundamental matrices. It builds the argument step-by-step, starting from geometric intuition and progressing to algebraic formulations. The value lies in its pedagogical clarity, making complex concepts accessible without oversimplification. The argumentation is solid, with each step logically following from the previous, and the use of matrix algebra is well-motivated. The explanation of why the essential matrix can be decomposed via SVD is particularly insightful, highlighting the underlying linear algebra.

94 words

Title / Content Match

The title accurately reflects the content, which focuses on epipolar geometry and the calibration of uncalibrated stereo systems.

Quality & Reliability

9/10

The lecture is presented by a renowned professor from Columbia University, with clear mathematical derivations and references to established concepts (e.g., essential matrix introduced by Longuet-Higgins). The content is rigorous and well-structured, though it lacks explicit citations to external sources.

Key Moments

Cited Sources

  • Longuet-Higgins (1981) - A computer algorithm for reconstructing a scene from two projections — Mentioned as the origin of the essential matrix.

Concurring Sources

  • Multiple View Geometry in Computer Vision (Hartley & Zisserman) — Standard reference covering epipolar geometry and the essential/fundamental matrices.

Contribution & Novelties

This lecture provides a clear and systematic derivation of the epipolar geometry and the essential/fundamental matrices, making it an excellent educational resource. It emphasizes the mathematical foundations and the practical steps for calibrating an uncalibrated stereo system. The lecture stands out for its pedagogical approach, breaking down complex concepts into understandable steps.

Pour aller plus loin :

110 words

Radar Profile

The radar profile shows high scores across all dimensions, indicating a well-balanced and reliable educational content. The lecture excels in information quantity and quality, with a strong technical level and high reliability.

Reliability 9/10