DOI number:10.1016/j.isprsjprs.2022.05.010

Journal:ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING

Key Words:Errors,Open source software,Open systems,Pinhole cameras,Pipelines,Pixels,Satellite imagery,Digital surface models,Epipolar,Epipolar resampling,Linear pushbroom sensor satellite,Model generation,Ortho-rectification,Pushbroom sensors,Rational function model,Resampling,Sensor satellites,data set,precision,remote sensing,satellite imagery,stereo image,Stereo image processing,Digital Surface Model,Epipolar Resampling,Linear Pushbroom Sensor Satellite,Ortho Rectification,Rational Function Model

Abstract:Epipolar resampling, also known as stereo rectification, is a prerequisite for optical satellite image stereo matching in digital surface model (DSM) generation. In epipolar resampling, image pairs are warped and thus can be matched pixel-to-pixel along the epipolar line. Different from the pinhole imaging model of frame cameras, the multi-center projection model of linear pushbroom sensors does not obey the epipolar geometric constraint, making it impossible to conjugate epipolar lines from stereo images. The epipolar resampling methods can resolve some of the inherent epipolar error, but not completely. The topographic relief brings high disparity values between epipolar image pairs, posing a challenge to the subsequent stereo matching to recover disparity map. In this paper, we introduce a novel epipolar resampling method for satellite imagery based on ortho rectification. This method takes full advantage of a rational function model to establish a connection between image space and object space coordinates, and thereby transform the two-dimensional disparity in ortho rectification products into one dimension. We propose a coarse-to-fine DSM generation pipeline to overcome the high-disparity-problem without additional time costs or precision decrement. We conducted experiments on various satellite stereo images, and validated both the extreme suppression on epipolar error as well as the feasibility of the proposed coarse-to-fine DSM generation pipeline. The experimental results show that the generated epipolar image pairs from our proposed method effectively solved the high disparity problem. Furthermore, the novel DSM generation method obtained an internal error below one pixel for a rectified stereo image pair in mountain area, and the lowest vertical error in the IARPA MVS dataset when compared with the common open-source programs and commercial software.

Co-author:Kun Zhu,Yuanfu Gong,Tong Wang,Xianwei Li,Haobo Yang

Indexed by:Journal paper

Correspondence Author:Guanzhou Chen,Xiaodong Zhang

Document Type:J

Volume:190

Page Number:56-68

ISSN No.:0924-2716

Translation or Not:no

Date of Publication:2022-07-07

Included Journals:SCI