A CSF-Based CNR Approach for Small-Size Image Sequences

For non-rigid structure from motion (NRSFM), the performance of most traditional approaches may decrease significantly when the frame number of the image sequence is relatively small. In this letter, a column space fitting (CSF) based consensus of non-rigid (CNR) reconstruction approach is proposed to deal with the 3D structure estimation problem for small-size image sequences. In the proposed method, a set of trajectory groups are first extracted by utilizing the distance weight of the pairwise points. In order to improve the estimation accuracy, an adaptive rank selection strategy is designed to choose the approximately optimal rank parameter. Corresponding to the trajectory group, the z-coordinates of the observation matrix are estimated by the CSF algorithm due to its good performance. After obtaining the outputs of the CSF-based weak estimators, the final 3D shape is derived by combining the outputs via the alternating directional method of multipliers. Experimental results on several widely used image sequences demonstrate the effectiveness and feasibility of the proposed algorithm.