We propose a method for multiple-plane object reconstruction using single-pixel digital holography. Multiple objects are placed at different axial distances from the modulator plane. Instead of using charge-coupled device (CCD) to record, we utilize single-pixel structured detection to first retrieve the holograms and then reconstruct the objects at different axial positions with a digital focusing method. In order to retrieve a high-quality digital hologram, 4-step Fourier spectrum acquisition method is used which can effectively reduce noise in the reconstruction. In addition, since images are commonly sparse in Fourier domain, it is found that only 10% Fourier spectrum coefficients can be used to retrieve high-quality digital holograms. Due to significant advantages of single-pixel imaging, e.g., imaging in conditions of low-light and non-visible wavelength, it is believed that the proposed method can effectively extend the applications of conventional digital holographic technique. Computational results are obtained and presented to demonstrate feasibility and effectiveness of the proposed method.