In this paper, a plane-based backward warping algorithm is proposed to generate novel views from multiple reference images. First the depth information is employed to reconstruct space planes from individual reference images and the potential occluding relationship between these planes is calculated. Then the planes that represent an identical space plane from different reference images are compared with each other to decide one with best sample rate preserved and used in the later warping period while the other samples are abandoned.While the image of a novel view is priduced,the planes thar pass the visibility test are projected onte the desired image form which people can get knowledge on the plane that the desired image pixels are warped from.Finally,pixels'depth of the desired image is calculated and then abackward warping is performed from these pixels to the reference images to obtain their colors.It is shown that the storage requirement and executing time of the proposed algorithm increases slowly with the number of reference images.