This paper proposes a method of pedestrian detection that takes both motion information and appearance features into account. This could be done by integrating motion information into the segmentation algorithm in the framework, which performs the validation of segmentation on candidate detection windows obtained by the appearance detector. The paper considers that better segmentation results can raise the detection accuracy. Shape features are obtained by integrating color information indirectly into pedestrian detection by using motion information to model foreground/background distribution of moving object. Better detection performance benefits from the complementary advantages between shape features and pedestrian appearance detector. The claim is supported by these experiments based on CAVIAR and the test video with pedestrians.