In the film, television and many other videos, exciting video sections are usually reflected by their frequent shot changes, and such sections are the most frequently objects in retrieval of this kind of video. In this paper, a method on retrieving videos according to their shot change frequencies is presented. Scene transition analysis has done on real videos, and video segmentation algorithm for both cut and dissolve are developed. To lessen the influence of error and missing shot segmentations, a robust calculation method of shot frequency on shot sequence acquired is proposed. Basic ideas and algorithm modules are given in detail, also with the experimental results on film video and analysis.