The support vector machine is a classification technique based on the structural risk minimization principle, and it is also a class of regression method with good generalization ability. In this paper, a new idea that each regression problem can be changed into a classification problem is presented. The proposed method has some theoretical foundations. Compared with SVM regression method, the geometric meaning of optimization problem in this paper is very clear and obvious.