In this paper, a new method is proposed to detect tampering of intelligent video surveillance and to recognize types of tampering. In order to detect tampering and recognize types of tampering, the method gives every type of tampering a feature of detection such as covered camera, defocused, intensity error, color error, noise of video and so on. At the same time, adaptive threshold is applied to decrease complexity. The experimental results show that the proposed method not only satisfies the demand for real-time of video surveillance system but also has excellent performance of detection and recognition. At last, the accuracy rate is 92.2%.