Aiming that highway incidents are apt to cause massive congestion, a video-based rapid detection algorithm for fast feedback event information is proposed. Firstly, the smoothing sequence method is used to get the background, and the background differencing method is utilized to obtain the foreground target. Secondly, using convex hull share on detecting occlusion, the car with the modified Kalman filter feature matching algorithm is tracked. Finally, through detecting the traffic flow speed and flow, the map relationships between speed, flow and the states of traffic flow is built. The fuzzy inference method is used to detect the traffic incident. Experimental results show that the method could obtain accurate prospect information, and it is applicable and high time-efficiency for traffic incident detection on the freeway.