An improved compression tracking (ICT) algorithm is proposed based on the characteristics of aerial video. After study on classic compression tracking(CT) algorithm, some shortcomings in sample collection and classification of the sampling processing are found and improved. Kalman filter is used to predict the target movement path and the prediction results are applied to sample collection for adaptive research. The sampling and feedback of the classifier are updated by using the classification results after determined. Values lower than a certain threshold are not transfered to the classifier for classification, which ensures the correctness and the accuracy of the feedback of the classifier. Based on the proposed algorithm, a target tracking system is implemented for aerial video. Compared with the classic compression tracking algorithm in real aerial video, the effectiveness and real-time performance are tested and verified.