Abstract: A tracking mode is presented which reflects regional pixel spatial relationship combining with the core of the original algorithm based on the analysis of the principle of algorithm. Meanwhile the adaptability and the similarity measurement formula with two level decision strategy are adopted，and it extracted region characteristic to normalize values by the different right. If it does not meet the characteristics of observed value condition, the coarse-fine search to update the target model should be adopted. Experimental results show that the fluctuations characteristic observations meet the actual situation of the target area in the target tracking process, and the target in the case of abnormal fluctuations can be repositioned, thereby the tracking stability can be improved.