Abstract: The correction method of three-channel polarization imaging system based on calibration is very complex in the process of calibrating non-uniformity of channels responsiveness, and this method cannot correct the non-uniformity when the physical environment changes. It affects the practicality of the polarization of the three-channel imaging system. To solve this problem, a scene-based correction method of the three-channel imaging system is proposed. The method is based on the statistics of polarization information in the scene. It separates non-polarized scenes from complex scenes, and fixes the differences of gray response among the three channels simply and quickly. As is shown in the experimental results, this method overcomes the impact of non-uniformity of channels responsiveness, gives prominence to the differences between the polarization of the different materials, makes the imaging effect of the three-channel polarization imaging system close to that of a single-channel polarization imaging system, and improves the practicality of the system perfectly.