Since the existing color constancy algorithms do not perform well for color cast removal in the case of non-uniform illumination and complex scenes, this paper proposes a deep learning algorithm that comprehensively uses the skin color model and perceptual loss to remove color casts. The algorithm integrates the skin color model and perceptual loss, so that can recognize and focus on skin color information in the calculation process, and pay more attention to the understanding of image semantics, rather than simple calculation between pixels. At the same time, the skin color model is combined with the attention mechanism, which highlights the role of the skin color area. The experimental results show that the color constancy calculation method proposed in this paper can accurately eliminate the color cast of images in single-illumination and multi-illumination scenes at the semantic level. Compared with other algorithms, this algorithm can achieve better results.