In order to improve the performance of the image classification, a novel saliency texture feature is proposed. Considering the advantage of the saliency map for representing the texture information, the saliency texture feature is extracted based on the saliency map. This feature is further fused with the HSV color feature, generating a fused image feature which is inputted into the classifier. Results of crossover experiments demonstrate that the fused feature works better than the compared counterpart and has the ability to correctly recognize the image objects. The imageclassification precision rates of the proposed method in SIMPLIcity and Corel5k databases achieved 84.84% and 85.05%, respectively.