Channel phase inconsistency is one of the important factors affecting the direction-finding accuracy, rectify zero-phase can improve the direction-finding accuracy. In this paper, an outlier recognition method based on zero-phase difference fitting model is proposed, by deducing the linear fitting model of zero-phase, the fitting phase error is established, and the fitting phase error follows normal distribution, so that the outlier recognition of zero-phase is converted into the gross error recognition of fitting phase error, Finally, the gross error is discriminated and eliminated by 3σ criterion and Grubbs criterion. This method can effectively identify and eliminate the outlier recognition of zero-phase. The experimental calculation shows that outlier recognition and elimination method base on zero-phase difference can effectively improve the direction-finding accuracy, and has been applied in engineering.