To achieve longrange tracking of suspicious targets and improve the accuracy of infraredguidance,a multitap pipeline architecture multitarget tracking mode is proposed.This method through convolution of image preprocessing, image segmentation and object detection algorithms in the FPGA.By increasing the speed of the convolution achieve the realtime processing.Experimental results show that this method compared with other tracking algorithm,can adaptively adjust the window size, change tracking policy and automatic allocation window which improve the tracking of diversity and choice.The method can guide the infrared guidance system for tracking multiple targets simultaneously,Final criterion is given for the high level of threat against targets.It has practical application prospect.