The real-time tracking of badminton in 3d space is realized by using binocular vision system in this paper. This paper mainly studies binocular images acquisition, binocular calibration, image correction, stereo matching and so on, to identify the badminton in sport as the target direction and realize the real-time tracking and positioning of the badminton in sport. In order to increase the stability of the system, the background subtraction algorithm and Camshift algorithm are combined to achieve the tracking and monitoring of badminton in a relatively complex background, the position information of the target badminton is obtained through binocular, and the position of badminton is fed back to the robot motion control system in real time. Through the constant testing, the tracking detection and the calculation of three-dimensional information of the flight path of badminton are realized, and the positioning error is within the range of ±10 mm, and the real-time tracking and positioning of badminton is successfully realized.