With the development of human machine interaction (HMI) technology, the handsfree technology becomes more and more prosperous. When confronting a complex control task, it provides a new interactive channel, and enriches the source of interactive signal. In this paper, using the wearable characteristic of Google Glass, a handsfree remote control system for mobile robot is built. This system detects the operator’s head gesture by processing data from accelerometers, geomagnetic sensors and gyroscopes through a complementary filter, designs a controller to parse the operator’s control intention, and sends the intention to the robot through WiFi. Meanwhile, the drift of head gesture reference is eliminated by the high pass filter component of the complementary filter. In order to validate the effectiveness and the reliability of this system, a series of obstacle avoidance experiments are arranged. The experimental results show that the operator can smoothly navigate the robot to complete experimental tasks, successfully frees hand from tasks, and provides a new way of remotely controlling mobile robot. In addition, this hands free control system can benefit those with paralyzed limbs.