Journal of Intelligent Computing Ibari Benaoumeur 1 , Bouzgou Kamel1, Ahmed-foitih Zoubir 1, Benchikh Laredj 2 6 3 2015 http://www.dline.info/jic/fulltext/v6n3/v6n3_2.pdf In this paper, an AR (Augmented reality) system based on a multimodal user interface is proposed and its core techniques are described. The objective of this work is to realize certain task that operators can use the virtual robot to ameliorate the interaction with the real world using AR environment. VC++ and OpenGL are used to create this application. AR applications (ARToolKit) is used to detect the real-time position and orientation of camera and to facilite the operator’s observation and operation. Experiments prove that the system is reliable and efficient. Simulation result is obtained and it is very useful for designers to ameliorate the interaction with the real world.