Camera-based systems are frequently used to track moving objects which are in the field of their view. This paper describes design and development of a camera-based visual system that can constantly track moving object without necessity of calibrating camera in real world coordinates. This reduces the complexity of the system and processing time due to the unnecessary conversions and calibrations. The system consists of a two-motor pan-tilt camera driving mechanism, PCI image acquisition board, and PWM-based DC-motor driver board. It uses image processing techniques to identify and locate the object in 3D scene and motion control algorithms to direct the camera towards the object. Thus the objective of the project is to develop a vision system and control algorithms which can be locked on the moving object within the field of its view. The developed software and related interface hardware monitor and control the motors in such a way that the moving object should always be located right at the center of the camera image plane. The system, in general, simulates 3D motion of the human eye when it always tends to focus on the moving object within the range of its view. It actually imitates the tracking ability of human eye.