A Flexible Manufacturing System (FMS) is an adaptive and dynamic system that cater to a wide range of different jobs where each involves a set of operations that are required to be done at a predetermined workstation. Therefore this research is regarding the development of a vision system application to monitor and control the operations of a system in order to manage the decision making concerning jobs and work pieces recognition that are to be made during system operation in the real time. The vision system which mainly focus on the shape matching properties consists of two phases, the training phase and the recognition phase. The main focus of this research is on the development of an adaptive training phase of the vision system, which are capable of automatic feature detection and manual feature selection decision. The feature selection decision in the training phase comprises of a selection of training traits that can be included depending on the types of application and the main characteristics that are to be identified during the recognition phase. Another aspect of this research is to extend the flexibility and adaptability of the system to accommodate different types of FMS configurations. The control scheme is able to be incorporated into a wide range of different configurations. This is done by exploiting a simple stand-alone control scheme instead of a centralized control scheme. This system can be applied to the industrial sectors especially for processes and quality controls. The advantages of this system is mainly on its user defined solutions, which the users can decide and manipulate how they want the system to react to the inputs that were predetermined. Besides, it also stresses the eases of use that reduce set-up time during product change or new product introductions. another advantage is the simple Graphical User Interface that lets normal users utilize the system without the help of a skilled user because there will be no complex programming involve.