Meta-heuristic algorithms are well researched and widely used in optimization problems. There are several meta-heuristic optimization algorithms with various concepts and each has its own advantages and disadvantages. Still it is difficult to decide which method would fit the best to a given problem. In this study the optimization of a fuzzy rule-base from a classifier, more specifically fuzzy character recognizer is used as the reference problem and the aim of the research was to investigate the behavior of selected meta-heuristic optimization techniques in order to develop a multi meta-heuristic algorithm.