In this paper a method is proposed for constructing hierarchical- interpolative fuzzy rule bases in order to model black box systems defined by input-output pairs, i.e. to solve supervised machine learning problems. The resulting hierarchical rule base is the knowledge base, which is constructed by using evolutionary techniques, namely, Genetic and Bacterial Programming Algorithms. Applying hierarchical-interpolative fuzzy rule bases is an advanced way of reducing the complexity of the knowledge base, whereas evolutionary methods ensure a relatively efficient learning process. This is the reason of the investigation of this combination. © 2011 IEEE.