In this paper various restrictions are proposed in the construction of hierarchical fuzzy rule bases by using Genetic and Bacterial Programming algorithms in order to model black box systems defined by input-output pairs, i.e. to solve supervised machine learning problems. The properties (learning speed, accuracy) of the established systems are observed based on simulation results and they are compared to each other. © 2010 TSI Press.