In this paper, we explore the use of a sparse fuzzy system generation technique in conjunction with simple projection-based fuzzy rule interpolation, to generate sparse fuzzy systems with relatively few rules whilst still achieving reasonable system accuracy. Through setting a parameter value, the user is able to control, to some extent, the number of rules generated by the rule extraction technique. The rule interpolation approach enables the sparse fuzzy system to maintain a reasonable accuracy. The effectiveness of this approach is validated experimentally.