This study extends the recently proposed Evolving Spiking Neural Network (ESNN) architecture by combining it with an optimization algorithm, namely the Versatile Quantum-inspired Evolutionary Algorithm (vQEA). Following the wrapper approach, the method is used to identify relevant feature subsets and simultaneously evolve an optimal ESNN parameter setting. Applied to carefully designed benchmark data, containing irrelevant and redundant features of varying information quality, the ESNN-based feature selection procedure lead to excellent classification results and an accurate detection of relevant information in the dataset. Redundant and irrelevant features were rejected successively and in the order of the degree of information they contained.