A pruning schema is applied to Multi-Layer Perceptron (MLP) gender classifier.MLP uses eigenvector coefficients of the face space created by Principal Component Analysis (PCA). We show that pruning improves the initial MLP performance by preserving the most effective input while eliminating most of the units and connections. Pruning is also used as tool to monitor which eigenvectors contribute to gender estimation. In addition, by usage of FERET face database, we test the PCA approach on gender estimation task in bigger setting than the previous experiments.