A binary hierarchical classifier is proposed to solve the multi-class classification problem. We also require rejection of non-target inputs, which thus producing a very difficult problem. The SVRDM (support vector representation and discrimination machine) classifier is considered at each node in the hierarchy, since it offers good generalization and rejection ability. Using this hierarchical SVRDM classifier with magnitude Fourier transform features, initial recognition and rejection test results on simulated infra-red data are excellent.