Evaluation of object detection systems requires a set of test images with objects in heterogeneous scenes. Unfortunately, existing publicly available object databases provide few, if any, test images suitable for evaluating object detection systems. Here we present the McGill Object Detection Suite (MODS), a software package for creating test sets suitable for evaluating object detection systems. These test sets are created by superimposing objects from existing publicly available object databases onto heterogeneous backgrounds. The MODS is capable of creating test sets focusing on pose, scale, illumination, occlusion, or noise. This software package is being made publicly available to aid the computer vision community by providing standard test sets which will allow object detection systems to be systematically compared and characterized.