Modern optical character recognition software relies on human interaction to correct misrecognized charac- ters. Even though the software often reliably identifies low-confidence output, the simple language and vocabu- lary models employed are insufficient to automatically cor- rect mistakes. This paper demonstrates that topic models, which automatically detect and represent an article's se- mantic context, reduces error by 7% over a global word distribution in a simulated OCR correction task. Detecting and leveraging context in this manner is an important step towards improving OCR.