Implementation of a three-dimensional video tracking algorithm using CCD's is presented. The algorithm does not require conventional pattern recognition or continuous segmentation updating. The only requirements, for the class of targets presented, are that the sampling lattice contain only points inside the target and that the background vary slowly. Several well-known segmentation techniques are available for initial segmentation and determination of target points. The use of CCD devices simplifies the architecture of the processor and permits real time processing at a high sampling rate. Some of the vector and matrix operations require either the use of continuously variable tapweight transversal filters or analog multipliers. The use of analog multipliers, which can be on-chip, reduces the number of components and offers higher accuracy than presently available variable tap weight transversal filters.