Usually tracking objects by means of a moving camera means solving the problem of segmenting its motion from the background and maintain the gaze on it. Usually key points, i.e. features like corners, are matched throughout consecutive frame to register frames and detecting objects or to compute a fixation point on the object of interest. None of the methods proposed so far investigates how, more then just matching features between frames, the tuning of their quality would increase the robustness of the methods. Hence, the novelty proposed in this paper concerns the automatic tuning of the focus parameter to increase the tracking capabilities and strength the robustness of the entire system.