Our goal is to provide a one-button interface called Video Bookmarking Search, which efficiently retrieves information desired by a user with a simple user interface and an intelligent background process without distracting the user?s attention from watching TV. We propose a method that infers keywords a user wants to search when watching TV by the Named Entity Recognition and the Semantic Role Analysis techniques for closed captions of Japanese TV shows on city life, travel, or cuisine to perform keyword selection for appropriate keyword-based Web search. According to experiments using actual TV shows with over 200 bookmarks, our method achieved 74.6% recall in the 10 retrieved results of searchable keywords that users want to search.