Search engine that uses a server-based agent to seek all URLs on a site, including dynamic pages from databases. Includes a function to keep searches current.