Site maps are XML documents that sites may have to let Google and other search engines know about all the pages of a site, so the sites can be fully indexed and all their pages appear feature in search results.
Listing all the pages of a site to build a site map may require a lot of time and manual effort.
This class provides an automated solution to building site maps that may require much less effort. It can crawl a site and find all its pages by following the links that are found in each page.