What is this? An XML sitemap is a file containing your website’s URLs(pages) and can be crawl by Google and let it know what pages your site has. Unlike a normal HTML sitemap which could be seen by normal visitors, an XML sitemap is intended to be seen just by Google bots. What can I …
What’s this Locating under your domain root (like our site’s yangli.com.au/robots.txt), it’s a file that is used to control search engine robots how to crawl your site, telling them what pages and files to crawl and what not to crawl. Crawling is a way how Google or any other search engines understand and index your …