Robots txt sitemap Any website that is interested in getting as many visitors as possible should use both robots.txt and sitemap files. Robots.txt A robots.txt file is…