Control how crawlers see your site. Set user agents, allow or disallow paths, add sitemaps, then get a ready-to-upload robots.txt file.
