Robots.txt Generator

Generate a valid robots.txt file to control search engine crawlers. Allow or block specific bots and paths, then download the file.