RoboGen Standard Edition Creates and manages Robot Exclusion files, ROBOTS.TXT for your website
Download

RoboGen Standard Edition Ranking & Summary

RoboGen Standard Edition Tags

generator MetaTag Robots txt exclusion File exclusion robots.txt generator robots.txt editor robots.txt manager edit robots.txt create robots.txt

RoboGen Standard Edition Description

RoboGen is a program, for Windows 2000, XP, and Vista, to help you more easily manage the robots.txt files for your websites. Instead of the time consuming manual management process, described in the tutorial, you can either edit your robot exclusion files on your local computer or on a remote FTP site. RoboGen is a visual editor for Robot Exclusion Files. The user is allowed to quickly and easily create the ROBOTS.TXT files that are required to instruct web search engines which parts of a your web site are not to be indexed or made searchable by the public browsing the web. RoboGen does this by providing the user a way to log onto his FTP server and then select the documents and directories which are not to be made searchable. RoboGen maintains a database of over 180 search engine user-agents, which are selectable from a drop down menu.

RoboGen Standard Edition Related Software