Robots.txt 2.0



Publisher Description



Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with

About Robots.txt

Robots.txt is a free trial software published in the Ecommerce list of programs, part of Web Development.

This Ecommerce program is available in English. It was last updated on 19 March, 2024. Robots.txt is compatible with the following operating systems: Windows.

The company that develops Robots.txt is NetPromoter. The latest version released by its developer is 2.0. This version was rated by 6 users of our site and has an average rating of 4.2.

The download we have available for Robots.txt has a file size of 2.10 MB. Just click the green Download button above to start the downloading process. The program is listed on our website since 2004-05-01 and was downloaded 451 times. We have already checked if the download link is safe, however for your own protection we recommend that you scan the downloaded software with your antivirus. Your antivirus may detect the Robots.txt as malware if the download link is broken.

How to install Robots.txt on your Windows device:

  • Click on the Download button on our website. This will start the download from the website of the developer.
  • Once the Robots.txt is downloaded click on it to start the setup process (assuming you are on a desktop computer).
  • When the installation is finished you should be able to see and run the program.



RELATED PROGRAMS
Our Recommendations






BarCode2D-PNG


Click stars to rate this APP!

Users Rating:  
  4.2/5     6
Downloads: 451
Updated At: 2024-03-19
Publisher: NetPromoter
Operating System: Windows
License Type: Free Trial