Make Robots Txt


Advertisement

Robots.txt Maker  v.4.4

Make Search Engine Friendly Robots.txt Files Fast and Easy! Pattern matching. Visit Time. Request Rate. Crawl delay, Sitemaps, and more. Save to your hard drive for easy reference. Import existing robots. txt file for easy editing and more. Easily noti

Robots-txt-generator

The spiders that visit your site consumes much of your bandwidth? If you want to control the robots or spiders that visit your site, robots-txt generator is the solution. It is very common that the webmaster of each site spends a lot of





Advertisement

RoboGen ROBOTS.TXT Editor  v.1.52

RoboGen is a visual editor for Robot Exclusion Files.

Visual SEO Studio  v.0.8.19.4832

A desktop SEO Audit Software, a Visual approach to make SEO tasks quick and easy. Crawl, Spot on-site issues at a glance, Take page screenshots and see where the fold lays, dominate robots.txt and XML Sitemaps. A comprehensive SEO suite, all Visual!

VIGraph

It draws a diagramms from your txt-data files. It scales your diagramms automatically or manually. Simply make a txt or csv (ASCII) file like that: Dow Johns Date; Open; High; Low; Close 4.14.2005; 10403.71; 10457.06; 10248.23;

Linking The Web

"Linking The Web" is a free utility that regularly monitors all backlinks to your sites. If some of the links don't exist, contain wrong anchor, are covered by a "nofollow" flag or hidden by robots.txt then you will be immediately notified by email. Also

Robot Arena 2  v.1 20

Robot Arena 2 (Design & Destroy) is a game where you create robots. It is a sequel to the original Robot Arena. We make robots and use them to fight with other robots. Multiplayer support will be possible using GameSpy website.

Chilkat Spider ActiveX  v.2.2.9.1

Crawl a website with ActiveX Spidering component. Advanced features include caching, 'avoid' patterns, and robots.txt compliance. Spider ActiveX Component for Crawling the Web: -Cache pages so future crawls can fetch from cache; -Robots.

Mars Escape Game  v.1.0

Mars Escape is a two-player game designed to gather data about human teamwork, social interaction and communication. It is designed to make robots smarter! Each player can take on the role of an astronaut or a robot on Mars.

ASP Search Engine  v.1. 5. 2003

Indexing of the title, description, keywords and full content of all HTML, ASP and TXT documents using a recursive call to all pages in a web site and sub folders excluding those folders listed in the robots.txt file. Simple search of the index for

Free Flip Txt Maker  v.1.0

The flip txt maker can easily convert your txt files to flipbook with page turning effect.

Sitemap Generator Utility  v.1.0.0.1

Sitemap Generator to generate html or txt sitemap. HTML Sitemap can be a valuable page to your website for search engines, vistors, and web masters.

Pages : 1 | 2 | Free
Newest Reviews