Make Robots Txt
The spiders that visit your site consumes much of your bandwidth? If you want to control the robots or spiders that visit your site, robots-txt generator is the solution. It is very common that the webmaster of each site spends a lot of
RoboGen is a visual editor for Robot Exclusion Files.
A desktop SEO Audit Software, a Visual approach to make SEO tasks quick and easy. Crawl, Spot on-site issues at a glance, Take page screenshots and see where the fold lays, dominate robots.txt and XML Sitemaps. A comprehensive SEO suite, all Visual!
It draws a diagramms from your txt-data files. It scales your diagramms automatically or manually. Simply make a txt or csv (ASCII) file like that: Dow Johns Date; Open; High; Low; Close 4.14.2005; 10403.71; 10457.06; 10248.23;
"Linking The Web" is a free utility that regularly monitors all backlinks to your sites. If some of the links don't exist, contain wrong anchor, are covered by a "nofollow" flag or hidden by robots.txt then you will be immediately notified by email. Also
Robot Arena 2 (Design & Destroy) is a game where you create robots. It is a sequel to the original Robot Arena. We make robots and use them to fight with other robots. Multiplayer support will be possible using GameSpy website.
Crawl a website with ActiveX Spidering component. Advanced features include caching, 'avoid' patterns, and robots.txt compliance. Spider ActiveX Component for Crawling the Web: -Cache pages so future crawls can fetch from cache; -Robots.
Mars Escape is a two-player game designed to gather data about human teamwork, social interaction and communication. It is designed to make robots smarter! Each player can take on the role of an astronaut or a robot on Mars.
Indexing of the title, description, keywords and full content of all HTML, ASP and TXT documents using a recursive call to all pages in a web site and sub folders excluding those folders listed in the robots.txt file. Simple search of the index for
The flip txt maker can easily convert your txt files to flipbook with page turning effect.
Sitemap Generator to generate html or txt sitemap. HTML Sitemap can be a valuable page to your website for search engines, vistors, and web masters.