recommendation: * * *
, Xenu
degree
degree
so it is a small and powerful software.
Xenu after the operation, the error list of all links provide your reference, and create a site map, there is a very useful feature is that Xenu can capture the URL generation XML site map.
three, YAHOO chain detection tool (Yah>
, Shanghai Dragon
recommendation: * * *
Xenu is a simple function, but it is very important to Shanghai dragon spider crawling simulation tools. It is English software. It can simulate the search engines crawl, crawl to every page, and for the record, Xenu after the operation, you can see what is wrong with the link in the results (marked "not found"), and then carefully stationmaster also errors may occur, it is difficult to check the artificial error link to this. The software can be easily found, and some have not included significant links, artificial see page is not easy to notice all, run Xenu again, you will probably see some strange, you don’t want to be included in the URL, and then through the link adjustment or the direct use of robots document to prohibit spider, read more