Basically all search engine spiders function on the same principle – they crawl the Web and index pages, which are stored in a database and later use various algorithms to determine page ranking, relevancy, etc of the collected pages. While the algorithms of calculating ranking and relevancy widely differ among search engines, the way they index sites is more or less uniform and it is very important that you know what spiders are interested in and what they neglect. Generally spider bot can index only text content of webpage. But a webpage may contain lots of images, flash object, videos and content generated by client side scripts (like JavaScript), All these type of content are not indexable by most of search engine bots. This Webpage Spider View Tool simulates a Search Engine by displaying the pure text content of a webpage highlighting keywords.