A seo spider is a program which browses the World Wide Web in a methodical, automatic manner.

This process is called spidering. Many sites, in particular search engines, use spidering as a means of providing up to date data. The seo spider creates a copy of all visited web pages in a huge database and then searched when a user enters a keyword into a search engine.

A spider will start with a list of URLs to visit, index and as it visits these websites it comes across other links which in time will return to visit those websites as well. This process can sometimes take weeks even months.

 

Spiders like links

This is why it is important to have some incoming links from other websites.

Spiders can follow these links and find your website, it will then index and enter you into their database for future searches at search engines.

Some websites can not be indexed by spiders due to the way they were designed. This is where a seo sitemap has to be used to insure your whole website is indexed.

The spider in most cases will index every incoming link, outgoing link, internal links, web titles, headers, meta tags content and so on.

In the seo keyword section you will learn where to place keywords. This will tell the spiders what your website is about and at the same time attract human visitors.

 

Helping the Seo Spider

You need to make it easy for the spider otherwise it can not do its job.

Using frames to design your website will make it unable to read any content. Using JavaScript will stop it in its path. Using flash in your website is a big no no.

Sitemaps can overcome most of the above problems, but how else can you help the spider do its job.

Imagine that your home page is a giant field to this spider and then it has to leap to your 2nd tier pages and index another load of huge fields and then leaps and hits your 3rd tier page and has to index another huge field. It starts to become tired and decides to go home. If you don’t have links it can not leap and if your website is more than 3 tiers deep it gets to tired.

Ok Ok it’s not a real spider. It will never get tired, but the basics behind it is that the search engines decide that your home page must be important. It is like the cover of a book. The further and deeper you go into a website it deems the web pages to be less important.

Lots on HTML links, content, content, content and a sitemap and you will keep those spiders happy.

 

 

Return from Seo Spider to Seo Introduction