URL value is a database driven website generated, with a question mark, sign and parameters. General dynamic URL is not conducive to the search engine spiders crawling, should try to avoid. Although love in Shanghai can now identify dynamic URL, but can not guarantee 100 percent recognition.
fifth, the requirement to some sites require users to log in to see the contents of the page, this part of the search engine is to see. This should pay attention to determine whether it is need to log on to see.
First, a dynamic URL The
many webmaster said, not good to do business website, it is because a lot of corporate website will be in the design of the search engine is not friendly, is not conducive to the spider crawling and crawling, the technique is called the spider trap. Remind the enterprise website must avoid spider trap.
third, FLASH website the entire home is a big flash, which constitutes a spider trap. The search engine residential HTML code is only one link to the flash file, there is no other text.
websites in order to achieve a certain function, force the use of cook>
and the site using a flash on the front page of the banner, and add the active link, although the user can see the visual content, but for spiders, it does not recognize, but not grab flash chain to address.
fourth, Session ID (session ID) tracking some web user access, each user access will generate a unique sessio ID, and in URL. The search engine spiders each visit will also be treated as a new user, URL will add a different session ID, with a page that the search engines get access to each of the URL will not be the same, back with a different session ID. One of the most common spider trap.