The robots.txt file doesn't allow a crawler to either crawl or index a web page.
rel=nofollow attribute of the anchor tag doesn't allow a crawler to either crawl or index a web page from the page where this tag is placed. However a crawler can still crawl and index the web page through some other page which is linked to that web page and which doesn't use the rel=nofollow.
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment