Robots META Tag
****************
The content="robots-terms" is a comma separated list used in the Robots META Tag that may contain one or more of the following keywords without regard to case: noindex, nofollow, all, index and follow.
noindex
name="robots" content="noind
Admin Note: The robots directives of index, follow or all are not required as it is the default behavior of indexing spiders.
index
Robots are welcome to include this page in search services.
follow
Robots are welcome to follow links from this page to find other pages.
If this meta tag is missing, or if there is no content, or the robot terms are not specified, then the robot terms will be assumed to be "index, follow" (e.g. "all"). If the keyword all is found in the robots terms list it overrides all other values. That is, a robots terms that is "nofollow, all, noindex, nofollow", would effectively be "all".
If the robots terms contains contradictory information (e.g. "follow, nofollow, follow") then the robot is free to do whatever it wishes with regard to the behavior being addressed (in this case the follow behavior).
Back to Previous
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment