Site Robots- Purpose?

[solomonar]

In the section "on line" there is some hundred robots.

I wonder whether those robots do belong to the web-page management. are external accepted or penetrating security walls.

If legitimate, what are their purpose please?

And a technical question: how the robots are built?

Thank you!

 

[AbbysMom]

Anne can answer this much better than I can, but I'll give it a try.

The bots are not a physical thing, rather a software application. Search engines and similar sites will go through online sites to read the information. This may explain a bit how google does it -

Googlebot - Search Console Help

 

[Anne]

You explained them well AbbysMom . These robots are simply Google's agents reading through the pages here and indexing them. They need to read them so they can later bring them up as search results when someone Googles a cat related question.
Each "bot" in the count indicates a page that's currently being indexed by Google. Nothing more. It's basically an indication for site owners that Google is reading the site yet at the same time doesn't overwhelm it with too many requests for pages from our server.

 

[mightyboosh]

solomonar They're both wrong. This is the truth of it.

 

[solomonar]

mightyboosh
LOL! That is not a good pose for the spine. :-)


AbbysMom
Thanks!
Interesting explanations.

---

OK - Google's bots.

But all of them are Google's bots?

 

[Anne]

Some may be from other search engines or companies that are indexing the internet for their needs. They can't do anything here other than read the pages just like a non-registered human visitor would. They have zero access beyond that.