00:00What is Unrobot.txt used for and what is it?
00:03Unrobot.txt is simply a small page
00:06that we add to your website's code
00:10right at the very beginning of your website, quite simply
00:14without using too many complex words like FTP, FileZilla, etc.
00:18And that will allow us to tell Google, or at least all the robots
00:22who visit your website
00:23ChatGPT is a robot, etc.
00:26Here are all the global robots that visit your site.
00:29to say you can go here and you cannot go there.
00:34And so, this will allow us to block, for example, pages
00:36that you don't want indexed by Google,
00:39pages that you also want to index,
00:40You authorize the robot to go there, etc.
00:44So, there are always things that we don't want to show on a website.
00:48For example, an admin side, the admin side of a website,
00:51We don't want to show it to Google, so we put it in robots.txt
00:54And we tell Google, you're not going there.
00:56There you go, I hope that's clear.
00:57I'll see you very soon.
00:58THANKS.
Commentaires