So, guys, in this video, we are going to talk about these robots.
So these are text file.
And now I will show you one example.
That is let's say this is Goulder.
Yes, this will come.
Now, let us assume that I am the owner of this Google dot com.
OK, I know I am not, but let's assume that I'm the owner of guru.com.
Suppose I want to I'm going to create another small application and I want to test that application
so that application.
But this water comes fresh.
So my app.
So it's just for an hour for error.
So OK.
My app and I get some actual data because I'm developing my app and I want to put that in my app for
that.
So since we do not have my application, it gave me an hour for.
So let's assume that I have some this this is my job.
So if there are some errors or any bugs in this webpage, it can lead to some exploitation.
So.
I want to take this one step further.
I don't want any Google search search engines like Google, Yahoo, Bing, not to display my dishearteningly.
So you can just Google.
You can just Google about this map and that Google's browser will not display this map, but so because
I put this map in robots.
So whatever the content in the robots, the text file, the Web browsers so courageously Google, uh,
like search engines, like Google, Yahoo, Bing, any other search engine will not display that in
the results.
So if I put my up in my, uh, robot strategy file of my, uh, this guru.com main domain, then search
engines will not find that, uh, this directory and will not display any content from this.
You need to manually find out because you need to guess that the reason my father is from Google or
any other Certina you cannot find this year, because my app has been like, uh, hidden from, uh,
search engines.
So I will show you that one.
So this is not a street lamp or the work.
This is for Web practice.
And finally, it is there is nothing on this page.
OK, now let's continue to view the circle and you can see there is no more information leaks.
Not even Google will find this time.
So because, uh, Google is and will not find the item that is in reverse.
So let me see.
Your robot got people and you can see here there is a syntax and user agent is equal to.
So here is a deserve, uh, search engines.
A star means are searching.
And so when all the search engines is going to crawl this domain, then it will see the robots.
And since it was originally started, it applies to the Arcaro.
So that search will not allow this part to be displayed in that resource.
So if I take this one.
So.
So I have mentioned here this yellow and then this territory, that means from the root, so whenever
the such unions see this, it will not display under those.
So you cannot find or any hagiographies until they find this robot.
So here the this not us guys have been, uh, put this secret for the, uh, disappear from me or hide
it from me.
So let me enter and you can see in the case of the secret and you can see that the password for the
next level, that is not allowed for any to this one.
So the main important is not the power, but the robot, right?
So as you can see here, there will be a user that is going to Google are being or any other star in
the sense of research and development.
You should not call this one and you should not display that in the results.
So that's all that's all about this robot strategy.
So one thing you can check in the testing is to continue to watch what, if any, sense to that are
out there in these parts.
You can just right there, right.
So that's what the robots are texting.
I hope you have understood.