1
00:00:00,060 --> 00:00:02,990
So, guys, in this video, we are going to talk about these robots.

2
00:00:04,350 --> 00:00:05,720
So these are text file.

3
00:00:06,090 --> 00:00:08,610
And now I will show you one example.

4
00:00:09,210 --> 00:00:11,080
That is let's say this is Goulder.

5
00:00:11,370 --> 00:00:12,570
Yes, this will come.

6
00:00:12,750 --> 00:00:16,600
Now, let us assume that I am the owner of this Google dot com.

7
00:00:16,800 --> 00:00:21,220
OK, I know I am not, but let's assume that I'm the owner of guru.com.

8
00:00:21,240 --> 00:00:28,280
Suppose I want to I'm going to create another small application and I want to test that application

9
00:00:29,550 --> 00:00:30,660
so that application.

10
00:00:30,660 --> 00:00:32,600
But this water comes fresh.

11
00:00:33,330 --> 00:00:34,530
So my app.

12
00:00:36,090 --> 00:00:37,780
So it's just for an hour for error.

13
00:00:39,240 --> 00:00:40,290
So OK.

14
00:00:40,500 --> 00:00:47,970
My app and I get some actual data because I'm developing my app and I want to put that in my app for

15
00:00:47,970 --> 00:00:48,210
that.

16
00:00:48,240 --> 00:00:53,190
So since we do not have my application, it gave me an hour for.

17
00:00:53,250 --> 00:00:57,610
So let's assume that I have some this this is my job.

18
00:00:58,170 --> 00:01:06,590
So if there are some errors or any bugs in this webpage, it can lead to some exploitation.

19
00:01:06,900 --> 00:01:07,350
So.

20
00:01:08,270 --> 00:01:10,520
I want to take this one step further.

21
00:01:10,670 --> 00:01:20,300
I don't want any Google search search engines like Google, Yahoo, Bing, not to display my dishearteningly.

22
00:01:21,820 --> 00:01:23,930
So you can just Google.

23
00:01:24,010 --> 00:01:34,270
You can just Google about this map and that Google's browser will not display this map, but so because

24
00:01:34,630 --> 00:01:36,520
I put this map in robots.

25
00:01:37,960 --> 00:01:46,270
So whatever the content in the robots, the text file, the Web browsers so courageously Google, uh,

26
00:01:46,270 --> 00:01:53,080
like search engines, like Google, Yahoo, Bing, any other search engine will not display that in

27
00:01:53,080 --> 00:01:53,610
the results.

28
00:01:53,800 --> 00:02:04,000
So if I put my up in my, uh, robot strategy file of my, uh, this guru.com main domain, then search

29
00:02:04,000 --> 00:02:11,890
engines will not find that, uh, this directory and will not display any content from this.

30
00:02:12,160 --> 00:02:17,830
You need to manually find out because you need to guess that the reason my father is from Google or

31
00:02:17,830 --> 00:02:26,150
any other Certina you cannot find this year, because my app has been like, uh, hidden from, uh,

32
00:02:26,200 --> 00:02:26,950
search engines.

33
00:02:27,970 --> 00:02:29,380
So I will show you that one.

34
00:02:29,410 --> 00:02:32,960
So this is not a street lamp or the work.

35
00:02:32,980 --> 00:02:35,230
This is for Web practice.

36
00:02:35,380 --> 00:02:38,590
And finally, it is there is nothing on this page.

37
00:02:39,020 --> 00:02:46,990
OK, now let's continue to view the circle and you can see there is no more information leaks.

38
00:02:47,380 --> 00:02:49,480
Not even Google will find this time.

39
00:02:50,920 --> 00:02:56,620
So because, uh, Google is and will not find the item that is in reverse.

40
00:02:57,970 --> 00:02:59,200
So let me see.

41
00:02:59,210 --> 00:03:08,890
Your robot got people and you can see here there is a syntax and user agent is equal to.

42
00:03:09,310 --> 00:03:12,730
So here is a deserve, uh, search engines.

43
00:03:13,180 --> 00:03:14,760
A star means are searching.

44
00:03:14,770 --> 00:03:20,860
And so when all the search engines is going to crawl this domain, then it will see the robots.

45
00:03:22,000 --> 00:03:27,820
And since it was originally started, it applies to the Arcaro.

46
00:03:28,390 --> 00:03:34,820
So that search will not allow this part to be displayed in that resource.

47
00:03:35,230 --> 00:03:36,550
So if I take this one.

48
00:03:38,180 --> 00:03:38,750
So.

49
00:03:40,780 --> 00:03:48,070
So I have mentioned here this yellow and then this territory, that means from the root, so whenever

50
00:03:48,070 --> 00:03:51,320
the such unions see this, it will not display under those.

51
00:03:51,340 --> 00:03:56,280
So you cannot find or any hagiographies until they find this robot.

52
00:03:57,460 --> 00:04:05,680
So here the this not us guys have been, uh, put this secret for the, uh, disappear from me or hide

53
00:04:05,980 --> 00:04:06,690
it from me.

54
00:04:07,000 --> 00:04:15,130
So let me enter and you can see in the case of the secret and you can see that the password for the

55
00:04:15,130 --> 00:04:17,590
next level, that is not allowed for any to this one.

56
00:04:18,970 --> 00:04:22,830
So the main important is not the power, but the robot, right?

57
00:04:24,280 --> 00:04:31,030
So as you can see here, there will be a user that is going to Google are being or any other star in

58
00:04:31,030 --> 00:04:33,730
the sense of research and development.

59
00:04:34,420 --> 00:04:38,950
You should not call this one and you should not display that in the results.

60
00:04:39,760 --> 00:04:42,560
So that's all that's all about this robot strategy.

61
00:04:43,420 --> 00:04:51,100
So one thing you can check in the testing is to continue to watch what, if any, sense to that are

62
00:04:51,490 --> 00:04:53,580
out there in these parts.

63
00:04:53,590 --> 00:04:55,540
You can just right there, right.

64
00:04:56,740 --> 00:04:58,440
So that's what the robots are texting.

65
00:04:58,780 --> 00:04:59,950
I hope you have understood.

