1
00:00:00,330 --> 00:00:01,890
‫So let's practice replication

2
00:00:01,890 --> 00:00:03,420
‫on Amazon S3.

3
00:00:03,420 --> 00:00:05,730
‫For this, we're going to create a new bucket.

4
00:00:05,730 --> 00:00:10,730
‫I'll call it s3-stephane-bucket-origin-v2.

5
00:00:11,790 --> 00:00:13,890
‫And I will set it in one region that I want,

6
00:00:13,890 --> 00:00:15,720
‫for example, eu-west-1.

7
00:00:15,720 --> 00:00:17,040
‫This will be my origin bucket

8
00:00:17,040 --> 00:00:18,390
‫and then data will be replicated

9
00:00:18,390 --> 00:00:20,880
‫from this bucket to another bucket.

10
00:00:20,880 --> 00:00:22,770
‫So the thing I need to do, of course,

11
00:00:22,770 --> 00:00:24,150
‫is to enable versioning

12
00:00:24,150 --> 00:00:25,920
‫because replication only works

13
00:00:25,920 --> 00:00:27,693
‫if versioning is enabled.

14
00:00:27,693 --> 00:00:29,463
‫So I will create this bucket.

15
00:00:31,740 --> 00:00:34,264
‫And then open this bucket in a new tab.

16
00:00:34,264 --> 00:00:36,330
‫And I will create a second bucket

17
00:00:36,330 --> 00:00:38,580
‫and this will be my target bucket.

18
00:00:38,580 --> 00:00:43,453
‫So I will do s3-stephane-bucket-replica-v2.

19
00:00:46,500 --> 00:00:48,720
‫And this time, the region can be either the same,

20
00:00:48,720 --> 00:00:51,870
‫for example, if you wanted to do same region replication

21
00:00:51,870 --> 00:00:53,190
‫or something completely different,

22
00:00:53,190 --> 00:00:54,870
‫for example, if you wanted the US,

23
00:00:54,870 --> 00:00:57,750
‫you could do us-east-1

24
00:00:57,750 --> 00:01:00,990
‫to replicate from Europe to the US.

25
00:01:00,990 --> 00:01:02,190
‫Okay, so let's scroll down

26
00:01:02,190 --> 00:01:03,930
‫and let's again enable bucket versioning

27
00:01:03,930 --> 00:01:05,163
‫on the target bucket.

28
00:01:08,370 --> 00:01:09,390
‫And we're good to go.

29
00:01:09,390 --> 00:01:11,280
‫So now we have our primary bucket

30
00:01:11,280 --> 00:01:13,140
‫and our secondary bucket.

31
00:01:13,140 --> 00:01:15,030
‫What I'm going to do is that in the origin bucket,

32
00:01:15,030 --> 00:01:16,380
‫I'm going to upload a file,

33
00:01:16,380 --> 00:01:19,860
‫so I will add a file of my beach, for example.

34
00:01:19,860 --> 00:01:21,063
‫Beach.jpg.

35
00:01:22,710 --> 00:01:24,900
‫Okay, this is done and we can close this.

36
00:01:24,900 --> 00:01:25,950
‫So now this has one file

37
00:01:25,950 --> 00:01:28,230
‫but, of course, this does not get replicated yet

38
00:01:28,230 --> 00:01:30,210
‫because we haven't set up replication yet.

39
00:01:30,210 --> 00:01:32,010
‫So let's go ahead and do this.

40
00:01:32,010 --> 00:01:33,960
‫So on the origin bucket,

41
00:01:33,960 --> 00:01:37,350
‫what I need to do is to go under Management,

42
00:01:37,350 --> 00:01:39,660
‫scroll down and there are replication rules.

43
00:01:39,660 --> 00:01:40,800
‫Currently zero.

44
00:01:40,800 --> 00:01:44,760
‫So let's go ahead and create our first replication rule.

45
00:01:44,760 --> 00:01:47,300
‫So I'll call this one DemoReplicationRule.

46
00:01:48,480 --> 00:01:49,680
‫Okay, perfect.

47
00:01:49,680 --> 00:01:51,420
‫We'll set it as enabled.

48
00:01:51,420 --> 00:01:53,730
‫For the source bucket, we'll leave it as is

49
00:01:53,730 --> 00:01:55,500
‫and in terms of rule scope,

50
00:01:55,500 --> 00:01:58,830
‫we'll apply it to all objects in the bucket.

51
00:01:58,830 --> 00:02:00,240
‫Now, for the destination,

52
00:02:00,240 --> 00:02:02,820
‫we can specify a bucket in this account

53
00:02:02,820 --> 00:02:04,350
‫or another account.

54
00:02:04,350 --> 00:02:06,005
‫And we'll choose one in this account.

55
00:02:06,005 --> 00:02:10,860
‫And the bucket name is my target bucket.

56
00:02:10,860 --> 00:02:12,540
‫So I need to actually enter the name.

57
00:02:12,540 --> 00:02:15,000
‫So we'll take this bucket right here,

58
00:02:15,000 --> 00:02:16,860
‫copy and paste it.

59
00:02:16,860 --> 00:02:18,180
‫Okay, and as you can see,

60
00:02:18,180 --> 00:02:20,040
‫the destination region was identified

61
00:02:20,040 --> 00:02:22,470
‫as being us-east-1.

62
00:02:22,470 --> 00:02:26,040
‫So therefore, this is a Cross-Region Replication.

63
00:02:26,040 --> 00:02:27,090
‫Okay.

64
00:02:27,090 --> 00:02:28,080
‫Now for IAM role,

65
00:02:28,080 --> 00:02:31,830
‫we need to actually go and create a new role for this.

66
00:02:31,830 --> 00:02:32,913
‫So here's the option.

67
00:02:33,840 --> 00:02:36,300
‫And then we can have a look at some settings

68
00:02:36,300 --> 00:02:38,700
‫but for now it doesn't really matter for us.

69
00:02:38,700 --> 00:02:39,843
‫Let's just save this.

70
00:02:41,790 --> 00:02:43,890
‫So we get a prompt right here,

71
00:02:43,890 --> 00:02:46,980
‫which says do you want to replicate existing objects?

72
00:02:46,980 --> 00:02:49,860
‫So it turns out that when you do enable replication,

73
00:02:49,860 --> 00:02:51,510
‫it will only replicate objects

74
00:02:51,510 --> 00:02:52,860
‫from the moment you set it.

75
00:02:52,860 --> 00:02:54,570
‫So for newer uploads.

76
00:02:54,570 --> 00:02:58,800
‫So if you wanted to replicate the previous objects

77
00:02:58,800 --> 00:03:00,810
‫from the source to the destination bucket,

78
00:03:00,810 --> 00:03:03,720
‫you could use something called a Batch Operation,

79
00:03:03,720 --> 00:03:06,365
‫an S3 Batch Operation to do so

80
00:03:06,365 --> 00:03:09,690
‫and you would need to say yes, replicate existing objects.

81
00:03:09,690 --> 00:03:10,890
‫But this is separate

82
00:03:10,890 --> 00:03:13,500
‫from the replication feature itself.

83
00:03:13,500 --> 00:03:15,420
‫Therefore, I'm going to say no,

84
00:03:15,420 --> 00:03:17,910
‫do not replicate existing objects.

85
00:03:17,910 --> 00:03:19,470
‫And we're good to go.

86
00:03:19,470 --> 00:03:20,820
‫So now let's have a look.

87
00:03:20,820 --> 00:03:23,670
‫So we have this Management

88
00:03:23,670 --> 00:03:26,850
‫with a replication rule that is ready.

89
00:03:26,850 --> 00:03:28,230
‫And now what I'm going to do

90
00:03:28,230 --> 00:03:30,600
‫is check in my replica bucket.

91
00:03:30,600 --> 00:03:32,640
‫Of course, if I refresh now,

92
00:03:32,640 --> 00:03:35,193
‫we see that the objects haven't been replicated.

93
00:03:36,090 --> 00:03:38,250
‫So I'm going to do is now upload a new file,

94
00:03:38,250 --> 00:03:41,850
‫for example, upload the coffee.jpg file.

95
00:03:41,850 --> 00:03:42,723
‫Upload it.

96
00:03:43,860 --> 00:03:44,850
‫We're done.

97
00:03:44,850 --> 00:03:47,040
‫So here is the coffee.jpg file.

98
00:03:47,040 --> 00:03:48,210
‫Let's show the versions.

99
00:03:48,210 --> 00:03:51,483
‫So this is coffee.jpg and the version is GBk.

100
00:03:52,905 --> 00:03:53,970
‫Okay, perfect.

101
00:03:53,970 --> 00:03:58,020
‫Now if we go in my target bucket, and refresh this,

102
00:03:58,020 --> 00:04:00,600
‫it's gonna take maybe five seconds.

103
00:04:00,600 --> 00:04:02,730
‫And this took about 10 seconds on the first replication

104
00:04:02,730 --> 00:04:04,890
‫but we can see that my coffee.jpg

105
00:04:04,890 --> 00:04:07,830
‫has been added into my replica bucket.

106
00:04:07,830 --> 00:04:09,390
‫And if I show the versions,

107
00:04:09,390 --> 00:04:12,300
‫we can see that the version ID of my coffee.jpg

108
00:04:12,300 --> 00:04:15,270
‫is the exact same of the origin bucket.

109
00:04:15,270 --> 00:04:17,790
‫So the version's IDs are replicated,

110
00:04:17,790 --> 00:04:18,870
‫which is great.

111
00:04:18,870 --> 00:04:20,970
‫And if I wanted to import the beach.jpg,

112
00:04:20,970 --> 00:04:23,700
‫I would need to upload a new version of that file.

113
00:04:23,700 --> 00:04:26,403
‫So let's upload beach.jpg again.

114
00:04:29,220 --> 00:04:30,390
‫Now this has been uploaded,

115
00:04:30,390 --> 00:04:31,380
‫we can look at the versions,

116
00:04:31,380 --> 00:04:34,230
‫so there is a new version right here

117
00:04:34,230 --> 00:04:38,130
‫of DK2 of my beach.jpg file.

118
00:04:38,130 --> 00:04:41,163
‫And now if I go here and refresh,

119
00:04:42,060 --> 00:04:43,500
‫now let's look at one more setting

120
00:04:43,500 --> 00:04:45,360
‫that is important for your exam.

121
00:04:45,360 --> 00:04:47,760
‫So if I go back into Management,

122
00:04:47,760 --> 00:04:50,850
‫and take this and edit this role,

123
00:04:50,850 --> 00:04:52,710
‫we can scroll down and have a look

124
00:04:52,710 --> 00:04:55,890
‫at one setting called the delete marker replication.

125
00:04:55,890 --> 00:04:57,570
‫So by default, delete markers

126
00:04:57,570 --> 00:04:59,070
‫are not replicated

127
00:04:59,070 --> 00:05:00,450
‫but there's a feature to do so.

128
00:05:00,450 --> 00:05:03,450
‫So if you enable delete marker replication,

129
00:05:03,450 --> 00:05:08,070
‫then they will be replicated from one bucket to another.

130
00:05:08,070 --> 00:05:09,570
‫So let's save this.

131
00:05:09,570 --> 00:05:12,300
‫So my replication rules have been saved.

132
00:05:12,300 --> 00:05:14,820
‫And so that means that if I go in this bucket,

133
00:05:14,820 --> 00:05:16,890
‫and I choose to delete this file, for example,

134
00:05:16,890 --> 00:05:20,940
‫I delete my coffee.jpg file, let's delete it.

135
00:05:20,940 --> 00:05:23,040
‫This will actually create a delete marker

136
00:05:23,040 --> 00:05:25,083
‫because my bucket is versioned.

137
00:05:26,370 --> 00:05:27,900
‫We're done.

138
00:05:27,900 --> 00:05:31,800
‫So now my coffee.jpg is deleted.

139
00:05:31,800 --> 00:05:33,450
‫And let's have a look in here.

140
00:05:33,450 --> 00:05:36,393
‫So let's refresh and we need to wait little bit.

141
00:05:37,290 --> 00:05:39,390
‫And now you can see that the delete marker

142
00:05:39,390 --> 00:05:42,390
‫has been replicated to my replica bucket.

143
00:05:42,390 --> 00:05:43,860
‫So if I don't show version,

144
00:05:43,860 --> 00:05:46,140
‫I don't see my coffee.jpg file

145
00:05:46,140 --> 00:05:48,630
‫but of course, if I show versions, I will see it.

146
00:05:48,630 --> 00:05:49,980
‫This is true here.

147
00:05:49,980 --> 00:05:52,380
‫And of course, this is true here as well.

148
00:05:52,380 --> 00:05:54,690
‫So the delete markers are deleted

149
00:05:54,690 --> 00:05:58,772
‫but if you decide to delete a specific version

150
00:05:58,772 --> 00:06:00,810
‫of a file, for example,

151
00:06:00,810 --> 00:06:05,130
‫I delete this one, which is I delete a specific version ID.

152
00:06:05,130 --> 00:06:07,500
‫So this is called the permanent delete.

153
00:06:07,500 --> 00:06:11,972
‫And if I permanently delete one object

154
00:06:11,972 --> 00:06:14,130
‫in my origin bucket,

155
00:06:14,130 --> 00:06:18,000
‫it will not be replicated to my replica bucket.

156
00:06:18,000 --> 00:06:20,940
‫So this beach.jpg here will never be deleted

157
00:06:20,940 --> 00:06:23,280
‫because only delete markers are replicated,

158
00:06:23,280 --> 00:06:25,050
‫not deletes, okay?

159
00:06:25,050 --> 00:06:26,550
‫So that's it for this lecture.

160
00:06:26,550 --> 00:06:29,500
‫I hope you liked it and I will see you in the next lecture.