1 00:00:00,470 --> 00:00:02,060 Hey, what's up, Gurus? 2 00:00:02,060 --> 00:00:06,490 Welcome to section 2, Data Engineering Crash Course. 3 00:00:06,490 --> 00:00:08,470 In this section, I'm going to be teaching you 4 00:00:08,470 --> 00:00:10,850 the basics of data engineering. 5 00:00:10,850 --> 00:00:12,803 And we're going to walk through some important concepts 6 00:00:12,803 --> 00:00:16,820 that you're going to need to know for the DP-203. 7 00:00:16,820 --> 00:00:18,410 Now, before we dive any further, 8 00:00:18,410 --> 00:00:21,340 it's important that we have our You Are Here page 9 00:00:21,340 --> 00:00:22,843 for the Introduction section. 10 00:00:22,843 --> 00:00:25,513 So, you are here. 11 00:00:26,520 --> 00:00:29,940 We are at the very beginning of a fairly long course. 12 00:00:29,940 --> 00:00:32,923 So make sure that you have set aside 13 00:00:32,923 --> 00:00:34,660 a timetable for yourself 14 00:00:34,660 --> 00:00:37,074 so that you can kind of keep pace with where you should be 15 00:00:37,074 --> 00:00:40,080 as you move towards taking this exam. 16 00:00:40,080 --> 00:00:43,625 Also, make that you have set aside breaks for yourself. 17 00:00:43,625 --> 00:00:47,880 Don't try and rush through the entire course with no breaks. 18 00:00:47,880 --> 00:00:49,923 You're going to find yourself very frustrated, 19 00:00:49,923 --> 00:00:52,860 even if that's just, "I'm going to watch 3 videos, 20 00:00:52,860 --> 00:00:53,693 "then I'm going to step out, 21 00:00:53,693 --> 00:00:55,714 "and I'm going to take a walk for 5 or 10 minutes, 22 00:00:55,714 --> 00:00:58,110 "and then I'm going to sit back down to it." 23 00:00:58,110 --> 00:01:01,833 Just make sure that you are pacing yourself for this exam. 24 00:01:04,000 --> 00:01:06,763 Now, like any good Introduction section, 25 00:01:06,763 --> 00:01:10,100 we are going to be building the foundation. 26 00:01:10,100 --> 00:01:11,010 And your building 27 00:01:11,010 --> 00:01:13,770 is only going to be as good as its foundation. 28 00:01:13,770 --> 00:01:17,300 So we're going to start that process here by diving in. 29 00:01:17,300 --> 00:01:19,530 We're also going to talk about core concepts. 30 00:01:19,530 --> 00:01:22,500 What is data, exactly? What's data engineering? 31 00:01:22,500 --> 00:01:24,623 How do those 2 play together? 32 00:01:26,630 --> 00:01:30,310 Lastly, a few key points for you to keep in mind. 33 00:01:30,310 --> 00:01:32,900 First, think buckets. 34 00:01:32,900 --> 00:01:37,380 So as we go through the various tasks for this exam, 35 00:01:37,380 --> 00:01:38,935 I want you to think about what services 36 00:01:38,935 --> 00:01:41,630 those tasks could be performed in. 37 00:01:41,630 --> 00:01:45,730 Is it Data Factory, Databricks, Azure Stream Analytics, 38 00:01:45,730 --> 00:01:48,940 Synapse, or multiple services? 39 00:01:48,940 --> 00:01:50,280 I want you to think about the buckets 40 00:01:50,280 --> 00:01:51,600 as we go through these tasks, 41 00:01:51,600 --> 00:01:54,424 because it's really going to help you in the exam 42 00:01:54,424 --> 00:01:56,990 and also in your career to be able to think about 43 00:01:56,990 --> 00:01:59,180 where those things would live. 44 00:01:59,180 --> 00:02:01,300 Next, repetition. 45 00:02:01,300 --> 00:02:04,253 Key services and key concepts will be repeated. 46 00:02:04,253 --> 00:02:08,520 So the first part to that, if you are not getting something, 47 00:02:08,520 --> 00:02:10,023 go all the way through the section, 48 00:02:10,023 --> 00:02:12,400 don't get hung up at the very beginning. 49 00:02:12,400 --> 00:02:15,290 It may be something that we cover multiple times. 50 00:02:15,290 --> 00:02:17,053 And the other side of that repetition, 51 00:02:17,053 --> 00:02:19,710 we have hands-on labs. 52 00:02:19,710 --> 00:02:21,130 And as you go through the sections 53 00:02:21,130 --> 00:02:22,690 you will see hands-on labs 54 00:02:22,690 --> 00:02:26,560 reinforcing some of important concepts from each section. 55 00:02:26,560 --> 00:02:28,840 So if you're not getting something clearly 56 00:02:28,840 --> 00:02:31,264 all the way through, do the lab as well. 57 00:02:31,264 --> 00:02:34,990 At the end of that, you might go, "Oh, I get it now." 58 00:02:34,990 --> 00:02:35,823 If you haven't, 59 00:02:35,823 --> 00:02:39,600 please go back, watch it again, ask questions. 60 00:02:39,600 --> 00:02:41,210 We're here to help, and we will make sure 61 00:02:41,210 --> 00:02:43,073 that you get where you need to be. 62 00:02:44,334 --> 00:02:48,150 Finally--yes--you need this for your career, too. 63 00:02:48,150 --> 00:02:49,605 For most data engineering positions 64 00:02:49,605 --> 00:02:51,830 it's more than a certification. 65 00:02:51,830 --> 00:02:53,535 There are very few data engineering jobs 66 00:02:53,535 --> 00:02:57,113 that don't require some sort of onboarding exam, right? 67 00:02:57,113 --> 00:03:00,260 Entrance exam, or whatever you want to call it. 68 00:03:00,260 --> 00:03:03,770 You're going to need to know the basics of data engineering. 69 00:03:03,770 --> 00:03:04,610 You're going to need to know 70 00:03:04,610 --> 00:03:06,222 beyond the basics of data engineering 71 00:03:06,222 --> 00:03:09,270 to be able to be a competent data engineer. 72 00:03:09,270 --> 00:03:12,220 So just getting the certification is not enough. 73 00:03:12,220 --> 00:03:13,500 And while I wouldn't recommend 74 00:03:13,500 --> 00:03:14,824 that you run off into the weeds 75 00:03:14,824 --> 00:03:19,210 in other concepts that don't relate to the 203, 76 00:03:19,210 --> 00:03:21,502 what I would suggest is you leave some notes for yourself 77 00:03:21,502 --> 00:03:23,720 of things that you would like to go back 78 00:03:23,720 --> 00:03:26,430 and learn more on as the course progresses. 79 00:03:26,430 --> 00:03:29,590 That way you won't get lost, and off in the weeds, 80 00:03:29,590 --> 00:03:32,370 and miss your deadlines for completing the 203. 81 00:03:32,370 --> 00:03:33,870 But you'll have some good notes 82 00:03:33,870 --> 00:03:35,541 for where you should go from here. 83 00:03:35,541 --> 00:03:37,112 All right, I hope that has been helpful. 84 00:03:37,112 --> 00:03:39,593 Let's dive into this section.