WEBVTT - This file was automatically generated by VIMEO

0
00:00:07.840 --> 00:00:08.520
Hi.

1
00:00:08.520 --> 00:00:13.500
In this video we will talk about how to load the data into our pandas data

2
00:00:13.510 --> 00:00:16.980
frame. What are the options and about our dataset?

3
00:00:19.350 --> 00:00:23.850
Our dataset for this module is stored in a CSV file. Uh,

4
00:00:23.870 --> 00:00:26.370
it is called Cybersecurity attacks csv,

5
00:00:27.380 --> 00:00:28.960
and this is the main data set,

6
00:00:28.960 --> 00:00:33.920
which contains a few statistics about various cyber attacks, their categories,

7
00:00:34.020 --> 00:00:37.320
sub-categories, protocol in a specific time period.

8
00:00:39.000 --> 00:00:43.020
The second file, this is this one, D C P four C S V,

9
00:00:44.060 --> 00:00:48.640
uh, which contains information about ports and services running on these ports.

10
00:00:49.390 --> 00:00:54.010
In one of the exercises, it'll be used to join with the main dataset.

11
00:00:57.660 --> 00:01:02.200
We have already used few times the pandas method to load C Ss V into

12
00:01:02.460 --> 00:01:07.400
pandas. It is the method, the read, c s v wait past the file name,

13
00:01:08.270 --> 00:01:09.420
which would like to open.

14
00:01:10.460 --> 00:01:13.600
It is very flexible and has a lot of parameters,

15
00:01:13.860 --> 00:01:17.200
but the most used parameters are the heater parameter,

16
00:01:17.870 --> 00:01:20.260
which allows to set by you explicitly.

17
00:01:20.280 --> 00:01:24.740
If you data content heaters step as a separator,

18
00:01:26.420 --> 00:01:28.440
and in case your file is too big,

19
00:01:28.580 --> 00:01:33.440
you can process the C s V chunk by chunk using chunk parameter visual return

20
00:01:33.440 --> 00:01:34.760
to you and iterator object.

21
00:01:37.900 --> 00:01:40.640
The c s V file is most common and reliable,

22
00:01:40.940 --> 00:01:45.640
but often you may want to load the data from different sources like a database

23
00:01:46.440 --> 00:01:48.900
market files. H D F F.

24
00:01:49.400 --> 00:01:52.420
The C S V file is the most common and reliable,

25
00:01:53.280 --> 00:01:58.060
but often you may want to load the data from different sources like a database,

26
00:01:58.560 --> 00:02:03.020
market files, uh, feather format, uh, SS three bucket, or from Hadoop.

27
00:02:03.960 --> 00:02:06.260
And, uh, Panda supports many of these.

28
00:02:11.330 --> 00:02:15.670
In our next video, we will explore a few methods for the initial data audit.
