-: So in this lesson,
we are going to talk about "Maintaining Metadata"
and what that means.
It's going to be a relatively short lesson.
Basically, I'm going to talk about,
"Hey, maintaining metadata. What exactly is that?"
and then we're going to take a look
at the Copy Activity in Data Factory.
You can also do this in Synapse,
but we'll take a look in Data Factory
and see how you would do that in the Azure portal.
Alright, so the what, when, where and why of metadata?
What?
Well, basically, we can preserve the metadata
for Data Lake migrations
or for Azure Blob Storage migration.
Basically, when we're copying files,
we can preserve the metadata.
And the types of things that we can preserve,
well, we can preserve customer-specified metadata,
or content language, or disposition, or type,
or encoding, or cash control.
The built-in system properties
or customer-specified metadata,
we can preserve that when copying things over.
Well, when and where?
Data Factory and Synapse pipeline copy activities
is what we're talking about when we talk about
this specific metadata preservation.
Why? Well, when we preserve the metadata,
we're preserving continuity.
So basically, what that means is
we are increasing the validity
and the authenticity of the resource,
of the copy activity in the new move
by providing that evidence of changes,
adjustments, migrations, preserving the metadata.
That's why. Because we want to preserve continuity.
Alright, so with that, we're going to jump over
and I'm going to show you how we do this in the portal.
So here we find ourselves in Data Factory.
I have set up a Pipeline in several different datasets.
I've grabbed a Copy data activity
and dragged that onto the canvas.
And then under Source, I have set up a Source dataset.
Now, it's important that the Source dataset is binary.
So make sure that you keep that in mind.
And if you've done that correctly, you can go
to Settings and you will see down here at the bottom
a Preserve setting, and I can choose what I want to do.
If I choose Attributes,
you can see that we're preserving the content type,
language, encoding, disposition, cash control,
and any other specified metadata.
So basically, all the things I just talked about
in the last slide, we're preserving that
when we preserve the attributes, here.
We can also see that by jumping over into code,
and scrolling down just a little bit,
you'll see that we have
a Preserve Attributes section set up here.
And that is where we're doing that in the JSON.
Now, if I change that away from binary into CSV
or something else, you'll see that this Attributes section
disappears entirely.
So we need to have that set
as binary in order to see the Preserve Attributes.
Alright, key points to remember.
This is an odds and ends lesson, super short.
Basically, you need to understand that the option exists.
Do you understand the option exists?
Fantastic, that should be it for this lesson.
You can move on to the next.