1
00:00:00,050 --> 00:00:04,220
Lesson building a profession of eye auditors, standards and training.

2
00:00:04,220 --> 00:00:10,400
Building a profession of eye auditors is an imperative component in addressing the ongoing issues and

3
00:00:10,400 --> 00:00:13,820
challenges associated with artificial intelligence.

4
00:00:14,270 --> 00:00:20,240
As AI systems proliferate across industries, from healthcare to finance, the need for robust governance

5
00:00:20,240 --> 00:00:22,430
frameworks grows ever more crucial.

6
00:00:22,970 --> 00:00:29,270
AI auditors play a pivotal role in ensuring that AI systems adhere to ethical guidelines, regulatory

7
00:00:29,270 --> 00:00:31,550
requirements, and performance standards.

8
00:00:31,550 --> 00:00:37,910
Establishing a profession of AI auditors entails creating a comprehensive set of standards and a rigorous

9
00:00:37,910 --> 00:00:44,240
training regimen, which must be grounded in a deep understanding of both technical and ethical dimensions.

10
00:00:45,590 --> 00:00:52,100
AI auditors must possess a unique blend of skills and knowledge, encompassing technical expertise in

11
00:00:52,100 --> 00:00:58,340
AI and machine learning, a keen understanding of ethical considerations, and familiarity with regulatory

12
00:00:58,340 --> 00:00:59,240
landscapes.

13
00:00:59,930 --> 00:01:04,920
To meet these demanding requirements, the training programs must be meticulously designed to cover

14
00:01:04,920 --> 00:01:07,080
various facets of AI auditing.

15
00:01:07,440 --> 00:01:13,080
This includes understanding algorithmic transparency, fairness, accountability, and the societal

16
00:01:13,080 --> 00:01:14,580
impacts of AI systems.

17
00:01:14,580 --> 00:01:20,520
For instance, auditors should be adept at examining the training data used in AI systems to identify

18
00:01:20,520 --> 00:01:23,790
biases that might lead to discriminatory outcomes.

19
00:01:24,150 --> 00:01:25,920
A study by Obermaier et al.

20
00:01:25,920 --> 00:01:30,630
Revealed that an algorithm used in health care disproportionately favored white patients over black

21
00:01:30,630 --> 00:01:35,790
patients, highlighting the critical need for thorough auditing to prevent such biases.

22
00:01:38,520 --> 00:01:44,190
Moreover, AI auditors must be proficient in technical evaluation methods to assess the performance

23
00:01:44,190 --> 00:01:46,500
and reliability of AI systems.

24
00:01:46,890 --> 00:01:52,230
This includes understanding statistical methods, validation techniques, and the ability to interpret

25
00:01:52,230 --> 00:01:53,520
complex models.

26
00:01:53,970 --> 00:01:59,970
The deployment of AI models in high stakes scenarios, such as autonomous driving or medical diagnosis,

27
00:02:00,000 --> 00:02:04,770
necessitates stringent validation protocols to ensure safety and efficacy.

28
00:02:05,050 --> 00:02:10,930
For instance, the failure of an autonomous vehicle in Arizona, which resulted in a fatality, underscores

29
00:02:10,930 --> 00:02:16,900
the importance of rigorous auditing processes to preemptively identify and mitigate risks.

30
00:02:18,460 --> 00:02:24,220
The establishment of standards for AI auditing is paramount to ensuring consistency and reliability

31
00:02:24,220 --> 00:02:25,810
in the auditing process.

32
00:02:26,140 --> 00:02:31,210
These standards should be developed through a collaborative approach involving stakeholders from academia,

33
00:02:31,240 --> 00:02:34,090
industry, government, and civil society.

34
00:02:34,990 --> 00:02:40,750
Such collaboration ensures that the standards are comprehensive and reflective of diverse perspectives

35
00:02:40,750 --> 00:02:41,890
and concerns.

36
00:02:42,400 --> 00:02:49,240
For example, the IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems has been instrumental

37
00:02:49,240 --> 00:02:54,310
in developing ethical standards for AI, providing a valuable framework for auditors.

38
00:02:55,690 --> 00:03:00,790
Training AI auditors also requires a focus on the ethical implications of AI systems.

39
00:03:01,210 --> 00:03:07,130
Auditors must be equipped to evaluate AI systems against ethical principles such as fairness, Transparency

40
00:03:07,130 --> 00:03:08,390
and accountability.

41
00:03:09,200 --> 00:03:14,750
This involves understanding the potential societal impacts of AI, including issues related to privacy,

42
00:03:14,750 --> 00:03:16,850
surveillance, and the digital divide.

43
00:03:17,480 --> 00:03:23,360
For instance, the use of AI surveillance systems has raised significant ethical concerns regarding

44
00:03:23,360 --> 00:03:28,910
privacy and civil liberties, necessitating thorough ethical evaluations by auditors.

45
00:03:29,930 --> 00:03:35,930
Furthermore, continuous professional development is essential for AI auditors to stay abreast of the

46
00:03:35,930 --> 00:03:40,280
rapidly evolving technological landscape and regulatory environment.

47
00:03:40,730 --> 00:03:46,370
This can be facilitated through ongoing education programs, workshops, and certifications.

48
00:03:46,790 --> 00:03:53,000
Professional bodies and organizations can play a crucial role in providing these opportunities, ensuring

49
00:03:53,000 --> 00:03:57,950
that auditors maintain their expertise and adhere to the highest standards of practice.

50
00:03:58,220 --> 00:04:03,830
The role of professional bodies such as the Association for Computing Machinery and the Institute of

51
00:04:03,830 --> 00:04:09,720
Electrical and Electronics Engineers in offering certifications and continuous learning opportunities,

52
00:04:09,750 --> 00:04:14,280
is instrumental in fostering a robust profession of AI auditors.

53
00:04:15,810 --> 00:04:22,110
In addition to technical and ethical training, AI auditors must also develop strong analytical and

54
00:04:22,110 --> 00:04:23,670
critical thinking skills.

55
00:04:23,700 --> 00:04:30,060
This enables them to identify potential issues and discrepancies in AI systems, and to make informed

56
00:04:30,060 --> 00:04:33,750
decisions regarding their compliance with established standards.

57
00:04:33,750 --> 00:04:39,840
For example, auditors must be capable of critically evaluating the outcomes of AI models to ensure

58
00:04:39,840 --> 00:04:45,150
they align with the intended objectives and do not produce unintended harmful consequences.

59
00:04:46,200 --> 00:04:51,360
The ability to think critically and analytically is essential for identifying and addressing complex

60
00:04:51,360 --> 00:04:54,420
issues that may arise in the auditing process.

61
00:04:56,730 --> 00:05:03,510
Moreover, effective communication skills are crucial for AI auditors as they must be able to clearly

62
00:05:03,510 --> 00:05:09,180
articulate their findings and recommendations to diverse stakeholders, including technical teams,

63
00:05:09,180 --> 00:05:11,860
management and regulatory bodies.

64
00:05:12,250 --> 00:05:18,130
This requires the ability to translate complex technical concepts into understandable language, and

65
00:05:18,130 --> 00:05:21,730
to provide actionable insights that can guide decision making.

66
00:05:21,730 --> 00:05:27,670
The importance of clear and effective communication in the auditing process cannot be overstated, as

67
00:05:27,670 --> 00:05:33,970
it ensures that stakeholders are well informed and can take appropriate actions based on the audit findings.

68
00:05:35,800 --> 00:05:42,220
The integration of AI auditing into organizational practices also necessitates the development of robust

69
00:05:42,250 --> 00:05:43,810
governance frameworks.

70
00:05:44,380 --> 00:05:50,230
Organizations must establish clear policies and procedures for AI auditing, including defining the

71
00:05:50,230 --> 00:05:56,200
scope and objectives of audits, selecting appropriate auditing methods, and ensuring the independence

72
00:05:56,200 --> 00:05:58,390
and objectivity of auditors.

73
00:05:59,050 --> 00:06:04,330
This involves creating a culture of accountability and transparency, where the findings of AI audits

74
00:06:04,330 --> 00:06:06,580
are taken seriously and acted upon.

75
00:06:07,150 --> 00:06:13,130
The establishment of governance frameworks is critical for ensuring that AI auditing is conducted Systematically

76
00:06:13,130 --> 00:06:19,460
and consistently, thereby enhancing the overall reliability and trustworthiness of AI systems.

77
00:06:20,930 --> 00:06:26,900
In conclusion, building a profession of AI auditors is essential for addressing the myriad challenges

78
00:06:26,900 --> 00:06:28,910
associated with AI systems.

79
00:06:29,300 --> 00:06:34,820
This requires the development of comprehensive standards and rigorous training programs that encompass

80
00:06:34,820 --> 00:06:38,270
technical, ethical, and analytical dimensions.

81
00:06:38,630 --> 00:06:44,600
The establishment of professional bodies and continuous professional development opportunities is crucial

82
00:06:44,600 --> 00:06:48,530
for maintaining the expertise and effectiveness of AI auditors.

83
00:06:49,190 --> 00:06:55,160
By fostering a robust profession of AI auditors, we can ensure that AI systems are developed and deployed

84
00:06:55,160 --> 00:07:00,530
in a manner that is ethical, transparent, and accountable, ultimately enhancing their reliability

85
00:07:00,530 --> 00:07:01,730
and trustworthiness.

86
00:07:02,270 --> 00:07:07,520
The collaborative efforts of stakeholders across academia, industry, government and civil society

87
00:07:07,520 --> 00:07:14,060
are vital in achieving this goal and in addressing the ongoing issues and challenges posed by AI.