International Comparison: AI Security Frameworks

April 17, 2026 Β· View on GitHub

How Australia compares to global AI security approaches

This document compares Australia's AI security landscape against major international frameworks: the European Union, United Kingdom, United States, Singapore, Canada, and Japan.


Comparison Matrix

DimensionπŸ‡¦πŸ‡Ί AustraliaπŸ‡ͺπŸ‡Ί EUπŸ‡¬πŸ‡§ UKπŸ‡ΊπŸ‡Έ USπŸ‡ΈπŸ‡¬ SingaporeπŸ‡¨πŸ‡¦ Canada
Binding AI Security Law❌ Noβœ… AI Act⚠️ Emerging⚠️ State-level❌ No⚠️ Sector
Risk Classification❌ Noβœ… 4-tier⚠️ Principles⚠️ NIST RMFβœ… AI Verify⚠️ ADM levels
Adversarial Testing⚠️ Detection onlyβœ… Mandatoryβœ… AISI conducts⚠️ Recommendedβœ… Moonshot❌ No
AI Security Body❌ Fragmented⚠️ Distributedβœ… AISI⚠️ NIST/NSAβœ… IMDA❌ No
Supply Chain⚠️ Guidanceβœ… Mandatory⚠️ Code⚠️ NIST guidance⚠️ AI Verify❌ No
Foundation Models❌ Noβœ… GPAI rulesβœ… AISI focus⚠️ EO (rescinded)⚠️ Emerging❌ No
Incident Reporting❌ No (AI-specific)βœ… High-risk AI⚠️ Emerging⚠️ Sector❌ No❌ No
Private Sector❌ Voluntaryβœ… All high-risk⚠️ Voluntary+⚠️ Mixed⚠️ Voluntary+⚠️ Federal only

Legend: βœ… Comprehensive | ⚠️ Partial/Emerging | ❌ Gap


European Union

EU AI Act

The EU AI Act is the world's first comprehensive, legally binding AI regulation. It entered into force in August 2024 with phased implementation through 2027.

Key AI Security Provisions:

Article 15: Accuracy, Robustness and Cybersecurity

High-risk AI systems must:

  • Achieve appropriate levels of accuracy, robustness, and cybersecurity
  • Be resilient against attempts by unauthorised third parties to alter use, outputs or performance
  • Address technical solutions for:
    • Data poisoning
    • Model poisoning
    • Adversarial examples
    • Model flaws

Article 53: GPAI Provider Obligations

General-purpose AI providers must:

  • Provide technical documentation
  • Make information available to downstream providers
  • Document training data (summary)
  • Comply with copyright requirements

Article 55: Systemic Risk GPAI

GPAI models with systemic risk must additionally:

  • Perform model evaluation
  • Assess and mitigate systemic risks
  • Conduct adversarial testing
  • Report serious incidents
  • Ensure cybersecurity protections

Enforcement

ViolationMaximum Penalty
Prohibited AI practices€35M or 7% global turnover
High-risk non-compliance€15M or 3% global turnover
Incorrect information€7.5M or 1% global turnover

Australia vs EU

AspectAustraliaEU
Private sector binding requirements❌ Noβœ… Yes
Risk classification system❌ Noβœ… 4-tier
Adversarial testing mandate❌ Noβœ… Systemic risk GPAI
Conformity assessment❌ Noβœ… High-risk AI
Penalties for non-compliance❌ N/Aβœ… Up to 7% turnover

United Kingdom

AI Security Institute (AISI)

The UK renamed its AI Safety Institute to the AI Security Institute in February 2025, explicitly expanding mandate to include:

  • National security applications
  • Cyberattacks and fraud
  • Adversarial robustness
  • Model security evaluation

Key Activities:

  • Red-teaming of frontier models
  • Security evaluation methodology
  • Published research on adversarial attacks
  • International cooperation

UK AI Cyber Security Code of Practice

Published January 2025, provides 13 principles across 5 lifecycle phases:

Lifecycle Phases:

  1. Secure Design
  2. Secure Development
  3. Secure Deployment
  4. Secure Maintenance
  5. Secure End-of-Life

Security Requirements:

  • Security awareness training (regular, risk-based frequency)
  • Secure coding training for AI developers
  • Threat modelling including AI-specific attacks
  • Supply chain security
  • Incident response for AI systems

Australia vs UK

AspectAustraliaUK
Dedicated AI Security body❌ AISI is Safety-focusedβœ… AISI renamed to Security
AI Cyber Security Code❌ Noβœ… 13 principles, 5 phases
Red-teaming capability❌ Noβœ… AISI conducts
Training requirements❌ Noβœ… regular security training
Frontier model evaluation⚠️ AISI operationalβœ… Active program

United States

Federal Landscape

The US approach is fragmented across agencies with sector-specific requirements.

Key Frameworks:

NIST AI Risk Management Framework (AI RMF 1.0, NIST AI 100-1)

Voluntary framework with four core functions:

  1. Govern - Cultivate AI risk management culture
  2. Map - Identify and categorise AI risks
  3. Measure - Analyse and assess AI risks
  4. Manage - Prioritise and act on risks

Security Coverage:

  • "Secure and Resilient" is core trustworthy AI characteristic
  • Addresses adversarial robustness
  • Supply chain risk management
  • Incident management

NIST Adversarial Machine Learning Report (NIST AI 100-2e2023)

Comprehensive taxonomy covering:

  • Evasion attacks - Manipulating inputs to cause misclassification
  • Poisoning attacks - Corrupting training data
  • Privacy attacks - Extracting training data or model information
  • Availability attacks - Denial of service against AI systems

NSA AI Security Center

Established to:

  • Develop AI security guidance
  • Coordinate with Five Eyes partners (including ACSC)
  • Focus on national security AI applications
  • Co-authored "Deploying AI Systems Securely" (CSI, April 2024) with ACSC

DHS AI Guidelines for Critical Infrastructure (DHS, February 2024)

14 February 2024 guidelines categorise three risk areas:

  1. Attacks using AI
  2. Attacks targeting AI systems
  3. AI design failures

Executive Order 14110 (Rescinded)

The October 2023 Executive Order established AI safety requirements including:

  • Red-teaming definitions
  • Reporting requirements for dual-use foundation models
  • Security standards development

Note: EO 14110 was rescinded in January 2025. Impact on AI security requirements ongoing.

EO 14179 "Removing Barriers to American Leadership in AI" (January 2025) replaced EO 14110 with a deregulatory approach. The US AI Safety Institute was subsequently renamed to the Center for AI Standards and Innovation (CAISI) in June 2025. The Trump administration released legislative recommendations in March 2026 seeking to preempt state AI laws with a "minimally burdensome" federal framework.

Australia vs US

AspectAustraliaUS
Risk management framework❌ Noβœ… NIST AI RMF
Adversarial ML taxonomy❌ Noβœ… NIST AI 100-2
AI security researchLimitedβœ… >$700M annually (NSF)
CI AI guidelines⚠️ CISC factsheetβœ… DHS comprehensive
Five Eyes coordinationβœ… Via ACSCβœ… NSA AISC

Singapore

National AI Strategy 2.0

Singapore's updated AI strategy emphasises trusted AI with practical implementation tools.

Key Initiatives:

AI Verify

World's first AI governance testing framework:

  • Self-assessment tool
  • Technical testing
  • Maps to international standards (ISO/IEC 42001)
  • Process-based and technical checks

Testing Areas:

  • Transparency
  • Fairness
  • Robustness
  • Accountability
  • Data governance

Project Moonshot

World's first open-source LLM red-teaming toolkit:

  • Automated testing
  • Manual adversarial testing
  • Jailbreak detection
  • Prompt injection testing
  • Benchmark against attack libraries

Freely available: github.com/aiverify-foundation/moonshot

Model AI Governance Framework

Practical guidance for:

  • Internal governance
  • Human oversight
  • Operations management
  • Stakeholder communication

Australia vs Singapore

AspectAustraliaSingapore
AI governance tool❌ Noβœ… AI Verify
Red-teaming toolkit❌ Noβœ… Project Moonshot (open source)
Model governance framework⚠️ NAIC guidanceβœ… Comprehensive framework
Testing/certification❌ Noβœ… AI Verify self-assessment
International standards alignment⚠️ Referencesβœ… Maps to ISO 42001

Canada

Federal Approach

Directive on Automated Decision-Making

Mandatory for all federal government AI:

Impact Assessment Levels:

LevelImpactRequirements
Level ILittle to noBasic documentation
Level IIModeratePeer review, testing
Level IIIHighExpert review, public notice
Level IVVery HighFull review, legal compliance

Security Requirements:

  • Security assessments during development
  • Measures to secure data and model integrity
  • Prevention of tampering and unauthorised modifications
  • Regular testing and monitoring

Algorithmic Impact Assessment Tool

Public tool for assessing AI systems:

  • 106 questions
  • Generates impact level
  • Identifies mitigation requirements

Australia vs Canada

AspectAustraliaCanada
Government AI mandateβœ… DTA Policyβœ… ADM Directive
Impact assessment tool❌ Noβœ… AIA Tool
Security in AI directive⚠️ General referenceβœ… Explicit requirements
Tamper prevention❌ Not specifiedβœ… Required
Public transparency⚠️ DTA transparency statementsβœ… Mandatory for Level III+

Japan

AI Safety Institute (Japan AISI)

Established 14 February 2024, Japan's AISI focuses on:

  • AI safety evaluation
  • Evaluation methodology development
  • International cooperation

Published:

  • AI Safety Evaluation Perspectives v1.01
  • Guidelines for AI development
  • Testing methodology

AI Security Coverage

Japan AISI evaluation perspectives include:

  • Robustness against adversarial inputs
  • Security of AI systems
  • Privacy protection
  • Misuse prevention

Australia vs Japan

AspectAustraliaJapan
Safety Instituteβœ… AISI (operational early 2026)βœ… AISI (operational)
Evaluation methodology❌ Not publishedβœ… Published v1.01
Adversarial robustness⚠️ ISM controlβœ… In evaluation framework
International cooperationβœ… INASI memberβœ… INASI member

China

Regulatory Landscape

China has binding AI regulations that predate the EU AI Act:

RegulationDateScope
Algorithmic Recommendation ProvisionsMar 2022Algorithmic transparency, user opt-out
Deep Synthesis ProvisionsJan 2023Deepfakes, synthetic media labelling
Interim Measures for Generative AIAug 2023Content review, training data compliance, watermarking

Key difference from Australia: China has mandatory, enforceable AI regulations covering the private sector. Australia has no equivalent.

Important context: China's AI regulations serve fundamentally different governance objectives, including content control and political censorship. The regulatory framework is embedded in an authoritarian governance model not comparable to liberal democracies. However, the technical regulatory mechanisms (registration, impact assessment, transparency requirements) offer useful comparison points.


International Network for Advanced AI Measurement, Evaluation and Science

Australia is a member of INASI, connecting with peer institutes:

Members:

  • πŸ‡¬πŸ‡§ UK AISI (AI Security Institute)
  • πŸ‡ΊπŸ‡Έ US CAISI (formerly AISI)
  • πŸ‡―πŸ‡΅ Japan AISI
  • πŸ‡°πŸ‡· Korea AISI
  • πŸ‡«πŸ‡· France AISI
  • πŸ‡¨πŸ‡¦ Canada AISI
  • πŸ‡ΈπŸ‡¬ Singapore (observer)
  • πŸ‡¦πŸ‡Ί Australia AISI (member)
  • πŸ‡ͺπŸ‡Ί EU AI Office (observer)

Focus Areas:

  • Frontier AI safety
  • Evaluation methodology sharing
  • Joint research
  • Information sharing on risks

Note: Network focuses on AI Safety; AI Security coordination varies by member.


Key Lessons for Australia

From EU

  • Lesson: Mandatory requirements drive compliance
  • Action: Consider binding AI security requirements for high-risk AI

From UK

  • Lesson: Safety and Security need unified approach
  • Action: Expand AISI mandate or rename to Security Institute

From Singapore

  • Lesson: Practical tools enable adoption
  • Action: Develop Australian AI security assessment toolkit

From US

  • Lesson: Comprehensive taxonomy enables understanding
  • Action: Adopt or develop Australian adversarial ML framework

From Canada

  • Lesson: Government can lead by example
  • Action: Strengthen DTA policy with explicit security requirements

Standards Alignment

ISO/IEC Standards

StandardDescriptionAustralia Status
ISO/IEC 42001:2023AI Management SystemsReferenced, not mandated
ISO/IEC 23894:2023AI Risk ManagementReferenced
ISO/IEC 27001:2022Information Security ManagementISM aligns
ISO/IEC 27701:2019Privacy Information ManagementOAIC references

Emerging and Recently Published Standards

StandardDescriptionStatus
ISO/IEC 27090:2024AI Cybersecurity GuidelinesPublished December 2024
ISO/IEC 24029-1:2021AI Robustness β€” Part 1: OverviewPublished
ISO/IEC 24029-2:2023AI Robustness β€” Part 2: Formal MethodsPublished
IEEE 2841Framework and Process for Deep Learning EvaluationIn development

International Treaties

TreatyDateAustralia Status
Council of Europe Framework Convention on AIAdopted May 2024, open for signature Sep 2024Not yet signed
Bletchley Declaration on AI SafetyNov 2023Signatory
Seoul Declaration on AI SafetyMay 2024Signatory

Conclusion

Australia's AI security approach has strengths in technical guidance (ACSC) and government policy (ISM, PSPF), but lags international peers in:

  1. Mandatory private sector requirements (EU leads)
  2. Unified Safety/Security approach (UK leads)
  3. Practical assessment tools (Singapore leads)
  4. Adversarial ML framework (US leads)
  5. Government AI security requirements (Canada leads)

Closing these gaps requires learning from international approaches while adapting to Australian context.


← Back to Index | Gap Analysis β†’ | Knowledge Graph β†’