Logo

AI and Data Protection

Many business decision makers are already thinking about or have implemented Artificial Intelligence (AI) into their day-to-day business operations.  This seismic shift in technical capability comes with some challenges and must be done in accordance with a range of legal requirements relating to the protection of data, specifically personal data.

What are the legal requirements?

1. General Data Protection Regulation (GDPR) – Europe

The GDPR (EU regulation) has strict rules on how AI processes personal data. Key requirements include:

Lawful Basis for Processing (Article 6)

  • AI systems must have a lawful basis (e.g., consent, legitimate interest, legal obligation) before processing personal data.

Data Subject Rights (Articles 12-22)

  • Individuals have rights such as:

    • Right to be informed (explainable AI)

    • Right to access data

    • Right to rectification

    • Right to erasure (right to be forgotten)

    • Right to object to automated decision-making (AI-based decisions must have human oversight)

Automated Decision-Making & Profiling (Article 22)

  • If an AI system makes fully automated decisions with legal effects, individuals must have:

    • The right to contest decisions

    • Human intervention in critical cases

    • Transparency on how the decision was made

Privacy by Design & Default (Article 25)

  • AI systems must incorporate data protection measures from the start (e.g., data minimization, encryption).

Data Protection Impact Assessment (DPIA) (Article 35)

  • If AI processing poses high risks to individuals (e.g., biometric recognition), organizations must conduct a DPIA.

Cross-Border Data Transfers (Articles 44-50)

  • AI systems processing data outside the EU must comply with international transfer rules (e.g., Standard Contractual Clauses, adequacy decisions).

2. Artificial Intelligence Act (EU AI Act) – Europe

The EU AI Act (expected enforcement in 2025) introduces risk-based AI regulation:

  • Unacceptable risk AI (banned): e.g., real-time biometric surveillance, social scoring.

  • High-risk AI (strict requirements): e.g., healthcare, banking, critical infrastructure.

  • Limited-risk AI (transparency obligations): e.g., AI chatbots.

  • Minimal-risk AI (no restrictions): e.g., AI-powered video games.

If an AI system processes personal data, it must comply with both the EU AI Act and GDPR.

3. California Consumer Privacy Act (CCPA) & CPRA – USA

The CCPA (2018) & CPRA (2023) set AI-related data protection rules for companies handling California residents’ data:

  • Right to opt-out of automated decision-making

  • Right to know if AI is making decisions about them

  • Right to correct and delete personal data

  • Stronger consent requirements for sensitive data (e.g., biometric data)

4. UK GDPR & AI Regulation
  • UK GDPR aligns with EU GDPR but allows more flexibility in AI innovation.

  • The UK is developing its own AI regulations, focusing on accountability, fairness, and explainability in AI systems. Note – Visit the Information Commissioners Office Website for more information.
5. China’s Personal Information Protection Law (PIPL)
  • Similar to GDPR, but stricter on data localization (AI using Chinese citizens’ data must store it in China).

  • Requires explicit consent for AI-based decisions.

  • Prohibits unfair AI discrimination.

How do you address the legal challenges around AI?

Organisations should ensure that they have considered the legal requirements from the very start of their project.
How does the assessment work?
We typically work with our clients to undertake a risk based assessment of the AI use cases aligned to their project. This involves:
  • Reviewing specific use cases (e.g. a Co-Pilot Implementation)
  • Undertaking the legally mandated risk assessments
  • Addressing any areas of non-compliance
  • Working with designers and implementors to ensure that the AI implementation subsequently aligns to the legal requirements and has implemented the risk assessment recommendations.
Note – an early stage review of AI and data protection is vital to removing compliance risk from your project and also reduces the likelihood of reworking requirements and costly re-development.

Find out more

Data Privacy Services are experts in the data protection compliance of AI solutions. We work with founders and business decision makers to address the risks and compliance requirements.  Contact us to arrange a call and discuss your AI project.

More Posts

Thank you for contacting us

We will respond shortly

Note – if you do not receive an email from us please check your spam folder as we normally respond within 2 hours.

Data Privacy Services
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.