Advanced

Nonconformity Handling

A practical guide to nonconformity handling for AI conformity-assessment practitioners.

What This Lesson Covers

Nonconformity Handling is a key topic within Working with a Notified Body. In this lesson you will learn the underlying conformity-assessment discipline, the controlling regulations and standards, how to apply the procedures to real AI systems, and the open questions practitioners are actively working through. By the end you will be able to engage with nonconformity handling in real AI conformity-assessment work with confidence.

This lesson belongs to the Notified Bodies & Accreditation category of the AI Conformity Assessment track. AI conformity assessment sits at the intersection of product regulation, accredited certification, sectoral regulation, and AI engineering. Understanding the notified body and accreditation infrastructure that gives every conformity certificate its legal weight is what lets you build a conformity programme that survives notified-body assessment, certification body audit, and market surveillance scrutiny.

Why It Matters

Work effectively with a notified body once you have engaged one. Learn the application package they expect, the assessment plan they will issue, the on-site or remote assessment day, how nonconformities are raised and graded (major vs minor), how you respond and close them, the certificate that issues at the end, and any conditions or restrictions on the certificate.

The reason nonconformity handling deserves dedicated attention is that AI conformity assessment is a young, rapidly maturing discipline. The EU AI Act conformity-assessment provisions become enforceable in stages between 2025 and 2027, ISO/IEC 42001 certificates started issuing in 2024, and CEN-CENELEC JTC 21 is producing harmonised standards on a rolling basis. Practitioners who can reason from first principles will navigate the next standard or the next interpretation far more effectively than those who only know today's rules.

💡
Mental model: Treat every conformity assessment as a chain — classification, criteria, route, evidence, declaration, marking, registration, post-market. Each link must be defensible to a sophisticated reviewer (notified body, accreditation body, market surveillance authority, court, peer reviewer). Master the chain and you can run any AI conformity-assessment regime that lands tomorrow.

How It Works in Practice

Below is a practical conformity-assessment pattern for nonconformity handling. Read through it once, then think about how you would apply it to a real high-risk AI system in your portfolio.

# Notified body engagement pattern
NB_ENGAGEMENT_STEPS = [
    'Verify NB designation in NANDO for your Annex III category',
    'Shortlist by scope, sector experience, capacity, fees',
    'Submit application package (QMS docs + Annex IV file)',
    'Agree assessment plan',
    'Host on-site / remote assessment',
    'Address nonconformities (major / minor) within agreed window',
    'Receive certificate of assessment',
    'Plan surveillance and substantial-modification handling',
]

Step-by-Step Analytical Approach

  1. Establish the criteria — What regime, standard, or scheme will this assessment measure against (EU AI Act Annex III + harmonised standards, ISO/IEC 42001, FDA SaMD + GMLP, sectoral regulation)? Document the criteria up front; conformity without explicit criteria is opinion, not assurance.
  2. Confirm the assessment route — Map the regime to the route (first-party, second-party, notified-body / certification-body assessment). For high-risk AI specifically, prefer the route that is mandated and defensible rather than the cheapest.
  3. Plan the evidence — Map every essential requirement to the evidence that will demonstrate compliance (technical documentation section, eval report, model card, datasheet, audit log). Use the Working with a Notified Body pattern from this topic.
  4. Collect sufficient appropriate evidence — Multiple sources, time-stamped, hash-pinned, secured. The bar is what a sophisticated reviewer (notified body, certification body, regulator) would expect to support the conformity conclusion.
  5. Form the declaration — Compare evidence to criteria; identify nonconformities; resolve before declaration; produce the DoC, certificate, or attestation; affix marking; register where required.
  6. Operate post-market — Maintain monitoring, handle incidents, manage substantial modifications, refresh evidence at every release, and prepare for surveillance.

When This Topic Applies (and When It Does Not)

Nonconformity Handling applies when:

  • You are placing or putting into service a high-risk AI system in the EU and need to demonstrate AI Act conformity
  • You are pursuing or maintaining ISO/IEC 42001 certification
  • You operate in a regulated sector (medical devices, automotive, aviation, financial services) and need sectoral approval for an AI-enabled product
  • You are responding to a customer or procurement requirement that asks for a conformity declaration, certificate, or attestation
  • You are consuming third-party conformity artefacts (DoCs, certificates, attestations, technical documentation) and need to assess their quality

It does not apply (or applies lightly) when:

  • The AI system is genuinely outside any conformity-assessment regime (most internal-use, low-risk AI)
  • The work is design-stage advisory rather than independent conformity assessment
  • The AI system is a research prototype not placed on market
⚠
Common pitfall: Practitioners often treat conformity assessment as a documentation exercise — producing the technical file, signing the DoC, and considering the work done. Conformity assessment is a living obligation: post-market monitoring, serious incident reporting, substantial modification management, and surveillance audits will catch you if the underlying engineering does not actually meet the essential requirements. Build the evidence as you build the AI; do not retro-fit it for the assessor.

Practitioner Checklist

  • Are the criteria for this conformity assessment explicit, written, and agreed with the relevant assessor?
  • Is the assessment route correct (first-party / NB / certification body) for the regime and risk level?
  • Is evidence preserved with integrity (timestamp, hash, immutable storage, 10-year retention)?
  • Are nonconformities tracked and closed with verified effectiveness, not self-attestation?
  • Do you have a written post-market monitoring plan, with named owners and feedback channels?
  • Is there a substantial-modification process that triggers re-assessment when needed?
  • Are surveillance audits and recertification on the calendar with named accountable owners?

Disclaimer

This educational content is provided for general informational purposes only. It does not constitute legal, regulatory, or professional advice; it does not create a professional engagement; and it should not be relied on for any specific conformity assessment, certification, or compliance matter. AI conformity-assessment regimes vary by jurisdiction and change rapidly. Consult qualified regulatory affairs, quality, and legal professionals for advice on your specific situation.

Next Steps

The other lessons in Working with a Notified Body build directly on this one. Once you are comfortable with nonconformity handling, the natural next step is to combine it with the patterns in the surrounding lessons — that is where doctrinal mastery turns into a working conformity programme. AI conformity assessment is most useful as an integrated discipline covering classification, route selection, technical documentation, declaration, marking, registration, post-market monitoring, and substantial-modification handling.