Skip to main content
The AI Guys

Other industries · Employment · Large organisation

A worked example: the organisation is invented; the rules, rulings and supervisors' statements are real and linked.

The ranking your recruiters asked a chat assistant for is on the high risk list

Situation
The chief technology officer of a large employer
Written by
Portrait of Tijn van der ZantTijn van der Zant
Last checked

The recruitment team of a large employer has a backlog of applications for warehouse and planning jobs. A recruiter pastes a batch of letters and career summaries into the company's general purpose assistant and asks for a ranking. In the distribution centres the planning software has a new module that hands out shifts on the basis of each worker's past picking speed. Nobody in the company decided to deploy a high risk system. From 2 December 2027 the law will see two.

Annex III of the European Union Artificial Intelligence Act, Regulation (European Union) 2024/1689, lists employment as one of eight areas. Point 4 covers systems intended to be used for recruitment or selection, including the filtering of applications and the evaluation of candidates. It also covers systems used for decisions on promotion and termination, for allocating tasks on the basis of individual behaviour or personal traits, and for monitoring and evaluating performance and behaviour. The requirements attached to the list apply from 2 December 2027. Article 6 has an exception for systems that only perform a narrow procedural or preparatory task, and closes it again for any system that profiles natural persons. Ranking candidates by expected performance fits the definition of profiling in the General Data Protection Regulation, which names the prediction of performance at work.

One rule is in force already. Since 2 February 2025 the Act prohibits systems that infer the emotions of a person in the workplace, except for medical or safety reasons. It sets the maximum fine for breaching a prohibition at 35 million euros or 7 percent of worldwide annual turnover, whichever is higher. A video interview product that scores enthusiasm has to be checked against that rule now.

When the high risk rules apply, an employer that uses such a system is a deployer and Article 26 gives the deployer duties of its own. It has to use the system according to the supplier's instructions, assign human oversight to people with the competence and the authority for it, keep the logs for at least six months, and tell candidates and workers that the system is being used in decisions about them. Paragraph 7 is specific to employers: before the system is put into service at the workplace, the workers' representatives and the affected workers must be informed.

Dutch law already asks for more than information. Under Article 27 of the Wet op de ondernemingsraden an employer needs the consent of the works council for a decision to adopt, change or withdraw an arrangement on appointment, dismissal or promotion policy, on staff appraisal, on the processing of personal data of staff, or on facilities that are suited to observing their attendance, behaviour or performance. A shift module that reads picking speed is hard to place outside that last category. The General Data Protection Regulation adds Article 22, the right not to be subject to a decision based solely on automated processing that significantly affects a person. In December 2023 the Court of Justice of the European Union held that a score produced by one company counts as such a decision when the company that receives it gives it a determining role.

The usual response is to ask the supplier for a compliance statement and file it. That statement covers the supplier's duties as provider and leaves yours untouched. It is also silent on the recruiter with the general assistant, and that is the awkward case. Article 25 says that whoever changes the intended purpose of a system that was not high risk, a general purpose system included, in such a way that it becomes high risk, is to be considered its provider. As we read it, an employer that lets a general assistant rank applicants risks taking on the heavier role, the one with the quality management system and the conformity assessment, without having bought anything.

The route decision matters here because applicant and personnel data are the input. Decide for each type of work whether it may go to a model provider's online interface under contract, to a private deployment, or only to systems on your own premises. Screening through a contracted interface in a European region can be defended. Pasting applications into a consumer chat tool is a different matter, since no contract of yours governs it. Keeping everything in your own data centre settles where the data goes. The works council, the logs, the oversight and the notices to candidates stay where they were.

The governance is the same on each route. It covers an inventory of every system that touches hiring or the allocation of work, your role for each one, the supplier contracts, a test on your own past applications that looks at who gets filtered out, logs, named overseers, training, and a route for complaints and incidents.

The AI Guys does this groundwork with technology and personnel teams, while the legal opinion on consent stays with your employment lawyer. Next month you should have in hand the inventory with the general assistant on it, a written decision on which hiring tasks staff may give to which tool, the agenda item for the works council, and a letter to each supplier asking which role it takes and which it assigns to you.

What we would build here

We would build the screening of applications as a custom AI solution on an online service under contract, processed in a European region. It holds up because named people with authority to overrule it oversee it, its logs are kept, candidates are told it is used, and it is tested on past applications to see who is filtered out.

The solutions we build

What this situation risks

The most the law allows here

€15 million or 3%

Source and caveat

Breaking the other duties the Act lists, such as the transparency duties: up to €15 million or 3% of worldwide annual turnover, whichever is higher.

European Union Artificial Intelligence Act (Regulation (EU) 2024/1689, as amended by Regulation (EU) 2026/1744), Article 99(4). Applies from 2 August 2026.

This is the most the law allows, not what is usually imposed. A fine can only follow a duty that applies: the transparency duties from 2 August 2026, the high-risk duties from 2 December 2027 and 2 August 2028.

Source: EU AI Act, Article 99(4), consolidated version of 27 July 2026, EUR-Lex, accessed 5 October 2026.

All fines

Sources

Show the sources
  1. Annex III, point 4 (recruitment, selection, targeted job advertisements, filtering applications, evaluating candidates; promotion, termination, task allocation based on individual behaviour or personal traits, monitoring and evaluating performance and behaviour); eight areas
  2. Article 6(3) (exceptions for a narrow procedural task or a preparatory task; a system that performs profiling of natural persons is always high-risk)
  3. Definition of profiling (General Data Protection Regulation Article 4(4): "to analyse or predict aspects concerning work performance")
  4. General Data Protection Regulation, Article 4
  5. Article 5(1)(f) (prohibition on inferring emotions in the workplace and in education institutions, except for medical or safety reasons), applying from 2 February 2025
  6. Article 99(3) (35 million euros or 7 percent, whichever is higher)
  7. Article 26 (instructions for use; human oversight; input data; logs at least six months; paragraph 7 on informing workers' representatives and affected workers; paragraph 11 on informing natural persons)
  8. Article 25(1)(c) (changing the intended purpose of a system, including a general-purpose system, so that it becomes high-risk makes one the provider)
  9. Provider duties (quality management system, conformity assessment)
  10. Wet op de ondernemingsraden, Article 27(1), points e, g, k and l
  11. General Data Protection Regulation, Article 22
  12. Court of Justice, judgment of 7 December 2023 in Case C-634/21 (SCHUFA Holding, scoring), press release 186/23

All examples