Annex 11
Technical Documentation Referred to in Article 53(1), Point (a) – Technical Documentation for Providers of General-Purpose AI Models
ANNEX XI
Technical documentation referred to in Article 53(1), point (a) — technical documentation for providers of general-purpose AI models
Section 1
Information to be provided by all providers of general-purpose AI models
The technical documentation referred to in Article 53(1), point (a) shall contain at least the following information as appropriate to the size and risk profile of the model:
|
1.
|
A general description of the general-purpose AI model including:
|
(a)
|
the tasks that the model is intended to perform and the type and nature of AI systems in which it can be integrated;
|
|
(b)
|
the acceptable use policies applicable;
|
|
(c)
|
the date of release and methods of distribution;
|
|
(d)
|
the architecture and number of parameters;
|
|
(e)
|
the modality (e.g. text, image) and format of inputs and outputs;
|
|
|
2.
|
A detailed description of the elements of the model referred to in point 1, and relevant information of the process for the development, including the following elements:
|
(a)
|
the technical means (e.g. instructions of use, infrastructure, tools) required for the general-purpose AI model to be integrated in AI systems;
|
|
(b)
|
the design specifications of the model and training process, including training methodologies and techniques, the key design choices including the rationale and assumptions made; what the model is designed to optimise for and the relevance of the different parameters, as applicable;
|
|
(c)
|
information on the data used for training, testing and validation, where applicable, including the type and provenance of data and curation methodologies (e.g. cleaning, filtering, etc.), the number of data points, their scope and main characteristics; how the data was obtained and selected as well as all other measures to detect the unsuitability of data sources and methods to detect identifiable biases, where applicable;
|
|
(d)
|
the computational resources used to train the model (e.g. number of floating point operations), training time, and other relevant details related to the training;
|
|
(e)
|
known or estimated energy consumption of the model.
|
With regard to point (e), where the energy consumption of the model is unknown, the energy consumption may be based on information about computational resources used.
|
Section 2
Additional information to be provided by providers of general-purpose AI models with systemic risk
| |
1.
|
A detailed description of the evaluation strategies, including evaluation results, on the basis of available public evaluation protocols and tools or otherwise of other evaluation methodologies. Evaluation strategies shall include evaluation criteria, metrics and the methodology on the identification of limitations. |
| |
2.
|
Where applicable, a detailed description of the measures put in place for the purpose of conducting internal and/or external adversarial testing (e.g. red teaming), model adaptations, including alignment and fine-tuning. |
| |
3.
|
Where applicable, a detailed description of the system architecture explaining how software components build or feed into each other and integrate into the overall processing. |
Corresponding Recitals
-
101
/eu-uk-ai-navigator/recital/no-101Recital 101
|
(101)
|
Providers of general-purpose AI models have a particular role and
responsibility along the AI value chain, as the models they provide may form the basis for
a range of downstream systems, often provided by downstream providers that necessitate
a good understanding of the models and their capabilities, both to enable the integration
of such models into their products, and to fulfil their obligations under this or other
regulations. Therefore, proportionate transparency measures should be laid down, including the
drawing up and keeping up to date of documentation, and the provision of information on the
general-purpose AI model for its usage by the downstream providers. Technical documentation
should be prepared and kept up to date by the general-purpose AI model provider for the purpose
of making it available, upon request, to the AI Office and the national competent authorities.
The minimal set of elements to be included in such documentation should be set out in specific
annexes to this Regulation. The Commission should be empowered to amend those annexes by means
of delegated acts in light of evolving technological developments.
|
View Recital