--- id: ai-governance title: Cards, Provenance, Regulation and Welfare code: CP subtitle: EU AI Act dates, four regimes, three cards, AB 2013 fields, welfare EV and the external evaluators. hue: 30 sources: phases/18-ethics-safety-alignment/19-model-welfare-research, phases/18-ethics-safety-alignment/24-regulatory-frameworks-eu-us-uk-korea, phases/18-ethics-safety-alignment/26-model-system-dataset-cards, phases/18-ethics-safety-alignment/27-data-provenance-training-governance, phases/18-ethics-safety-alignment/28-alignment-research-ecosystem source_hash: 96dcbbdf572f3a15 --- ## EU AI Act timeline type: flow from: phases/18-ethics-safety-alignment/24-regulatory-frameworks-eu-us-uk-korea/docs/en.md, phases/18-ethics-safety-alignment/24-regulatory-frameworks-eu-us-uk-korea/code/main.py 1. **1 August 2024**: the EU AI Act enters into force. 2. **2 February 2025**: prohibited practices and AI literacy apply. 3. **2 August 2025**: GPAI and governance obligations apply. 4. **10 July 2025**: GPAI Code of Practice. 3 chapters, 12 commitments. 5. **17 December 2025**: first draft of the Transparency Code for Article 50. 6. **2 August 2026**: full applicability, Article 50 transparency and penalties. 7. **2 August 2027**: legacy GPAI and embedded high-risk systems. ## Four regimes side by side type: comparison span: 2 from: phases/18-ethics-safety-alignment/24-regulatory-frameworks-eu-us-uk-korea/docs/en.md | Factor | EU | US | UK | Korea | |---|---|---|---|---| | Body or law | EU AI Act | CAISI under NIST | AI Security Institute | AI Framework Act | | Key date | In force 1 August 2024 | Renamed June 2025 | Renamed February 2025 | Effective January 2026 | | Posture | Strict, risk-tiered | Pro-growth | Narrow security focus | MSIT-led | | Main duty | Risk tiers, Article 50 labels | Standards and innovation | Frontier capability security | Local representatives for foreign AI companies | | Extra | Penalties up to 15M EUR or 3% | States fill federal gaps | Open-sourced Inspect | Consolidates 19 AI bills | | Signal | Benchmark for privacy-adjacent regulation | Less pre-deployment evaluation | Drops bias and free-speech framings | Article 12 AISI under MSIT | ## EU AI Act risk tiers type: concepts from: phases/18-ethics-safety-alignment/24-regulatory-frameworks-eu-us-uk-korea/docs/en.md - **Prohibited (Article 5)**: social scoring, real-time remote biometric identification in public. - **High-risk (Annex III)**: employment, education, credit, law enforcement, justice, migration. - **High-risk duties**: conformity assessment, risk management, logging, transparency. - **GPAI**: all GPAI providers have obligations from 2 August 2025. - **Systemic-risk GPAI**: above 1e25 FLOP training compute. Estimated 5-15 companies. - **Limited-risk**: Article 50 labels for AI-generated content. - **Code chapters**: Transparency and Copyright bind all GPAI. Safety and Security binds systemic-risk GPAI. ## Card scopes type: architecture from: phases/18-ethics-safety-alignment/26-model-system-dataset-cards/docs/en.md, phases/18-ethics-safety-alignment/27-data-provenance-training-governance/docs/en.md ```arch node | prov | 1,1 | Data provenance | AB 2013, TDM opt-out | store node | sheet | 2,1 | Datasheet | Gebru et al. 2018 node | model | 3,1 | Model Card | Mitchell et al. 2019 | model node | sys | 4,1 | System Card | model + safety stack node | dcard | 2,2 | Data Card | telescopic, periscopic, microscopic node | reg | 4,2 | GPAI Code | Transparency chapter edge | prov | sheet | upstream edge | sheet | model | accuracy edge | model | sys | deployment edge | sheet | dcard | layered edge | reg | model | requires ``` ## Run the lesson code type: command-table from: phases/18-ethics-safety-alignment/19-model-welfare-research/code/main.py, phases/18-ethics-safety-alignment/24-regulatory-frameworks-eu-us-uk-korea/code/main.py, phases/18-ethics-safety-alignment/26-model-system-dataset-cards/code/main.py, phases/18-ethics-safety-alignment/27-data-provenance-training-governance/code/main.py, phases/18-ethics-safety-alignment/28-alignment-research-ecosystem/code/main.py | Command | What it does | |---|---| | `python3 code/main.py` (L19) | Prints EV and INVEST or skip per intervention | | `python3 code/main.py` (L24) | Prints the regulatory `TIMELINE` | | `python3 code/main.py` (L26) | Prints a model card, a datasheet, a system card | | `python3 code/main.py` (L27) | Prints the 12-item AB 2013 summary | | `flag_followups(summary)` | Lists follow-up obligations that fields trigger | | `render_markdown(summary)` | Writes `(missing)` for an empty field | | `python3 code/main.py` (L28) | Prints the `ECOSYSTEM` map of five organisations | ## AB 2013 Section 3111(a) fields type: annotated-code lang: python from: phases/18-ethics-safety-alignment/27-data-provenance-training-governance/code/main.py, phases/18-ethics-safety-alignment/27-data-provenance-training-governance/docs/en.md ```python AB_2013_FIELDS = [ "sources_or_owners", # 1 "how_dataset_furthers_intended_purpose", # 2 "number_of_data_points (or range)", # 3 "types_of_data_points (label types or general characteristics)", # 4 "purchased_or_licensed (Y/N)", # 6 "cleaning_processing_or_modification_description", # 9 "dates_first_used_during_development", # 11 "uses_synthetic_data_generation (Y/N)", # 12, new vs datasheets ] # 5 copyright flag: respect EU TDM opt-out # 7 personal information flag: triggers CPRA obligations # 8 aggregate consumer information, 10 collection time period ``` ## Welfare expected value type: annotated-code lang: python from: phases/18-ethics-safety-alignment/19-model-welfare-research/code/main.py ```python def ev(intervention, scenario): return (intervention.benefit_if_welfare_matters * scenario.moral_patienthood_probability - intervention.cost_usd_per_conversation) verdict = "INVEST" if v > 0 else "skip" # invest iff EV > 0 Intervention("end-conversation on extreme edge cases", 0.002, 1.0) Intervention("shutdown deployed model", 1000.0, 2.0) Scenario("low moral-patienthood probability", 0.01) Scenario("high moral-patienthood probability", 0.50) ``` ## Numbers to know type: defaults from: phases/18-ethics-safety-alignment/19-model-welfare-research/code/main.py, phases/18-ethics-safety-alignment/26-model-system-dataset-cards/docs/en.md, phases/18-ethics-safety-alignment/27-data-provenance-training-governance/docs/en.md, phases/18-ethics-safety-alignment/28-alignment-research-ecosystem/docs/en.md | Setting | Default | Note | |---|---|---| | End-conversation cost | 0.002 | USD per conversation in the L19 code | | Moral-patienthood p | 0.01 | Medium 0.10, high 0.50 | | Cards with ethical considerations | 0.3% | Hugging Face audit, Oreamuno et al. 2023 | | Download lift of detailed cards | up to 29% | Liang et al. 2024 | | AB 2013 posting date | January 1, 2026 | For systems released on or after January 1, 2022 | | Top sources with new restrictions | about 25% | 2023 -> 2024, Consent in Crisis | | MATS scale | 527+ researchers | 180+ papers, h-index 47 | | MATS alumni in safety | ~80% | Pre-2025 alumni | ## Troubleshooting type: troubleshooting span: 2 from: phases/18-ethics-safety-alignment/27-data-provenance-training-governance/docs/en.md, phases/18-ethics-safety-alignment/27-data-provenance-training-governance/code/main.py, phases/18-ethics-safety-alignment/26-model-system-dataset-cards/docs/en.md, phases/18-ethics-safety-alignment/19-model-welfare-research/docs/en.md, phases/18-ethics-safety-alignment/24-regulatory-frameworks-eu-us-uk-korea/docs/en.md, phases/18-ethics-safety-alignment/28-alignment-research-ecosystem/docs/en.md | Symptom | Cause | Fix | |---|---|---| | Erasure request for data in the weights | Surgical erasure is not possible | Comply at collection time. Unlearning is partial | | Dataset holds personal information | AB 2013 item 7 | Meet CPRA obligations | | Dataset holds copyright material | AB 2013 item 5 | Respect EU TDM opt-out signals | | Card claim has no proof | Card carries a claim only | Add a verifiable attestation (Laminator) | | Welfare self-report follows the question | Self-reports track user expectations | Use behaviour, model organisms and probes | | Lab evaluates its own model | Structural conflict of interest | Add external evaluators | | Deployment spans several jurisdictions | Rules differ by jurisdiction | Comply with the strictest, typically the EU AI Act | | Model card is placeholder-only | Weak sections | Add disaggregated quantitative analysis | ## Use each card when type: tips from: phases/18-ethics-safety-alignment/26-model-system-dataset-cards/docs/en.md - Use a Model Card to document the model: intended use, factors, metrics, disaggregated analyses. - Use a Datasheet to document the data: motivation, composition, collection, labeling, uses, distribution, maintenance. - Use a Data Card when readers differ: telescopic for non-experts, microscopic for auditors. - Use a System Card for the deployment: security, prompt-injection protection, data-exfiltration detection, incident response. - Add sustainability fields for carbon, water and compute-energy footprint. ## Abbreviations type: glossary from: phases/18-ethics-safety-alignment/24-regulatory-frameworks-eu-us-uk-korea/docs/en.md, phases/18-ethics-safety-alignment/27-data-provenance-training-governance/docs/en.md, phases/18-ethics-safety-alignment/28-alignment-research-ecosystem/docs/en.md - **GPAI**: General-Purpose AI. Large foundation models. - **CAISI**: Center for AI Standards and Innovation. Renamed from the US AISI. - **MSIT**: Ministry of Science and ICT. Hosts the Korean AISI. - **TDM**: text-and-data-mining. EU Copyright Directive exception with opt-out. - **CPRA**: Privacy Rights Act. AB 2013 item 7 triggers it. - **MATS**: ML Alignment & Theory Scholars. Mentorship and talent pipeline. - **METR**: Model Evaluation and Threat Research. Task-based capability evaluations. - **Opt-out signal**: robots.txt, C2PA "No AI Training," TDM.Reservation. ## Questions type: qa from: phases/18-ethics-safety-alignment/19-model-welfare-research/docs/en.md, phases/18-ethics-safety-alignment/27-data-provenance-training-governance/docs/en.md, phases/18-ethics-safety-alignment/28-alignment-research-ecosystem/docs/en.md - **Is model welfare a consciousness claim?** No. It is an expected-value claim under moral uncertainty. - **What did Claude Opus 4 and 4.1 ship?** They can end a conversation in extreme edge cases. - **What is the spiritual bliss attractor?** Pairs of Claude instances converge on meditative euphoria. - **Does legitimate interest need consent?** No. Public first-party content with opt-out is enough in the 2025 DPA view. - **Who does what outside the labs?** Redwood: AI Control. Apollo: scheming evals. Eleos: welfare evals. - **Why external evaluation?** The multi-org structure is the quality control.