openuniversity.edu.pl An open, community-maintained curriculum
UNIVERSITAS APERTA · SCIENTIA OMNIBUS PATET · MMXXVI ✦ ✦ Open University Universitas Aperta · Scientia Omnibus Patet

Programmes · 4 courses · ≈ 16 ECTS

Large Language Models

The shortest honest path from trained fundamentals to the research frontier of language models: build a GPT by hand, learn the ideas that led to it, then study the large models themselves.

  1. Build one from scratch

    Assumes the Foundations of Machine Learning programme or equivalent preparation.

    3 ECTS
    ML 220 Neural Networks: Zero to Hero Andrej Karpathy 3 ECTS

  2. The ideas underneath

    6 ECTS
    AI 301 NLP with Deep Learning (CS224n) Stanford University · Christopher Manning 6 ECTS

  3. Working with open models

    3 ECTS
    AI 201 The Hugging Face LLM Course Hugging Face · Hugging Face team 3 ECTS

  4. The frontier

    4 ECTS
    AI 310 Large Language Models (CS324) Stanford University · Percy Liang, Tatsunori Hashimoto, Christopher Ré 4 ECTS
On completion

On completing this programme you have implemented a transformer and a tokenizer from scratch, can fine-tune and deploy open models, and can read current LLM research — scaling laws, alignment, evaluation — as a participant rather than a spectator.