Building a GPT-2 level LLM from scratch - AI Tinkerers Dubai - Jan 2025

Speaker: Antons Tesluks, AI Engineer, ACX

In this talk, Antons Tesluks from AirCarbon Pte. Ltd. will guide the audience through building a GPT-2-level language model from scratch, highlighting key insights into model training and the implications of different datasets.