On March 15, Ilia State University will host an event as part of Tbilisi AI Meetups: “Implementation of Transformer Architecture in PyTorch”.

Speaker: Malkhaz Suladze

Agenda:

• Key innovations of the Transformer architecture compared to RNNs and LSTMs
• The role of self-attention, positional encoding, and residual connections
• How multi-head attention is interpreted through Anthropic’s 0-layer and 1-layer theory
• Hands-on implementation: writing multi-head self-attention and building the Transformer Encoder-Decoder from scratch using PyTorch

Working language: English

Register Here: https://lu.ma/wsk6ddc1

Date & Time: Saturday, March 15, 14:00

Location: Ilia State University, T Building, Auditorium N102, 3/5 K. Cholokashvili Ave.