AI Bootcamp - Transformers

Announcing the Second EAS AI Bootcamp: Transformers

After the successful completion of our first AI Bootcamp in October, we are happy to announce that the second AI bootcamp will take place from January 2 to January 5, 2024. This bootcamp will cover transformers, a set of concepts and tools that have influenced many different branches of AI, including NLP, Vision, and Reinforcement Learning. As before,  this course is designed  for Caltech graduate students and researchers and aims to accelerate their research productivity through the practical applications of transformers in AI.

Daily Structure: Each day includes one or two in-depth lectures, complemented by two to three interactive hands-on sessions. Following feedback from the last bootcamp, we will emphasize more on hands-on sessions.

Topics covered:

● The evolution of Transformers: Starting with a brief overview of Recurrent Neural

Networks (RNNs), we delve into the history and development of transformers.

● Core concepts: Explore the attention mechanism and the fundamental architecture of

transformers

● Transformers in Natural Language Processing (NLP): Study prominent

transformer-based NLP architectures such as BERT and GPT.

● Vision Transformers: Understand their design and diverse applications.

● Cross-Domain applications: Examine how transformers are revolutionizing various

fields beyond NLP and computer