AI Bootcamp VIIII - Transformers

Objective: To equip participants with the tools and knowledge to understand, implement, and utilize transformer based models in their research or explore these concepts further through advanced courses or self-study.

• Introduction to Transformers and Attention Mechanisms
• Transformer Architectures (Encoder-Decoder, GPT)
• Vision Transformers
• Fine-tuning Transformers
• Applications of Transformers

Registration URL:  https://caltech.instructure.com/enroll/NTHPFE

Registration Deadline:  Jan 30th

Please take the pre-screening Quiz before 11:59 PM Pacific Time on Thursday Jan 30th

Note: This bootcamp is open to Graduate Students, Post Docs, and Faculty.

Topics Covered:

Prerequisites:

• Python Programming
• Machine Learning Basics and experience with ML frameworks such as PyTorch or TensorFlow
• Linear Algebra
• Multivariable Calculus
• Probability Theory