Programming For Ai Ai504 Fall 2024 Practice 2 Basic Machine Learning

Summary

Introduction to Numpy: - Scalars, vectors, matrices, tensors - Defining N-dimensional arrays - Indexing, slicing - Math operations ... BERT & GPT - Word embedding review - Contextualized word embedding (ELMo, GPT-1, BERT) - GPT- PyTorch & Neural Networks: - PyTorch intro (comparison with NumPy) - PyTorch autograd - PyTorch modules - MNIST ... GPT - Data preprocessing - Causal Language Model BERT - Data preprocessing - BERT training - BERT fine-tuning (sentiment ... Autoencoder: - Implementing & training an autoencoder - Visualizing the reconstructed outputs - Visualizing latent representations ... Transformers - Prepare input - Implement Transformer - Train and Evaluate - Visualize attention. Transformer - Self-attention - Multi-head attention - Transformer (encoder) - Positional encoding - Sequence-to-sequence with ...