top of page

Advanced NLP
Dive into RNNs, GPU efficient code, & more.

About

Before starting the course, let’s go over the content and what you need before jumping in.

​

This course covers more advanced topics in NLP, such as subword tokenization (what ChatGPT uses), optimizing models for GPU performance, and RNNs (recurrent neural networks).

652ebec8fbd9a45bcec81892_Which_Language_Is_Useful_for_NLP_and_Why_62f7833585_edited.png
GPT-4-released.jpg
2020-02-21_difference-between-cnn-rnn-1_edited_edited.png

Is this course for you?

Before jumping into this course, I would recommend understanding most of Generative LLMs. If you’re iffy on a couple topics, don’t worry since we’ll do a quick review first.

 

If you have an understanding of how ChatGPT works and want to dive deeper into NLP, this course is for you.

PyTorch-removebg-preview (1).png
GPU-for-machine-learning-1_edited.jpg
657792545057c88e9e549d39_230411_RLHF-LLM_Blog_edited_edited.png

Topics

  1. Advanced Tokenization Techniques (e.g. Byte Pair Encoding)

  2. Types of Attention (more than just Self Attention)

  3. Sampling Algorithms (Beam Search, Top-K, etc.)

  4. Optimizing code for GPU performance (e.g. vectorization)

  5. Optimizers (e.g. Adam)

  6. RNNs (Recurrent Neural Networks)

  7. LSTMs and GRUs (better RNNs)

  8. Transformer Modifications (e.g. Mixture of Experts)

  9. RLHF (Reinforcement Learning from Human Feedback)

​

Modules coming soon.

bottom of page