Warning: This content has not yet been fully revised for this year.
This lab is designed to help you make progress towards the following course objectives:
- [MS-LLM-Tokenization]
- [MS-LLM-TokenizationImpact]
Work through the following notebook. (No accelerator is needed. Either Kaggle or Colab is fine; if you use Colab, remember to “Copy to Drive”.)
- Tokenization
(name:
u08n1-tokenization.ipynb; show preview, open in Colab)
If you finish, you may get started on next week’s notebook:
Logits in Causal Language Models
(name: u09n1-lm-logits.ipynb; show preview,
open in Colab)