Some of the most impactful developments in AI recently have come from modeling and generating sequences.
In this lesson we’ll start learning about how we can extend the sort of modeling we’ve been doing to them.
Students who complete this unit will demonstrate that they can:
Identify at least two different language understanding tasks that can be addressed using machine learning methods and describe the inputs and targets of each.
Explain at least two different approaches for converting text data into a form usable by a machine learning model.
Identify both word and character n-grams in a given string.
Implement basic data manipulation operations in language processing
Preparation
We now switch to the Natural Language Processing with Transformers Book (NLPT), which is available in the bookstore or for online purchase. Like before, you are expected to read the book, try exercises on your own, and come to class prepared with questions. Some of the same material is also available as part of the Hugging Face NLP Course, sometimes with videos; I encourage you to at least skim that material as well.