Some of the most impactful developments in AI recently have come from modeling and generating sequences.
In this lesson we’ll start learning about how we can extend the sort of modeling we’ve been doing to them.
Students who complete this unit will demonstrate that they can:
Identify at least two different language understanding tasks that can be addressed using machine learning methods.
Describe causal language modeling as a prediction problem
Explain at least two different approaches for converting text data into a form usable by a machine learning model.
Identify both word and character n-grams in a given string.
Implement basic data manipulation operations in language processing
Preparation
Since NLP has advanced so much in the past few years, we’re going to use the Hugging Face NLP Course instead of the material in our textbook.