· Xiaojing Yang · NLP and LLMs
Sequence-to-Sequence Models
The encoder-decoder idea behind machine translation, summarization, and many generation tasks.
Tag: Multilingual AI
- · Xiaojing Yang · NLP and LLMs
Tokenization and Subwords
Tokenization is the first modeling decision in NLP: it decides what units a model can see, how rare terms are represented, and how multilingual systems handle domain language.
- · Xiaojing Yang · NLP and LLMs
Transformers for NLP
How Transformers combine self-attention, feed-forward layers, residuals, and positional information.
- · Xiaojing Yang · NLP and LLMs
Word Embeddings and Sentence Embeddings
How discrete language becomes vector space, and why sentence embeddings matter for retrieval and evaluation.