General Knowledge of Natural Language¶

Preliminary knowledge for understanding language models and modern NLP systems, from sequence modeling fundamentals to Transformer-based architectures.

Contents¶

• Language Model Fundamentals - Notes covering encoder/decoder concepts, RNNs, LSTMs, sequence-to-sequence models, attention, perplexity, Transformers, BERT, GPT, and decoder-only LLM architecture.

Imported Artifacts¶

• Source markdown: language_model.md
• Source figures: 13 diagrams imported from the original images/ artifact folder and displayed inside the notes page.

Build the natural-language and language-model basics needed before diving into advanced LLM topics.