Raschka S. - Build a Large Language Model [2025, PDF, ENG] torrent

Книги и журналы » Компьютерная литература » Программирование (книги)

Build a Large Language Model

Год издания: 2025
Автор: Raschka S.

Издательство: Manning
ISBN: 978-1633437166
Язык: Английский

Формат: PDF
Качество: Издательский макет или текст (eBook)
Интерактивное оглавление: Да
Количество страниц: 370

Описание: Learn how to create, train, and tweak large language models (LLMs) by building one from the ground up!

In Build a Large Language Model (from Scratch) bestselling author Sebastian Raschka guides you step by step through creating your own LLM. Each stage is explained with clear text, diagrams, and examples. You’ll go from the initial design and creation, to pretraining on a general corpus, and on to fine-tuning for specific tasks.
Build a Large Language Model (from Scratch) teaches you how to:
• Plan and code all the parts of an LLM
• Prepare a dataset suitable for LLM training
• Fine-tune LLMs for text classification and with your own data
• Use human feedback to ensure your LLM follows instructions
• Load pretrained weights into an LLM
[spoiler="Примеры страниц (скриншоты)"]

[/spoiler]
[spoiler="Оглавление"]
1. Understanding large language models 1
2. Working with text data 17
3. Coding attention mechanisms 50
4. Implementing a GPT model from scratch to generate text 92
5. Pretraining on unlabeled data 128
6. Fine-tuning for classification 169
7. Fine-tuning to follow instructions 204
A. Introduction to PyTorch 251
B. References and further reading 289
C. Exercise solutions 300
D. Adding bells and whistles to the training loop 313
E. Parameter-efficient fine-tuning with LoRA 322
[/spoiler]