BONUS FREE CRIME NOVEL! PROMOTIONS

Close Notification

Your cart does not contain any items

Quantization Methods for Large Language Models From Theory to Real-World Implementations

Anand Vemula

$40.95   $34.50

Paperback

Not in-store but you can order this
How long will it take?

QTY:

English
Anand Vemula
19 August 2024
The book provides an in-depth understanding of quantization techniques and their impact on model efficiency, performance, and deployment.

The book starts with a foundational overview of quantization, explaining its significance in reducing the computational and memory requirements of LLMs. It delves into various quantization methods, including uniform and non-uniform quantization, per-layer and per-channel quantization, and hybrid approaches. Each technique is examined for its applicability and trade-offs, helping readers select the best method for their specific needs.

The guide further explores advanced topics such as quantization for edge devices and multi-lingual models. It contrasts dynamic and static quantization strategies and discusses emerging trends in the field. Practical examples, use cases, and case studies are provided to illustrate how these techniques are applied in real-world scenarios, including the quantization of popular models like GPT and BERT.
By:  
Imprint:   Anand Vemula
Dimensions:   Height: 216mm,  Width: 140mm,  Spine: 5mm
Weight:   109g
ISBN:   9798227328335
Pages:   76
Publication Date:  
Audience:   General/trade ,  ELT Advanced
Format:   Paperback
Publisher's Status:   Active

See Also