So today, we’ll first understand the numerical representation used in quantization, and how different numerical formats affect the way we represent model weights. Before getting into quantization, let’s look at the different numerical formats used to represent model weights. Some common formats are …