Tag: FP8 Quantization
-
Red Hat Halves NVIDIA Nemotron 3.5 Lightning 30B Memory With FP8 for Single-GPU Agents
Red Hat AI released an FP8-quantized checkpoint of NVIDIA’s 30B Nemotron 3.5 Lightning Mamba-MoE model, cutting memory 50% to fit on a…