Tag: Red Hat
-
Red Hat Guardrail Benchmark: 200M Laptop Classifier Nearly Matches 35B LLM at 54ms Latency
Red Hat’s AI Safety team tested 9 guardrails in NeMo Guardrails: a 200M DeBERTa CPU model hit 89.01% prompt-injection accuracy in 54.1ms…
-
Red Hat Halves NVIDIA Nemotron 3.5 Lightning 30B Memory With FP8 for Single-GPU Agents
Red Hat AI released an FP8-quantized checkpoint of NVIDIA’s 30B Nemotron 3.5 Lightning Mamba-MoE model, cutting memory 50% to fit on a…