INT4 LoRA wonderful-tuning vs QLoRA: A user inquired about the variances amongst INT4 LoRA high-quality-tuning and QLoRA in terms of precision and speed. Another member explained that QLoRA with HQQ includes frozen quantized weights, won't use tinnygemm, and utilizes dequantizing alongside torch.matmul[Aspect Request]: Offline Mode · Issue #11518