INT4 LoRA great-tuning vs QLoRA: A user inquired about the distinctions among INT4 LoRA good-tuning and QLoRA in terms of accuracy and speed. An additional member explained that QLoRA with HQQ requires frozen quantized weights, would not use tinnygemm, and makes use of dequantizing alongside torch.matmul Suitable placement sizing enables tra