Just put together a gist for merging QLoRA with the quantized model weights as mentioned by @Tim_Dettmers https://t.co/O0QEMrxwn5 @Teknium1 @erhartford Since I know you guys were looking into it. Should be able to quantize the whole thing after this without issue https://t.co/MXVGIfsWz3 View Tweet
