RAG, Fine-Tuning & ContextTim Dettmers et al.
QLoRA
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
QLoRA
Why it matters
Fine-tunes a 65B model on a single 48 GB GPU using 4-bit NF4, double quantization and paged optimizers
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/2305.14314Added in Week 35, 2026 · See that week
On the map — ② RAG, Fine-Tuning line
- Previous stopHugging Face ships PEFT v0.1.0, the library's first official release
- This record · stopQLoRA
- Next stopLost in the Middle