Self-alignment: how much safety to teach a language model without making it useless
A 3-billion-parameter Llama 3.2, LoRA fine-tuning and one question: what dose of safety data is needed for it to refuse what is harmful without refusing everything. The line tries fixed …