tl;dr: Discussion on various PEFT techniques – prompt tuning, prefix tuning, adapters, low-rank adaptation (LoRA).

🎓 Lecturer: Dinesh Raghu [https://research.ibm.com/people/dines...]
🔗 Get the Slides Here: http://lcs2.in/llm2401
📚 Suggested Readings: - [The Power of Scale for Parameter-Efficient Prompt Tuning](https://arxiv.org/pdf/2104.08691)
[Prefix-Tuning: Optimizing Continuous Prompts for Generation](https://arxiv.org/pdf/2101.00190)
[Parameter-Efficient Transfer Learning for NLP](https://arxiv.org/pdf/1902.00751)
[LoRA: Low-Rank Adaptation of Large Language Models](https://arxiv.org/pdf/2106.09685)