Tag: LoRA
17May
Data Augmentation for LLM Fine-Tuning: Synthetic and Human-in-the-Loop Approaches
Explore how synthetic data and human-in-the-loop strategies enhance LLM fine-tuning. Learn to balance scale and quality using LoRA and PEFT for domain-specific AI.
5Feb
How to Select Hyperparameters for Fine-Tuning LLMs Without Catastrophic Forgetting
Learn how to select hyperparameters for fine-tuning large language models without losing prior knowledge. Discover critical settings like learning rate and batch size, advanced techniques such as LoRA, and practical steps to avoid catastrophic forgetting in real-world AI applications.