Tag: LoRA

17May

Data Augmentation for LLM Fine-Tuning: Synthetic and Human-in-the-Loop Approaches

Posted by JAMIUL ISLAM 0 Comments

Explore how synthetic data and human-in-the-loop strategies enhance LLM fine-tuning. Learn to balance scale and quality using LoRA and PEFT for domain-specific AI.

5Feb

How to Select Hyperparameters for Fine-Tuning LLMs Without Catastrophic Forgetting

Posted by JAMIUL ISLAM 10 Comments

Learn how to select hyperparameters for fine-tuning large language models without losing prior knowledge. Discover critical settings like learning rate and batch size, advanced techniques such as LoRA, and practical steps to avoid catastrophic forgetting in real-world AI applications.