Tag: LoRA
5Feb
How to Select Hyperparameters for Fine-Tuning LLMs Without Catastrophic Forgetting
Learn how to select hyperparameters for fine-tuning large language models without losing prior knowledge. Discover critical settings like learning rate and batch size, advanced techniques such as LoRA, and practical steps to avoid catastrophic forgetting in real-world AI applications.