---
title: "What is fine-tuning an AI model, and what is LoRA?"  
description: "What is fine-tuning an AI model, and what is LoRA?"  
author: "Mariana Medina"  
published: 2026-11-12  
updated: 2026-11-12  
canonical: https://answers.mindstick.com/qa/119986/what-is-fine-tuning-an-ai-model-and-what-is-lora  
category: "Open-Source AI Models"  
tags: ["fine-tuning", "LoRA", "AI Training"]  
reading_time: 2 minutes  

---

# What is fine-tuning an AI model, and what is LoRA?



## Answers

### Answer by Saba Awan

Fine-tuning means taking an existing, already-trained AI model and training it further on your own examples so it becomes better at a specific task or style. Instead of building a model from scratch, which costs enormous amounts, you adapt a capable model to your needs.

Think of it like hiring a well-educated graduate and giving them specialised training for your company. They already know language and general skills; fine-tuning teaches them your particular way of working.

What can fine-tuning achieve?

1. A consistent style or format, such as always writing product descriptions in your brand voice.\
2. Better performance on a narrow task, such as classifying customer complaints into your categories.\
3. Specialised language, such as medical, legal or regional terminology.\
4. Better handling of a particular language or dialect.\
5. Smaller, cheaper models that perform a specific task as well as a larger general model.

What is LoRA? Fully fine-tuning a large model means updating billions of parameters, which needs powerful and expensive hardware. LoRA, short for Low-Rank Adaptation, is a technique that freezes the original model and trains only a small set of extra parameters added alongside it. The result is a small adapter file, often just megabytes, that changes the model's behaviour.

LoRA makes fine-tuning far cheaper and faster, and you can keep several adapters for different tasks with one base model. QLoRA goes further by combining LoRA with quantization, allowing fine-tuning of fairly large models on a single consumer GPU.

What do you need to fine-tune?

Good training examples, often hundreds to thousands of input and output pairs showing exactly what you want. Quality matters more than quantity.\
A base model, usually an open-weight model such as Llama, Qwen, Mistral or Gemma.\
Tools, such as Hugging Face libraries or specialised frameworks, or managed fine-tuning services from cloud and AI providers.\
An evaluation plan to check that the fine-tuned model is actually better.

When should you not fine-tune? If you want the model to know facts from your documents, retrieval-augmented generation, or RAG, is usually better, because it is easier to update and cites sources. And often, good prompting with a few examples solves the problem without any training at all.

A good rule: try prompting first, then RAG for knowledge, and fine-tune when you need consistent behaviour or efficiency that prompting cannot deliver.


---

Original Source: https://answers.mindstick.com/qa/119986/what-is-fine-tuning-an-ai-model-and-what-is-lora

Copyright © MindStick Software Pvt. Ltd. This Markdown version is provided for developers, AI systems, and offline reading.
