In one line, what is pre‑training in LLMs, and how does it differ from post‑training (fine‑tuning)?
💡 Model Answer
Pre‑training is the initial, large‑scale, unsupervised learning phase where a language model learns general language representations by predicting masked tokens or next words across a massive corpus. Fine‑tuning (post‑training) is a subsequent supervised phase where the pre‑trained weights are adapted to a specific downstream task—such as sentiment analysis or question answering—using labeled data. The key difference is that pre‑training captures broad linguistic knowledge, while post‑training tailors that knowledge to a particular application. In practice, pre‑training is computationally expensive but reusable across many tasks; fine‑tuning is cheaper and task‑specific.
This answer was generated by AI for study purposes. Use it as a starting point — personalize it with your own experience.
🎤 Get questions like this answered in real-time
Assisting AI listens to your interview, captures questions live, and gives you instant AI-powered answers on a discreet on-screen overlay.
Get Assisting AI — Starts at ₹500