Chain-of-Thought
A technique where the model "thinks out loud" step by step before giving its final answer, instead of producing a result immediately. It noticeably improves accuracy on tasks that require logic or math.
See also
RLHF (Reinforcement Learning from Human Feedback)
A fine-tuning method where humans rate the quality of a model's responses, and the model is adjusted to more often produce answers that humans rate highly. It's a key step in making an AI model helpful and safe, not just technically functional.
Diffusion Model
A type of generative model that learns to create images (or other content) by gradually "cleaning up" random noise until a coherent picture emerges. It underlies most image generators, including Midjourney, Stable Diffusion, and DALL-E.
Foundation Model
A large model trained on a broad dataset that serves as the base for many narrower applications through fine-tuning or prompting — instead of training a separate model from scratch for every task.
Neural Network
A mathematical model loosely inspired by the connections between neurons in the brain: many layers of simple computational units that together learn to find complex patterns in data. It's the foundation of nearly all modern AI systems.
Model Weights
The numeric parameters inside a neural network that are adjusted during training and determine how the model processes input. "Open-weight" means these parameters can be downloaded so anyone can run the model themselves.
Few-shot / Zero-shot Learning
A model's ability to perform a new task after seeing just a few examples (few-shot) or with no examples at all, based purely on a text description of the task (zero-shot) — without any additional training on new data.