Distillation
Definition: Distillation trains a small model ('student') to imitate a large one ('teacher'), yielding a lighter, faster model close to the original.
It's a way to make AI more accessible and cheaper to run.
Definition: Distillation trains a small model ('student') to imitate a large one ('teacher'), yielding a lighter, faster model close to the original.
It's a way to make AI more accessible and cheaper to run.