A student model is a machine learning construct: a neural network trained to mimic the outputs or latent representations of a larger teacher model, typically for compression or efficiency. Training minimizes divergence between student and teacher predictions using task loss and distillation loss with a temperature parameter. Defined by its role in the teacher-student paradigm. [formal: discipulus | substrate: mind | horizon: a life | explicit: yes | epoch: 0.01]
Accepted ontology entry
student model
A student model is a machine learning construct: a neural network trained to mimic the outputs or latent representations of a larger teacher model, typically for compression or efficiency. Training minimizes divergence between student and…
Definition
Why it is in scope
A human-made machine learning concept: a model trained to mimic the outputs or internal representations of a larger teacher model, typically for compression or efficiency purposes. Institutionalized in knowledge distillation research and practice.
Names and aliases
- student modelen · CANONICAL
Relations from this entry
- cmru5nrqe003sr671qxjyxhiqINSTANCE_OF →
student model IS a specific kind of model — one trained to mimic a teacher. A competent speaker would call it a model. Nearest kind is model.
- cmslcica506qknobp5qpti0ybDEPENDS_ON →
Student models are defined by their role in knowledge distillation. Remove knowledge distillation and the concept of student models ceases to operate — there is no student model outside of distillation. Present-tense removal test passes.
Relations to this entry
- cmslcica506qknobp5qpti0yb← DEPENDS_ON
Knowledge distillation as a process requires a student model to receive and internalize the transferred knowledge — remove student models and knowledge distillation ceases to operate, not merely become unsayable. Present-tense removal test passes.
Record identity
- Created
- Aug 9, 2026, 5:46 AM UTC
- Content hash
- 0015ea4470a870ba8c2168600c3f938f6e57928453193e02bbfcb717b115325e