Distillation works extremely well for small models, as almost every small model is likely distilled from a larger model.
distillation works extremely well. So almost every small model, if you have a small model, it's almost certainly distilled.
distillation works extremely well. So almost every small model, if you have a small model, it's almost certainly distilled.