`bridge.training.distill`#

Module Contents#

Functions#

Main function to run knowledge distillation (KD).

API#

bridge.training.distill.distill( config: megatron.bridge.training.config.ConfigContainer, ) → None#

Main function to run knowledge distillation (KD).

Parameters:: config – The main configuration container holding all necessary parameters.

.. warning::

This is an experimental API and is subject to change in backwards incompatible ways without notice.