Black Box Modal Extraction

• Introduced a novel black-box technique for distilling pre-trained models, leveraging a class-conditioned synthetic data generator, and identifying a sparse sub-network that surpasses the teacher model’s performance.

Code | Report | Presentation