Predicting Multi-Codebook Vector Quantization Indexes for Knowledge Distillation
Paper
•
2211.00508
•
Published
This repository contains the codebook indexes generated by a fine-tuned HuBERT-XL model.
It can be used for multi-vector quantization knowledge distillation in ASR(https://arxiv.org/abs/2211.00508 for the paper). Please refer to https://github.com/k2-fsa/icefall/blob/master/egs/librispeech/ASR/distillation_with_hubert.sh for usage instructions.