QLoRA微调实战:1.5B参数Whisper-large-v2在24GB显存实现中文语音识别,CER骤降50%!
模型准备:QLoRA 微调核心技术解析
1. 模型加载与量化配置
from transformers import WhisperForConditionalSpeechRecognition
from peft import prepare_model_for_kbit_training
import bitsandbytes as bnb
bnb_config = bnb.BitsAndBytesConfig(