DKL: Decoupled Knowledge Learning for Instruction-Tuned Language Models
This addresses a real deployment problem: incorporating proprietary knowledge without expensive instruction-tuning runs. The technique is sound but incremental, trading the synthetic data generation cost of RAFT for the cost of base model retraining. Worth evaluating if you're managing a suite of specialized models, but not a fundamental shift.