Google DeepMind introduces SkillSmith for dynamic model adaptation

Google DeepMind just built something that could reshape how AI models pick up new tricks. SkillSmith, detailed in a paper submitted to arXiv on July 29, 2026, generates new model capabilities at inference time by blending stored text knowledge with parametric weight information. No retraining necessary. The system uses prefix-tuning to treat stored model weights as a native modality alongside traditional text input. SkillSmith bridges the gap between text-based knowledge composition and parametric skill libraries, which have traditionally been processed separately. It synthesizes rich textual metadata and prefix weights together, then generates new prefix weights tailored for specific skills through what the researchers call an “instruction-steered paradigm.” Lead author Lucio M. Dery and six co-authors, all affiliated with Google, demonstrated that SkillSmith significantly outperforms both text-only and weight-space-only baseline models in instruction-steered tasks. Prefix-tuning itself isn’t new. It’s been a known technique for adapting models without full fine-tuning. What SkillSmith adds is the ability to treat those prefix weights as composable building blocks that can be mixe...