DeepMind’s Epistemic Neural Networks Enable Large Language Model Fine-Tuning With 50% Less Data
In the new paper Fine-Tuning Language Models via Epistemic Neural Networks, a DeepMind research team modifies large language models to create an Epistemic Neural Network. The novel approach achieves model performance comparable to that obtained via fine-tuning while requiring 50 percent less data.