AI4Research open seminar

  • Date: –14:00
  • Location: Zoom:
  • Lecturer: Andreas Hellander Senior lecturer at Department of Information Technology, Uppsala University Robin Kurtz Data Scientist at The National Library of Sweden
  • Website
  • Organiser: AI4Research
  • Contact person: Cecilia Alsmark
  • Phone: 0737078418
  • Seminarium

AI4Research open seminar: Federated Learning for Language Models

Federated Learning (FL) is a relatively new machine learning method that enables models to be built on private data sets, without pooling the data at a centralized node. In this we will provide an introductory overview of federated learning, as well as share learnings from a recent project where the The National Library of Sweden (Kungliga Biblioteket, KB) and Scaleout explored the possibilities and pitfalls of training a federated ELECTRA language model on two separate data sets of Swedish and Norwegian. KB maintains large amounts of data that is legally difficult to share. Using the decentralized approach of FL allows KB to cooperate with other national libraries and research intuitions to train models without having to share the data.