Article
Democratising Machine Learning through Hugging Face
12/9/2022
min read
AI
âThis contribution plays a part in democratising AI. We have made Document AI more freely and widely available to other developers in organisations all around the world.â
Hi Christoffer! You work as a data scientist in machine learning (ML) at Visma â how is that and what do you do?
First of all, it is a lot of fun. We get to come up with creative solutions using deep learning to solve challenging problems in Document AI. We read research papers and turn the knowledge from them into our two machine learning products: SmartScan and AutoSuggest.
In a few words, what is Hugging Face exactly?
Hugging Face is a company known for their enormous efforts to democratise AI through their transformer implementations and the accompanying model hub, which is like an app store for machine learning models. The entire thing is open-source, so everyone is able to contribute â it really is a community effort. Researchers and practitioners use it in their everyday work to create (more or less) all of the amazing AI applications that you see everywhere.
âHugging Face is like an app store for machine learning models.â
Iâm curious to know what you use the community for?
The Visma Machine Learning Assets team works in the field of Document AI, specifically with SmartScan. The team started using Hugging Face in 2020, when we wanted to explore the Transformer model, which is a natural language processing model that Hugging Face specialises in. They have a repertoire of almost 70,000 thousand machine learning models for different use cases and languages.
So, weâre using their image models and natural language models as a starting point to fine-tune our data. This means that we can quickly iterate and experiment with what works and doesnât work for us. Needless to say, Hugging Face Transformers is a huge asset to our team.
Whatâs more, weâve also found that the community around Hugging Face is great for discovering relevant research papers and new algorithms.
So, you recently contributed a TensorFlow model at Hugging Face Transformers. Can you tell us about that?
The specific thing that the team and I contributed is an AI model, called LayoutLMv3. Itâs a huge state-of-the-art model from Microsoft in the field of Document AI. It combines some of the best from computer vision and natural language processing in one model that is able to understand documents beyond just text. On top of that, the LayoutLMv3 model is super accurate, amazingly fast, and also relatively simple at the same time.
Weâve been using TensorFlow (Googleâs AI framework) in our team for a long time, and we saw that a TensorFlow version of LayoutLMv3 didnât exist, so we decided it was time to give back to the community that has given us so much.
âThe LayoutLMv3 model is super accurate, amazingly fast, and also relatively simple at the same time.â
This is the first TensorFlow model at Hugging Face that was added entirely by a contributor (including model architecture and weights). Whatâs in it for the community?
Besides the benefits we get from the model, this implementation we shared with the Hugging Face community plays a part in democratising AI. The model becomes much more freely and widely available to other developers in organisations around the world, which I think is pretty cool.
What does this mean to you? (And congrats!)
Of course itâs a privilege to give back, as itâs nice to not only be a consumer, but also a contributor in the community, so I think itâs really great that we have the talent and support to do this. I also want to give a big shout out to the rest of the Visma Machine Learning Assets team and my co-contributors Esben Toke Christensen and Lasse Reedtz for pushing this through the finish line. Also a big thank you to the Hugging Face team for their incredible work and support.
âHugging Face transformers are a huge asset in our team, so it is a privilege for me to be able to give back to the community by contributing this implementation.â
Are you interested in how we can help you with machine learning?
For more information about the Machine Learning Assets team and our products Smartscan and Autosuggest:
Learn more about Smartscan and the team behind it
If you want to learn more about LayoutMv3:
Read this article on LayoutLMv3: Pre-training for Document AI
About the episode
Artificial intelligence (AI),ai,Insights: Machine Learning,Machine Learning
Voice of Visma
We're sitting down with leaders and colleagues from around Visma to share their stories, industry knowledge, and valuable career lessons. With the Voice of Visma podcast, weâre bringing our people and culture closer to you. Welcome!