Video by NetApp Instaclustr via YouTube
While LLMs produce fantastic results, the costs can be steep. A small language model is a great option for limited budgets and resources while still providing solid, fast outputs.
Learn how to build a SLM from scratch with Sr. AI developer advocate David VonThenen.
Demo: https://www.youtube.com/watch?v=VUuVro-Dv7c
Be sure to subscribe for all things AI!
Timestamps:
00:46: What is a small language model?
01:55: Setting up a nanoGPT-style casual LM
09:26: Building our model
13:38: Results
14:59: Fine-tuning the model
21:06: The types of LMs