Embedl's Blog on Deep Learning
Battle of the SLMs: Gemma vs LLama
The battle of the small language models (SLMs) just heated up with the release of the Gemma 3 models by the Gemma team a...
Deep Learning’s Sputnik Moment?
The DeepSeek Shock Shockwaves were sent around Silicon Valley and the stock market following the release of new AI model...
AI and UN Sustainability Goals: Reducing the Energy and Carbon Footprint of AI Models
The rapid expansion of Artificial Intelligence (AI) has revolutionized industries, yet its environmental implications ra...
ChatGPT in your lap: Bringing LLMs from the Cloud to the Edge
The wonderous ChatGPT continues to amaze – the new multimodal version could figure out that a picture was taken in Gothe...
Knowledge Distillation: A Powerful and Versatile Tool
Knowledge Distillation (KD) is a pivotal technique in model optimization, where the detailed information stored in a hig...
Vision Transformers vs CNNs at the Edge
Enter the Transformer “The Transformer has taken over AI”, says Andrej Karpathy, (Former) Director of AI at Tesla, in a ...
The Big Story of AI in 2023: LLMs
The year 2023 marked a revolutionary period in the field of artificial intelligence, particularly with the advent of Lar...
What do Vision Transformers See?
CNNs have long been the workhorses of vision ever since they achieved the dramatic breakthroughs of super-human performa...