Google DeepMind has released a new, compact, open-source AI model, Gemma 2 2B, on Thursday. Containing just 2.6 billion parameters, the language model surpasses rivals like OpenAI’s GPT-3.5 and Mistral AI’s Mixtral 8x7B, which are much bigger in size. Google’s Developer Blog stated that Gemma 2 2B had been built using distillation techniques which effectively reduces computational requirements while distilling …
