Google Gemini is a big step forward for AI models
Hindustan TimesGoogle’s next-generation foundation model, Gemini, is ready for prime-time. In six out of eight benchmarks, Gemini Pro outperformed GPT-3.5, including in MMLU, one of the key leading standards for measuring large AI models, and GSM8K, which measures grade school math reasoning,” says Sissie Hsiao, Vice President and General Manager for Assistant and Bard, at Google. Gemini Ultra became the first model to score 90.0% on MMLU, which benchmarks with a combination of 57 subjects including math, physics, history, law, medicine and ethics, for testing world knowledge and problem-solving abilities. Google confirms the Pixel 8 Pro is the first smartphone engineered to run Gemini Nano, powering new features including Summarize in the Recorder app and rolling out in Smart Reply in Gboard, starting with WhatsApp. Developers and enterprises will get access to Gemini Pro on December 13, while Android developers will also be able to use Gemini Nano for on-device tasks, a glimpse of which Google will give the world using AICore on the Pixel 8 Pro phone.