Google just announced their Gemini model last December with the Gemini Pro now used on the Pixel 8 Pro and Galaxy S24. Then Gemini Advanced was announced with access to their most powerful model Gemini Ultra. Today, the Gemini 1.5 Pro model was announced with capabilities said to be comparable to the Gemini Ultra but with reduced processing power requirements.
Gemini 1.5 Pro is already accessible to developers and enterprise users. It has a performance increase of up to 87% in benchmark tests. The advantage of Gemini 1.5 Pro is that it processes up to 1 million context tokens compared to GPT-4 Turbo which only supports 128,000 context tokens.
Access to this 1 million context token capability is only available to a select number of AI Studio and Vertex AI customers at this time. Google has plans to offer it to all customers in the future but details about it have not been finalized.
With 1 million context tokens, Gemini 1.5 Pro can process 1 hour of video, 11 hours of audio, 30,000 lines of code or a document with 700,000 words. In Google's internal tests, Gemini 1.5 Pro can actually process up to 10 million context tokens.
In the video example above, Gemini Pro 1.5 is given the task of "reading" the Apollo 11 mission document in the form of a 402-page PDF uploaded by the user. In just 30.2 seconds, Gemini Pro 1.5 can provide answers about the interesting moments of the mission such as the communication made complete with quotes and the context of the conversation made. This capability is not yet possible for GPT-5 Turbo due to its smaller context token window.
Google also used the Machine Translation from One Book (MTOB) benchmark to ensure 1.5 Pro can handle translation tasks with languages it has never been trained on. For example is Kalamang, a language used by less than 200 people on earth. A grammar handbook is provided and 1.5 Pro can translate English documents into Kalamangan very well.
It is currently unknown when Gemini 1.5 Pro will be offered to all users. After Gemini 1.5 Pro there will definitely be Gemini 1.5 Nano and Gemini 1.5 Ultra with different capabilities.