Best AI Models for Vertex AI - Page 2

The PaLM API offers a straightforward and secure method for leveraging our most advanced language models. We are excited to announce the release of a highly efficient model that balances size and performance, with plans to introduce additional model sizes in the near future. Accompanying this API is MakerSuite, an easy-to-use tool designed for rapid prototyping of ideas, which will eventually include features for prompt engineering, synthetic data creation, and custom model adjustments, all backed by strong safety measures. Currently, a select group of developers can access the PaLM API and MakerSuite in Private Preview, and we encourage everyone to keep an eye out for our upcoming waitlist. This initiative represents a significant step forward in empowering developers to innovate with language models.

Gemma represents a collection of cutting-edge, lightweight open models that are built upon the same research and technology underlying the Gemini models. Created by Google DeepMind alongside various teams at Google, the inspiration for Gemma comes from the Latin word "gemma," which translates to "precious stone." In addition to providing our model weights, we are also offering tools aimed at promoting developer creativity, encouraging collaboration, and ensuring the ethical application of Gemma models. Sharing key technical and infrastructural elements with Gemini, which stands as our most advanced AI model currently accessible, Gemma 2B and 7B excel in performance within their weight categories when compared to other open models. Furthermore, these models can conveniently operate on a developer's laptop or desktop, demonstrating their versatility. Impressively, Gemma not only outperforms significantly larger models on crucial benchmarks but also maintains our strict criteria for delivering safe and responsible outputs, making it a valuable asset for developers.

The Gemma family consists of advanced, lightweight models developed using the same innovative research and technology as the Gemini models. These cutting-edge models are equipped with robust security features that promote responsible and trustworthy AI applications, achieved through carefully curated data sets and thorough refinements. Notably, Gemma models excel in their various sizes—2B, 7B, 9B, and 27B—often exceeding the performance of some larger open models. With the introduction of Keras 3.0, users can experience effortless integration with JAX, TensorFlow, and PyTorch, providing flexibility in framework selection based on specific tasks. Designed for peak performance and remarkable efficiency, Gemma 2 is specifically optimized for rapid inference across a range of hardware platforms. Furthermore, the Gemma family includes diverse models that cater to distinct use cases, ensuring they adapt effectively to user requirements. These lightweight language models feature a decoder and have been trained on an extensive array of textual data, programming code, and mathematical concepts, which enhances their versatility and utility in various applications.

Gemini 2.0 Flash Thinking is an innovative artificial intelligence model created by Google DeepMind, aimed at improving reasoning abilities through the clear articulation of its thought processes. This openness enables the model to address intricate challenges more efficiently while offering users straightforward insights into its decision-making journey. By revealing its internal reasoning, Gemini 2.0 Flash Thinking not only boosts performance but also enhances explainability, rendering it an essential resource for applications that necessitate a profound comprehension and confidence in AI-driven solutions. Furthermore, this approach fosters a deeper relationship between users and the technology, as it demystifies the workings of AI.

Gemini 2.0 Flash-Lite represents the newest AI model from Google DeepMind, engineered to deliver an affordable alternative while maintaining high performance standards. As the most budget-friendly option within the Gemini 2.0 range, Flash-Lite is specifically designed for developers and enterprises in search of efficient AI functions without breaking the bank. This model accommodates multimodal inputs and boasts an impressive context window of one million tokens, which enhances its versatility for numerous applications. Currently, Flash-Lite is accessible in public preview, inviting users to investigate its capabilities for elevating their AI-focused initiatives. This initiative not only showcases innovative technology but also encourages feedback to refine its features further.

Gemini 2.0 Pro stands as the pinnacle of Google DeepMind's AI advancements, engineered to master intricate tasks like programming and complex problem resolution. As it undergoes experimental testing, this model boasts an impressive context window of two million tokens, allowing for the efficient processing and analysis of extensive data sets. One of its most remarkable attributes is its ability to integrate effortlessly with external tools such as Google Search and code execution platforms, which significantly boosts its capacity to deliver precise and thorough answers. This innovative model signifies a major leap forward in artificial intelligence, equipping both developers and users with a formidable tool for addressing demanding challenges. Furthermore, its potential applications span various industries, making it a versatile asset in the evolving landscape of AI technology.

Gemini 2.5 Flash is a high-performance AI model developed by Google to meet the needs of businesses requiring low-latency responses and cost-effective processing. Integrated into Vertex AI, it is optimized for real-time applications like customer support and virtual assistants, where responsiveness is crucial. Gemini 2.5 Flash features dynamic reasoning, which allows businesses to fine-tune the model's speed and accuracy to meet specific needs. By adjusting the "thinking budget" for each query, it helps companies achieve optimal performance without sacrificing quality.

The Gemini Live API is an advanced preview feature designed to facilitate low-latency, bidirectional interactions through voice and video with the Gemini system. This innovation allows users to engage in conversations that feel natural and human-like, while also enabling them to interrupt the model's responses via voice commands. In addition to handling text inputs, the model is capable of processing audio and video, yielding both text and audio outputs. Recent enhancements include the introduction of two new voice options and support for 30 additional languages, along with the ability to configure the output language as needed. Furthermore, users can adjust image resolution settings (66/256 tokens), decide on turn coverage (whether to send all inputs continuously or only during user speech), and customize interruption preferences. Additional features encompass voice activity detection, new client events for signaling the end of a turn, token count tracking, and a client event for marking the end of the stream. The system also supports text streaming, along with configurable session resumption that retains session data on the server for up to 24 hours, and the capability for extended sessions utilizing a sliding context window for better conversation continuity. Overall, Gemini Live API enhances interaction quality, making it more versatile and user-friendly.

Gemini 2.5 Pro Deep Think is the latest evolution of Google’s Gemini models, specifically designed to tackle more complex tasks with better accuracy and efficiency. The key feature of Deep Think enables the AI to think through its responses, improving its reasoning and enhancing decision-making processes. This model is a game-changer for coding, problem-solving, and AI-driven conversations, with support for multimodality, long context windows, and advanced coding capabilities. It integrates native audio outputs for richer, more expressive interactions and is optimized for speed and accuracy across various benchmarks. With the addition of this advanced reasoning mode, Gemini 2.5 Pro Deep Think is not just faster but also smarter, handling complex queries with ease.

Veo 3 is Google’s most advanced video generation tool, built to empower filmmakers and creatives with unprecedented realism and control. Offering 4K resolution video output, real-world physics, and native audio generation, it allows creators to bring their visions to life with enhanced realism. The model excels in adhering to complex prompts, ensuring that every scene or action unfolds exactly as envisioned. Veo 3 introduces powerful features such as precise camera controls, consistent character appearance across scenes, and the ability to add sound effects, ambient noise, and dialogue directly into the video. These new capabilities open up new possibilities for both professional filmmakers and enthusiasts, offering full creative control while maintaining a seamless and natural flow throughout the production.

Lyria 2 is an innovative music generation tool developed by Google, built to empower musicians with high-fidelity sound and professional-grade audio. With its ability to create intricate and detailed compositions across genres such as classical, jazz, pop, and electronic, Lyria 2 allows users to control key elements of their music like key and BPM, giving them granular creative control. Musicians can use text prompts to generate custom music, accelerating the composition process by providing new starting points and refining ideas quickly. Lyria 2 also helps uncover new musical styles and techniques, encouraging exploration beyond familiar genres. By generating music with stunning nuance and realism, it opens new creative avenues for artists to experiment with melodies, harmonies, and arrangements, whether they're looking to refine existing compositions or craft entirely new pieces.

WeatherNext represents a suite of AI-driven models developed by Google DeepMind and Google Research, designed to deliver cutting-edge weather predictions. These advanced models surpass conventional physics-based approaches in both speed and efficiency, leading to enhanced reliability in forecasts. By improving the accuracy of weather predictions, these innovations could significantly aid in disaster preparedness, ultimately saving lives during severe weather scenarios and bolstering the dependability of renewable energy sources and supply chains. WeatherNext Graph stands out by providing more precise and efficient deterministic forecasts than existing systems, producing a single forecast for each specified time and location with a 6-hour temporal resolution and a 10-day lead time. In addition, WeatherNext Gen excels at generating ensemble forecasts that outshine the current predominant models, thereby equipping decision-makers with a clearer understanding of weather uncertainties and the associated risks of extreme weather conditions. This leap in forecasting capability promises to transform how we respond to and manage the impacts of climate variability.

MedGemma is an innovative suite of Gemma 3 variants specifically designed to excel in the analysis of medical texts and images. This resource empowers developers to expedite the creation of AI applications focused on healthcare. Currently, MedGemma offers two distinct variants: a multimodal version with 4 billion parameters and a text-only version featuring 27 billion parameters. The 4B version employs a SigLIP image encoder, which has been meticulously pre-trained on a wealth of anonymized medical data, such as chest X-rays, dermatological images, ophthalmological images, and histopathological slides. Complementing this, its language model component is trained on a wide array of medical datasets, including radiological images and various pathology visuals. MedGemma 4B can be accessed in both pre-trained versions, denoted by the suffix -pt, and instruction-tuned versions, marked by the suffix -it. For most applications, the instruction-tuned variant serves as the optimal foundation to build upon, making it particularly valuable for developers. Overall, MedGemma represents a significant advancement in the integration of AI within the medical field.

Harness the capabilities of tailored models to gain a strategic edge in your market. With our advanced enterprise Gen AI framework, you can surpass conventional limits and delegate repetitive tasks to robust assistants in real time – the possibilities are endless. For businesses that prioritize data protection, customize and implement generative AI solutions within your own secure cloud environment, ensuring safety and confidentiality at every step.

Imagen 3 represents the latest advancement in Google's innovative text-to-image AI technology. It builds upon the strengths of earlier versions and brings notable improvements in image quality, resolution, and alignment with user instructions. Utilizing advanced diffusion models alongside enhanced natural language comprehension, it generates highly realistic, high-resolution visuals characterized by detailed textures, vibrant colors, and accurate interactions between objects. In addition, Imagen 3 showcases improved capabilities in interpreting complex prompts, which encompass abstract ideas and scenes with multiple objects, all while minimizing unwanted artifacts and enhancing overall coherence. This powerful tool is set to transform various creative sectors, including advertising, design, gaming, and entertainment, offering artists, developers, and creators a seamless means to visualize their ideas and narratives. The impact of Imagen 3 on the creative process could redefine how visual content is produced and conceptualized across industries.

Google Cloud's Text-to-Speech API has unveiled Chirp 3, a feature that allows users to develop custom voice models by utilizing their own high-quality audio recordings. This innovation streamlines the process of generating unique voices for audio synthesis via the Cloud Text-to-Speech API, catering to both streaming and long-form text applications. Due to safety protocols, access to this voice cloning feature is limited to select users, and those interested in gaining access must reach out to the sales team for inclusion on the allowed list. The Instant Custom Voice capability supports a variety of languages, such as English (US), Spanish (US), and French (Canada), ensuring a broad reach for users. Moreover, this service is operational across multiple Google Cloud regions and offers a range of supported output formats, including LINEAR16, OGG_OPUS, PCM, ALAW, MULAW, and MP3, depending on the chosen API method. As voice technology continues to evolve, the possibilities for personalized audio experiences are expanding rapidly.

Lyria, Google’s text-to-music model, is now available on Vertex AI, allowing businesses to generate custom music tracks with just a text prompt. It is perfect for marketers, content creators, and media professionals who need personalized, high-quality music for campaigns, videos, and podcasts. Lyria produces music across various genres and styles, eliminating the need for expensive licensing or time-consuming composition processes. The platform helps streamline content creation by tailoring soundtracks that match the mood, pacing, and narrative of your content.

Imagen 4 is the latest iteration of Google's image generation model, offering the highest level of clarity and creative potential. Users can now generate hyper-realistic images with enhanced textures, colors, and typography, bringing their visual ideas to life with more precision. The model excels at producing photo-realistic representations of people, animals, landscapes, and other objects, with improved sharpness and accuracy in every detail. It supports a wide range of artistic styles, including abstract, impressionistic, and realistic portrayals. Imagen 4 also features an ultra-fast mode that allows users to test dozens of ideas instantly, creating images up to 10x faster than previous versions. With a maximum resolution of 2K, it ensures the finest details are captured. The model’s capabilities make it perfect for professionals in creative industries looking to experiment with various styles or bring complex visions to fruition quickly and effectively.