Connect Vertex AI with AI Content Labs and create multimodal content

Key Features

AI Content Labs allows you to leverage Gemini’s multimodal capabilities, including the gemini-1.5-pro-002, gemini-1.5-flash-002, gemini-2.0-flash-exp, and gemini-2.0-flash-thinking-exp-1219 models, as well as claude-sonnet-3.5 from Anthropic and the Imagen 3.0 image model, if enabled in your Vertex AI account. Gemini stands out for its ability to process text, images, audio, and PDFs simultaneously, opening up a world of creative possibilities. Its extensive context window allows you to work with large inputs and maintain coherence across your projects. In addition to these models, the integration with Vertex AI provides access to an ever-expanding selection of generative AI models. At the end of this post, you’ll find the complete and updated list of Vertex AI models available in AI Content Labs.

This integration enables you to create complex workflows that combine the strengths of different AI models. Imagine generating text with Gemini, editing it with Claude, and then creating an image from that text using Imagen 3.0, all within a single automated workflow in AI Content Labs. This ability to combine different models allows you to take your projects to the next level, creating highly sophisticated and customized solutions. Additionally, direct access to the Vertex AI API offers granular control over each model’s parameters, allowing you to fine-tune performance to meet your specific needs.

Use Cases

Imagine you’re a content creator and need to generate an engaging blog article with relevant images. You can use Gemini to generate the article’s text based on a specific title or topic. Then, you could use Vertex AI’s Imagen 3.0 model to create customized images that illustrate the content. Finally, you could use Elevenlabs to generate an audio version of the article, perfect for podcasts or audiobooks.

Another example would be creating a storyboard for a video. You can use Gemini to generate the script and scene descriptions. Then, using Fal.ai, you can generate images or even short animations for each scene, creating a visually compelling storyboard. This workflow allows you to quickly prototype and efficiently visualize your ideas.

Setup Guide

Activating Vertex AI in AI Content Labs is simple. You just need your Vertex AI API key. Head over to the AI Content Labs documentation on the Vertex AI API key for detailed instructions on configuring the integration and starting to harness the power of Gemini and other Vertex AI models in your workflows.

Benefits and Limitations

• Advantages: Vertex AI’s Gemini models offer high multimodal capabilities, processing text, images, audio, and PDFs with an extensive context window. Its integration with AI Content Labs lets you access Google’s latest generative AI technology.
• Disadvantages: The cost of using Gemini models can be a factor to consider, especially for large-scale projects. Additionally, as an evolving service, some features may be subject to change.

Plans and Pricing

Using Vertex AI in AI Content Labs involves token consumption, with pricing varying based on the model used and the length of the generated text. You can find more information on Vertex AI pricing on the Google Cloud pricing page. Note that the pricing data provided in this article is accurate as of January 2025 and may be subject to change. It is recommended to check the official pricing page for the most up-to-date information.

Empower your workflows with cutting-edge artificial intelligence. Integrate Vertex AI with AI Content Labs today and start creating innovative experiences. Get started now.