Agentic Cinema: Hackathon Resources Guide 

Welcome to the backlot! Use this curated guide to find the documentation, SDKs, and code samples needed to build your agentic workflows and movie studio tools. All links have been verified for accuracy.

 

πŸ› οΈ Phase 1: Core Frameworks & Environment

Choose your building stage. Whether you want a managed, low-code interface or a fully custom SDK setup, begin here:

 

🎬 Phase 2: Action Mechanisms & Data Connectivity (GenMedia Focus)

Your agents need to "do" things (tools) and "know" things (grounding). Use these media-focused resources to process scripts, audio, and visual assets:

πŸ“„ Script Processing & Document Grounding
πŸŽ₯ Video Analysis & VFX (Multimodal Storyboarding)
  • Multimodal Introduction: Gemini Multimodal Use Cases β€” Learn to feed text, video, and audio simultaneously to Gemini.
  • Comprehensive Video Transcription: Video Transcription Notebook β€” Generate timestamped transcriptions and speaker annotations from raw video clips.
  • Video Asset Captioning: Video Captioning Notebook β€” Generate detailed metadata and descriptions to make video libraries searchable.
  • Visual VFX Generation: Imagen 3 Image Generation Guide β€” Generate VFX mood boards, concept art, and storyboard panels from simple text prompts.
🎡 Audio & Speech Generation (Lyria & Gemini TTS)
  • Audio Generation (Lyria 3): Lyria 3 Music Generation Guide β€” Generate high-fidelity music clips, soundtracks, or sound effects across various genres.
  • Speech Generation (Gemini TTS): Gemini 3.1 Flash TTS Tutorial β€” Convert text to expressive speech using prebuilt voices, and configure multi-speaker settings.
  • Multi-Speaker Podcast Generator: Multi-Speaker Podcast Notebook β€” Generate multi-speaker dialogues, script reads, or discussions using Gemini and Speech APIs.
  • Dialogue Sentiment Analysis: Multimodal Sentiment Analysis β€” Analyze actor reads or voiceovers by comparing audio tone against script text.

 

 

🀝 Phase 3: Partner Integration & Infrastructure

Connect your agents to external systems, developer tools, and operational metrics.

 

 

🧠 Phase 4: Reasoning, State, & Logic Hosting 

Complex cinematic workflows require state tracking, tool invocation, and managed hosting. We recommend building your agents natively using the Agent Development Kit (ADK) instead of external wrapper libraries:

πŸ“¦ ADK Installation

Install the ADK and Agent Engine client libraries:

pip install "google-cloud-aiplatform[agent_engines,adk]>=1.101.0"

πŸ€– Native ADK & Agent Engine Tutorials
  • ADK Introduction: Introduction to Agent Engine β€” Learn how to define Python functions as tools, wrap them in your agent, and serialize configurations natively.
  • Deploying ADK Agents: Deploying ADK Agents to Agent Engine β€” Step-by-step instructions to deploy your ADK agent to a serverless Vertex AI environment from a local notebook or from source code.
  • Live API Streaming (Bidirectional Audio): Live API on Agent Engine Tutorial β€” Connect ADK agents directly to the Gemini Live API WebSockets for low-latency voice interactions (e.g., interactive script rehearsal).
  • API & Tool Integration (VFX Tooling): Google Maps Agent Tutorial β€” A blueprint for building an agent integrated with external tools, APIs, and image/satellite tools.
  • Agentic Database Interaction: Model Context Protocol (MCP) Database Toolbox β€” Ground your agent and query SQL databases securely using the Model Context Protocol.
πŸ”Œ Agent Tools & Function Calling
  • Introduction to Function Calling: Introduction to Function Calling β€” Allow your agent to query scheduling APIs, write to databases, or trigger cloud tasks.
  • Forced Agent Actions: Forced Function Calling Guide β€” Ensure your agent always queries safety checks or permissions before executing a command.
  • Multimodal Tool Triggering: Multimodal Function Calling β€” Make your agent trigger database updates or email alerts directly from visual video cues.

 

 

πŸš€ Phase 5: Deployment & Safety

Get your production ready for the red carpet and protect the studio assets:

  • Agent Deployment: Agent Builder Deployment Guide β€” Publish your agent as a web chat interface or a REST endpoint using environments.
  • Logic Hosting: Cloud Run Quickstart β€” Fast, serverless deployment for custom agent backends, APIs, and tool servers.
  • Studio Secrets: Secret Manager Guide β€” Securely store and retrieve API keys for your partner tools.
  • Safety & Guardrails: Gemini Safety Settings β€” Configure moderation filters for hate speech, harassment, and unsafe creative outputs.

 

 

Questions?

For further questions about the hackathon, please post on the discussion forum or join us in Discord.