mirror of
https://github.com/google/adk-docs.git
synced 2026-09-14 16:16:59 +08:00
Joe Fernandez
f12068a4bb
* docs: add language support tags to pages - replace img.shield tags - add language support tags where missing * update Agents page with general tags * update language and version tagging - response to review comments - rename css styles to avoid style name conflicts * add tags to api-server page
99 lines
5.0 KiB
Markdown
99 lines
5.0 KiB
Markdown
# Bidi-streaming (live) in ADK
|
|
|
|
<div class="language-support-tag">
|
|
<span class="lst-supported">Supported in ADK</span><span class="lst-python">Python v0.5.0</span><span class="lst-preview">Experimental</span>
|
|
</div>
|
|
|
|
Bidirectional (Bidi) streaming (live) in ADK adds the low-latency bidirectional voice and video interaction
|
|
capability of [Gemini Live API](https://ai.google.dev/gemini-api/docs/live) to
|
|
AI agents.
|
|
|
|
!!! example "Experimental preview release"
|
|
|
|
The Bidirectional (Bidi) streaming feature is experimental.
|
|
|
|
With bidi-streaming, or live, mode, you can provide end users with the experience of natural,
|
|
human-like voice conversations, including the ability for the user to interrupt
|
|
the agent's responses with voice commands. Agents with streaming can process
|
|
text, audio, and video inputs, and they can provide text and audio output.
|
|
|
|
<div class="video-grid">
|
|
<div class="video-item">
|
|
<div class="video-container">
|
|
<iframe src="https://www.youtube-nocookie.com/embed/Tu7-voU7nnw?si=RKs7EWKjx0bL96i5" title="Shopper's Concierge" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
|
|
</div>
|
|
</div>
|
|
|
|
<div class="video-item">
|
|
<div class="video-container">
|
|
<iframe src="https://www.youtube-nocookie.com/embed/LwHPYyw7u6U?si=xxIEhnKBapzQA6VV" title="Shopper's Concierge" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
|
|
!!! info
|
|
|
|
This is different from server-side streaming or token-level streaming.
|
|
Token-level streaming is a one-way process where a language model generates a response and sends it back to the user one token at a time. This creates a "typing" effect, giving the impression of an immediate response and reducing the time it takes to see the start of the answer. The user sends their full prompt, the model processes it, and then the model begins to generate and send back the response piece by piece. This section is for bidi-streaming (live).
|
|
|
|
<div class="grid cards" markdown>
|
|
|
|
- :material-console-line: **Quickstart (Bidi-streaming)**
|
|
|
|
---
|
|
|
|
In this quickstart, you'll build a simple agent and use streaming in ADK to
|
|
implement low-latency and bidirectional voice and video communication.
|
|
|
|
- [Quickstart (Bidi-streaming)](../get-started/streaming/quickstart-streaming.md)
|
|
|
|
- :material-console-line: **Custom Audio Streaming app sample**
|
|
|
|
---
|
|
|
|
This article overviews the server and client code for a custom asynchronous web app built with ADK Streaming and FastAPI, enabling real-time, bidirectional audio and text communication with WebSockets.
|
|
|
|
- [Custom Audio Streaming app sample (WebSockets)](custom-streaming-ws.md)
|
|
|
|
- :material-console-line: **Bidi-streaming development guide series**
|
|
|
|
---
|
|
|
|
A series of articles for diving deeper into the Bidi-streaming development with ADK. You can learn basic concepts and use cases, the core API, and end-to-end application design.
|
|
|
|
- [Bidi-streaming development guide series: Part 1 - Introduction](dev-guide/part1.md)
|
|
|
|
- :material-console-line: **Streaming Tools**
|
|
|
|
---
|
|
|
|
Streaming tools allows tools (functions) to stream intermediate results back to agents and agents can respond to those intermediate results. For example, we can use streaming tools to monitor the changes of the stock price and have the agent react to it. Another example is we can have the agent monitor the video stream, and when there is changes in video stream, the agent can report the changes.
|
|
|
|
- [Streaming Tools](streaming-tools.md)
|
|
|
|
- :material-console-line: **Custom Audio Streaming app sample**
|
|
|
|
---
|
|
|
|
This article overviews the server and client code for a custom asynchronous web app built with ADK Streaming and FastAPI, enabling real-time, bidirectional audio and text communication with both Server Sent Events (SSE) and WebSockets.
|
|
|
|
- [Streaming Configurations](configuration.md)
|
|
|
|
- :material-console-line: **Blog post: Google ADK + Vertex AI Live API**
|
|
|
|
---
|
|
|
|
This article shows how to use Bidi-streaming (live) in ADK for real-time audio/video streaming. It offers a Python server example using LiveRequestQueue to build custom, interactive AI agents.
|
|
|
|
- [Blog post: Google ADK + Vertex AI Live API](https://medium.com/google-cloud/google-adk-vertex-ai-live-api-125238982d5e)
|
|
|
|
- :material-console-line: **Blog post: Supercharge ADK Development with Claude Code Skills**
|
|
|
|
---
|
|
|
|
This article demonstrates how to use Claude Code Skills to accelerate ADK development, with an example of building a Bidi-streaming chat app. Learn how to leverage AI-powered coding assistance to build better agents faster.
|
|
|
|
- [Blog post: Supercharge ADK Development with Claude Code Skills](https://medium.com/@kazunori279/supercharge-adk-development-with-claude-code-skills-d192481cbe72)
|
|
|
|
</div>
|