The ACE Agent Chat Controller is a critical component of the NVIDIA ACE Agent, a GPU-accelerated SDK for building conversational AI agents or bots. It orchestrates the end-to-end bot pipeline for a speech IO-based bot, providing connectivity between AI skills like NVIDIA Riva Speech AI, NVIDIA ACE Avatar AI & Vision AI, and use case-specific custom plugins. The Chat Controller manages the flow of audio or text data between modules such as Automatic Speech Recognition (ASR), Chat Engine, Text-To-Speech (TTS), and NVIDIA Omniverse Audio2Face Client, ensuring efficient system integration and composable dialog management.

Features

• End-to-End Orchestration: Manages the entire bot pipeline for speech IO-based bots.
• gRPC API: Exposes a gRPC API for building conversational AI client applications.
• Modular Integration: Connects various AI skills and custom plugins.
• Redis Message Brokers: Utilizes Redis for sending metadata and events.
• Kubernetes Compatibility: Compatible with NVIDIA AI Enterprise Infrastructure.

Benefits

• Seamless Integration: Ensures smooth connectivity between different AI modules.
• Enhanced Performance: Leverages GPU acceleration for real-time performance.
• Scalability: Supports scalable deployment with Kubernetes.
• Flexibility: Customizable for various use cases and applications.
• Reliability: Provides robust and reliable orchestration of AI services.