AI Telephony Agent Make INBOUND and OUTBOUND calls with AI agents using VideoSDK. Supports multiple SIP providers and AI agents with a clean, extensible architecture for VoIP telephony solutions.
Installation
Prerequisites
Python 3.11+
VideoSDK account
Twilio account (SIP trunking provider)
Google API key (for Gemini AI)
Setup
Clone the repository
git clone https://github.com/yourusername/ai-agent-telephony.git cd ai-agent-telephony
Install dependencies
pip install -r requirements.txt
Configure environment variables Create a .env file:
# VideoSDK Configuration VIDEOSDK_AUTH_TOKEN = your_videosdk_token VIDEOSDK_SIP_USERNAME = your_sip_username VIDEOSDK_SIP_PASSWORD = your_sip_password # AI Configuration GOOGLE_API_KEY = your_google_api_key # Twilio SIP Trunking Configuration TWILIO_SID = your_twilio_sid TWILIO_AUTH_TOKEN = your_twilio_auth_token TWILIO_NUMBER = your_twilio_number
Run the server
python server.py
The server will start on http://localhost:8000
API Endpoints
Handle Inbound Calls (SIP User Agent Server)
POST /inbound-call
Handles incoming calls from your SIP provider. Expects Twilio webhook parameters, either host this server or use ngrok :
POST < server-url > /inbound-call
CallSid : Unique call identifier
: Unique call identifier From : Caller's phone number (CLI - Calling Line Identification)
: Caller's phone number (CLI - Calling Line Identification) To : Recipient's phone number (DID - Direct Inward Dialing)
Initiate Outbound Calls (SIP User Agent Client)
POST /outbound-call Content-Type: application/json { " to_number " : " +1234567890 " , " initial_greeting " : " Hello from AI Agent! " }
Configure SIP Provider
POST /configure-provider ? provider_name=twilio
Switch SIP providers at runtime (currently supports: twilio ).
Adding New SIP Providers
The modular architecture makes it easy to add new SIP providers and SIP trunking services. Here's how to add a new provider:
1. Create Provider Implementation
Create providers/your_provider.py :
from typing import Dict , Any from . base import SIPProvider from config import Config class YourProvider ( SIPProvider ): def __init__ ( self ): self . client = self . create_client () def create_client ( self ) -> Any : return YourProviderClient ( Config . YOUR_API_KEY ) def generate_twiml ( self , sip_endpoint : str , ** kwargs ) -> str : return f" { sip_endpoint }