Skip to content

QuickTalk Local Deployment

Use this path when OpenTalking should load the QuickTalk adapter in-process instead of introducing OmniRT first.

Terminal
export DIGITAL_HUMAN_HOME=/path/to/digital_human
export OPENTALKING_HOME="$DIGITAL_HUMAN_HOME/opentalking"

# Set mirrors first when package downloads are slow.
export UV_INDEX_URL=https://pypi.tuna.tsinghua.edu.cn/simple
export PIP_INDEX_URL=https://pypi.tuna.tsinghua.edu.cn/simple
export UV_HTTP_TIMEOUT=300
export UV_LINK_MODE=copy

cd "$OPENTALKING_HOME"
uv sync --extra dev --extra models --extra quicktalk-cuda --python 3.11
source .venv/bin/activate

Prepare a QuickTalk local asset root that contains checkpoints/quicktalk.pth, checkpoints/repair.npy, HuBERT files, and InsightFace assets.

The avatar does not need to start as model_type=quicktalk. OpenTalking decouples avatar selection from model selection: if an avatar has metadata.source_video, metadata.source_image, reference.png, or preview.png, QuickTalk prewarm can generate the template video and face cache it needs. Dedicated QuickTalk avatars can still declare metadata.quicktalk.template_video explicitly.

Then start:

Terminal
export OPENTALKING_QUICKTALK_BACKEND=local
export OPENTALKING_QUICKTALK_ASSET_ROOT=/absolute/path/to/opentalking/models/quicktalk
export OPENTALKING_QUICKTALK_WORKER_CACHE=1
export OPENTALKING_TORCH_DEVICE=cuda:0
cd "$OPENTALKING_HOME"
bash scripts/start_unified.sh --backend local --model quicktalk --api-port 8000 --web-port 5173

Open http://localhost:5173, choose a clear front-facing avatar such as the built-in singer, and select the quicktalk model. The first run prewarms the avatar cache before the session starts.

Frontend Startup

scripts/start_unified.sh starts the WebUI as well as the OpenTalking API. To restart only the frontend while the API is already running on port 8000, use a second terminal:

Terminal
cd "$OPENTALKING_HOME"
bash scripts/quickstart/start_frontend.sh --api-port 8000 --web-port 5173 --host 0.0.0.0

For a remote server, forward your local browser port to the server 5173, then open http://127.0.0.1:5173.

Verify:

Terminal
curl -s http://127.0.0.1:8000/models | python3 -m json.tool