RealtimeVoiceChat (KoljaB)
- bootstraps the following three: RealtimeSTT (KoljaB), LLM (e.g. Ollama or OpenAI), and RealtimeTTS (KoljaB)
Setup
Linux
This setup assumes you have Ollama already installed and running (in my case it’s reachable at http://10.0.0.5:11434).
Update APT and install packages:
sudo apt update sudo apt install -y portaudio19-dev python3-dev build-essential gitInstall conda, use it to create and activate a python 3.10 environment:
cd ~ wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh bash Miniconda3-latest-Linux-x86_64.sh source ~/.bashrc conda --version conda update -n base -c defaults conda conda create -n py310 python=3.10 conda activate py310Install pytorch stuff
pip install torch==2.5.1+cu121 torchaudio==2.5.1+cu121 torchvision --index-url https://download.pytorch.org/whl/cu121Git clone the project
git clone https://github.com/TheRealMarcusChiu/RealtimeVoiceChatInstall package dependencies for project:
cd RealtimeVoiceChat pip install -r requirements.txtMake it point to your Ollama instance (say it’s reachable at http://10.0.0.5:11434):
Make change to file code/llm_module.py line 62
OLLAMA_BASE_URL = os.getenv("OLLAMA_BASE_URL", "http://10.0.0.5:11434")Run it
cd code python server.py