A smart assistant for live streamer, always ready to accompany and interact anytime. It can chat with you, reply to viewers messages in real time, and even appear using your chosen character, making every stream feel more lively.
Background Project|When I was running Kino AI, I often got DMs from viewers asking, “How can I use AI on my live too?” The problem was, hosting Kino AI on a regular VPS wasn’t possible, mainly because of TTS. Kino AI relied on Applio TTS, which required a GPU. That meant I couldn’t just run it on a normal VPS.
Background Project|I could’ve used third party services like Resemble or TopMediai, but for long streams the cost would quickly pile up. On top of that, I used Zep for memory. Technically, Zep could run for free locally, but self-hosting it in production was way more complicated compared to their hosted service (which again adds cost). To make things worse, the community version wasn’t supported anymore, which made it harder to maintain in the long run.
Background Project|So, I decided to build Teman AI, a lightweight version of Kino AI. For TTS, instead of relying on GPU heavy models, I used Google Translate’s voice combined with ffmpeg to generate audio on the fly. For memory, I replaced Zep with Flowise’s simple memory, keeping track of just 10 conversations, which I think is good enough.
Background Project|I also treated this project as a way to learn DevOps from scratch. I wanted to understand how things really work when you build and run everything yourself.
Infrastructure|I use K3s to set up the cluster, and inside it I run ArgoCD. With ArgoCD, I can easily deploy and manage all the services Teman AI needs. Every time I push changes to the DevOps repo, ArgoCD keeps the cluster in sync with the latest configuration, so the deployments stay up to date automatically
Infrastructure|I also use ArgoCD Image Updater to automatically track and deploy new container images. By applying a semantic versioning strategy, the updater detects and pulls the latest compatible version based on the tags I define. After pulling, it also updates the DevOps repo manifests to reflect the new image version, ensuring everything stays consistent between the repo and the running cluster.
Secure Access|I use Cloudflare Zero Trust to secure several subdomains that serve the ArgoCD dashboard, Grafana, Flowise, Prometheus, and the staging environment. Any request will be redirected to Cloudflare's identity check before it even touches Traefik, ensuring only authenticated users can reach the services.
Infrastructure|Yup, I think that’s all for the infra things. With this setup, I guess I got a proper end to end environment where I can experiment not only with building apps, but also with how they’re deployed, scaled, monitored, and secured in production.
Streamer Setup|The streamer needs 3 steps to get Teman AI running smoothly: