AI over SMS — Distributed AI Gateway
open-sourceEvent-driven system enabling offline AI access via SMS
Aug 2025 – Jan 2026Problem
Billions of people lack reliable internet access but need AI capabilities. Traditional AI interfaces require stable HTTP connections, unusable for low-connectivity regions.
Solution
Designed an event-driven gateway that routes AI queries over SMS using Spring Boot, Kafka, Redis, and Twilio. Stateful conversations are maintained in Redis. Asynchronous Kafka pipelines enable cross-language (Java/Python) AI processing.
Architecture
Impact
- ▸Stateful conversation handling with Redis-backed caching, zero context loss across SMS turns
- ▸Asynchronous Kafka pipelines reduced redundant LLM calls significantly
- ▸Cross-language processing: Java gateway + Python AI workers on same Kafka bus
- ▸Deployable on minimal infrastructure, accessible in low-bandwidth environments