Smart India Hackathon 2026 · Problem Statement

AI-Powered
Patient Intake
for Government Hospitals

Voice-first medical interviews, multilingual support, document intelligence, and seamless ABDM integration — purpose-built for India's high-footfall public healthcare system.

8+
Languages
90s
Avg. Interview
ABDM
FHIR R4 Ready
24/7
Kiosk Mode
Scroll to explore
Technology

Built with Modern, Production-Ready Tech

Fully self-hostable — the entire stack runs locally with no cloud dependency. Designed for air-gapped government hospital networks.

AI & Voice

Sarvam AI TTS · STT · Translation
Local LLMs Ollama · Llama · Gemma
OCR Engine Sarvam · Tesseract · Cloud Vision
Whisper Local Speech Recognition

Backend

FastAPI Python REST API
PostgreSQL pgvector · Embeddings
Redis Session Cache
FHIR R4 ABDM Integration

Frontend & Infra

React + TypeScript Vite · Tailwind CSS
i18n · 10 Languages Hindi · Bengali · Tamil · more
Docker Compose One-command deploy
Nginx Reverse Proxy · SPA
100% Local-First Architecture

Every component — LLM inference, speech recognition, text-to-speech, OCR, and database — runs entirely on-premises. Zero patient data leaves the hospital network. Perfect for HIPAA, DISHA, and air-gapped deployments.

Patient Journey

From Walk-In to Doctor-Ready in 90 Seconds

A voice-first workflow designed for patients of all literacy levels and ages.

1

Choose Language

Patient selects from 10 Indian languages. All subsequent interactions happen in their chosen language.

2

ABHA Login / Register

Authenticate with ABHA ID, Aadhaar number, or register as a new patient. Linked to ABDM.

3

Audio Consent

Consent is read aloud by the kiosk in the patient's language. One tap to agree — no forms to read.

4

Voice Interview

AI asks structured medical questions via voice. Patient speaks naturally — STT captures, LLM extracts symptoms, vitals, and history.

5

Document Scan

Upload prescriptions, lab reports, or discharge summaries. OCR extracts text, LLM structures it into a timeline.

6

Doctor Dashboard

Physician sees a structured SOAP summary with red-flag alerts, document timeline, and FHIR-ready data — before the patient walks in.