WhatsApp AI Agent

KCC Agri Sevak

An autonomous WhatsApp AI agent that delivers real-time crop advisory to 50,000+ farmers across Haryana — in Hindi and English.

What It Does

Farmers send a text message, voice note, or photo on WhatsApp. The agent autonomously decides which tools to invoke — crop detection, knowledge retrieval, weather lookup, image analysis, or safety scanning — and responds with actionable, context-aware advisory in the farmer's language.

Core Capabilities

Agentic Tool Calling

LangGraph-powered agent with 5 registered tools — autonomously decides which to invoke per query

Crop Detection

Fine-tuned classifier trained on 125 crops, handling Hindi and English crop names

Safety Filter

Dual-layer banned pesticide detection covering 96 CIB&RC chemicals — RAG warning + auditor prompt injection

Multilingual

Full Hindi and English support — farmers interact in whatever language is natural to them

Voice & Image Input

Accepts voice notes and photos — processes speech-to-text and image analysis natively

4,750+ Knowledge Docs

RAG-indexed agricultural knowledge base with ChromaDB vector storage

Tech Stack

FastAPILangGraphGemini 2.5 FlashChromaDBPineconeRedis ClusterKafkaAzure AKSWhatsApp Cloud API

How It Works

01

Farmer sends a message

Text, voice note, or photo via WhatsApp — no app download needed

02

Agent processes & routes

LangGraph agent analyzes intent and autonomously selects tools — crop detector, RAG retriever, weather API, image analyzer, or safety scanner

03

Knowledge retrieval

Pulls relevant advisory from 4,750+ indexed documents using vector similarity search

04

Safety check

Every response passes through a dual-layer filter for banned pesticide references before delivery

05

Response delivered

Farmer receives actionable, contextual advice in their language — within seconds