DrishtiPay
DrishtiPay is an AI payment guardian for blind and elderly UPI users in India.
Core trick
Captures spoken payment intent, then compares the QR owner, shop sign, and UPI screen amount with what the user said before PIN entry.
Description
DrishtiPay is an AI payment guardian for blind and elderly UPI users in India. It captures payment intent by voice, verifies shop signs, QR owner, UPI amount, and product/payment details, then stops risky payments before PIN entry. It detects QR mismatch, wrong amount, and user-side typing mistakes, making UPI safer beyond normal screen readers.
README excerpt
# DrishtiPay DrishtiPay is a mobile-first multimodal AI payment guardian for blind and elderly UPI users in India. It protects users before UPI PIN entry by checking what the user intends to do, what the shop/product shows, who the QR belongs to, what the UPI screen says, and whether the action will send or receive money. ## Why It Matters Screen readers can read a button. DrishtiPay tells the user whether pressing it could cost them money. UPI fraud and accidental payment mistakes often happen in the final seconds before PIN entry. DrishtiPay acts as a trust layer at that moment. ## Core Features - Voice intent capture for amount, merchant, and send/receive action - UPI screen and QR safety reasoning - Amount mismatch detection, including user-side typing mistakes - Shop sign vs QR owner mismatch detection - UPI PIN scam warning: users never need a PIN to receive money - Product-to-payment checks through ShopShield - Payment autopsy and trust-chain memory - Multi-agent reasoning panel - Guardian alert preview and blocked-incident report - Multilingual safety warnings and voice test - Demo mode for reliable judging ## Trust Chain DrishtiPay verifies the full payment journey: ```text Voice Intent -> User Typed Amount -> Shop Sign -> QR Owner -> UPI Screen -> PIN Action -> Guardian Alert ``` If any link breaks, DrishtiPay warns the user before money leaves the account. ## Demo Flow The main demo simulates a blind or elderly user trying to pay Rs 80 at Lakshmi Medic