Regional Prize: Europe, Middle East, Africa
Cartmate
An Ai-powered shopping experience
Core trick
A vision model extracts colors, patterns, and cuts from uploaded outfit photos, then conditions a product search agent on that style profile.
Built with
javascriptpythonshelltypescript
Description
CartMate
- AI Shopping Assistant
Revolutionizing e-commerce through intelligent conversational AI
Inspiration
CartMate was born from the frustration of navigating
complex e-commerce interfaces
, endless filters, and overwhelming product catalogs. We envisioned a future where shopping feels like having a conversation with a
knowledgeable friend
who understands your style, knows your preferences, and can find exactly what you're looking for through simple, natural dialogue.
Traditional online shopping forces users to translate their desires into rigid search terms and filter combinations.
CartMate flips this paradigm
, allowing users to express their needs naturally while AI handles the complexity behind the scenes.
What it does
CartMate transforms online shopping into an
intelligent conversation
. Our AI-powered assistant doesn't just search for products—it understands style, learns preferences, and provides a truly personalized shopping experience.
Core Features
Conversational Shopping Experience
Users can describe what they're looking for in natural language. Whether it's
"I need something trendy for a summer wedding"
or
"show me comfortable work shoes under $100,"
CartMate understands context and intent.
Visual Style Analysis
Upload photos of your favorite outfits or inspiration images. Our AI analyzes colors, patterns, cuts, and styling to build a comprehensive understanding of your personal aesthetic.
Intelligent Product Discovery
Our specialized AI agents search through product catalogs with
style awareness
, filtering options based on your conversation history and visual preferences.
Smart Price Intelligence
Real-time price comparison across multiple retailers ensures you never miss a better deal. Our system tracks pricing trends and suggests optimal purchase timing.
Context-Aware Cart Management
Add items through conversation while the system validates style coherence and suggests complementary pieces. The AI remembers your preferences and warns about potential style conflicts.
Multi-Agent Coordination
Six specialized AI agents
work together seamlessly—from style analysis to price comparison—all orchestrated through natural conversation.
How we built it
CartMate leverages a
sophisticated multi-agent architecture
designed for scalability and intelligence.
Technical Architecture
Frontend Stack
React
with
TypeScript
for type safety and developer experience
Real-time
WebSocket
connections for instant messaging
Responsive design optimized for both desktop and mobile shopping
Backend Infrastructure
Python FastAPI
providing high-performance async API endpoints
Redis
for session management and real-time pub/sub messaging
WebSocket servers handling concurrent chat sessions
AI Services Integration
Google Vertex AI
powering conversational intelligence with Gemini
Computer Vision API
for sophisticated image style analysis
Perplexity API
for market research and competitive pricing
Microservices Architecture
Online Boutique
integration via gRPC for product catalog and cart management
Kubernetes
deployment on Google Cloud Platform for production scalability
Service mesh architecture enabling reliable inter-service communication
Agent-to-Agent (A2A) Protocol
Our custom
A2A protocol
enables seamless coordination between specialized agents:
class AgentCoordinator:
def __init__(self):
self.agents = {
'orchestrator': OrchestratorAgent(),
'style_profiler': StyleProfilerAgent(),
'product_discovery': ProductDiscoveryAgent(),
'price_comparison': PriceComparisonAgent(),
'cart_manager': CartManagerAgent(),
'analytics': AnalyticsAgent()
}
Agent Responsibilities:
Orchestrator Agent
: Primary conversational interface and workflow coordination
Style Profiler Agent
: Image analysis and preference learning
Product Discovery Agent
: Intelligent product search and filtering
Price Comparison Agent
: Real-time market analysis and deal discovery
Cart Management Agent
: Transaction handling with style validation
Analytics Agent
: User behavior analysis and recommendation optimization
Challenges we ran into
Multi-Agent Coordination Complexity
Building a system where
six AI agents
communicate effectively while maintaining natural conversation flow required developing a custom protocol. Ensuring agents don't interrupt each other or provide conflicting information demanded sophisticated state management and careful orchestration logic.
Real-Time Performance at Scale
Implementing
WebSocket communication
that remains responsive under load while handling streaming AI responses presented significant architectural challenges. We needed to balance real-time responsiveness with system stability.
Style Analysis Integration
Connecting computer vision analysis with product recommendations required building a
semantic understanding of fashion
and style that goes beyond simple keyword matching. Teaching AI to understand style compatibility and aesthetic coherence was particularly complex.
Production Deployment Challenges
Kubernetes networking
issues, including service discovery problems and LoadBalancer configuration complexities, required deep debugging across multiple service layers. Resource allocation and auto-scaling configuration demanded careful optimization.
API Rate Limiting and Error Handling
Coordinating multiple external APIs with different rate limits and response patterns while maintaining smooth user experience required implementing sophisticated retry mechanisms and
graceful degradation
strategies.
Accomplishments that we're proud of
Production-Ready Multi-Agent System
We successfully deployed a complex distributed system with
six specialized AI agents
communicating through a custom protocol. The system handles real user traffic with
sub-second response times
.
Seamless User Experience
Despite the technical complexity underneath, users experience CartMate as a simple, intuitive conversation. The multi-agent coordination is
completely transparent
to end users.
Advanced Style Intelligence
Our visual analysis system can identify style patterns, color preferences, and aesthetic choices from images, then apply this understanding to product recommendations with
impressive accuracy
.
Robust Production Deployment
Successfully deployed on
Kubernetes
with proper load balancing, auto-scaling, and monitoring. The system handles concurrent users and maintains
high availability
.
Real-Time Performance
Achieved low-latency WebSocket communication with streaming AI responses, creating an experience that feels
immediate and responsive
.
What we learned
Distributed Systems Architecture
Building CartMate taught us invaluable lessons about designing
resilient distributed systems
. We gained deep experience with service mesh architecture, async communication patterns, and handling partial failures gracefully.
AI Service Orchestration
Coordinating multiple AI services while maintaining coherent user experience requires careful
prompt engineering
, state management, and fallback strategies. We learned how to design AI workflows that feel natural despite complex backend coordination.
Production Kubernetes Management
Deploying and debugging complex applications on Kubernetes provided hands-on experience with:
Container orchestration
Service discovery
Resource management
Production monitoring
Real-Time Application Development
Building responsive WebSocket applications taught us about
connection management
, state synchronization, and optimizing for low-latency communication.
User Experience in AI Applications
Balancing AI capability with user control, providing transparent feedback about system actions, and maintaining user trust in automated recommendations requires
thoughtful UX design
.
What's next for CartMate
Enhanced Personalization Engine
Implement persistent user profiles that learn and evolve over time, building increasingly sophisticated understanding of individual style preferences and shopping behaviors.
Expanded Product Intelligence
Outfit Coordination
: Suggest complete outfits and coordinate multiple items across categories
Seasonal Awareness
: Understand fashion seasons and suggest timely, relevant items
Occasion Intelligence
: Recommend appropriate items based on specific events and contexts
Advanced Shopping Features
Price Monitoring
: Track price history and alert users to deals on wishlist items
Inventory Intelligence
: Predict stock levels and suggest optimal purchase timing
Trend Analysis
: Surface emerging fashion trends relevant to user preferences
Platform Expansion
Multi-Store Integration
: Connect with major e-commerce platforms beyond Online Boutique
Mobile Applications
: Native iOS and Android apps with location-aware features
Voice Commerce
: Hands-free shopping through voice interactions
Augmented Reality
: Virtual try-on experiences and style visualization
Social and Community Features
Style Sharing
: Allow users to share and discover style profiles within communities
Collaborative Shopping
: Enable group shopping experiences and gift recommendations
Style Challenges
: Gamified experiences that encourage style exploration
Enterprise Solutions
Retailer Dashboard
: Analytics and insights for partner stores
White-Label Solutions
: Branded AI shopping assistants for individual retailers
API Platform
: Developer tools for integrating CartMate intelligence into existing platforms
CartMate represents the future of e-commerce
—where technology serves human creativity and personal expression rather than overwhelming users with complexity. Our vision is a shopping experience that understands not just
what you want to buy
, but
who you want to become
.
// The future of shopping is conversational
const future = await CartMate.chat("Find me something amazing");
README excerpt
# CartMate *The Future of AI-Powered Shopping Experience* [](https://github.com/cartmate/cartmate) [](https://github.com/cartmate/cartmate/releases) [](LICENSE) [](https://cloud.google.com/vertex-ai) > **CartMate** transforms traditional e-commerce into an intelligent, conversational shopping experience. Shop naturally through AI conversations, discover products through style analysis, and enjoy seamless purchase journeys—all powered by Google's Vertex AI. --- ## ✨ **What Makes CartMate Different** CartMate isn't just another shopping platform—it's a **complete reimagining** of how people discover, evaluate, and purchase products online. Instead of navigating complex interfaces and filters, users simply **chat** with our AI to find exactly what they need. ### **Core Experience Features** 🎯 **Conversational Commerce** Shop through natural conversation—describe what you want, ask questions, get recommendations 🎨 **Visual Style Intelligence** Upload images to teach our AI your style preferences and receive perfectly matched recommendations 🔍 **Context-Aware Discovery** Our AI remembers your conversation history and preferences to suggest increasingly relevant products 💰 **Smart Price Intelligence** Aut