Regional Prize: Latin America
NeroFashion
Bringing online shopping closer to reality with AI.
Core trick
Composites a product image onto a user photo with an image model, and reads AI descriptions aloud via text-to-speech for blind users.
Built with
fastapigeminigoogle-genainanobananapythonreact
Description
Inspiration
The biggest barrier in online shopping is not price, it’s the
lack of proximity to the product
. Customers can’t touch, try, or feel items before purchasing, which creates insecurity, frustration, and high return rates. Our inspiration came from this challenge:
how can we make e-commerce more personal, inclusive, and fun?
What it does
We built a new
AI microservice
for the online boutique application that runs on
Google Kubernetes Engine (GKE)
. Without changing the core system, we added a layer of intelligence that helps customers feel closer to the products.
✨ Key features:
Image mixing
- Users can see themselves wearing the product before buying.
Smart descriptions + Accessibility
- AI generates detailed product/person descriptions. With
text-to-speech
, blind users can describe interests via audio and receive personalized recommendations.
Fashion tips and compliments
- Makes the experience more human and engaging.
Intent-based search
- The user can say:
“I want sunglasses for summer”
. The AI extracts intent, finds the product in the catalog with price/metadata, and shows it applied to the user.
How we built it
Stack
:
Google Gen AI API (Nano Banana + LLMs)
FastAPI for the API
Docker for containerization
GKE for orchestration and scalability
Designed as a
plug-and-play microservice
, so intelligence could be added seamlessly to the boutique application.
Handled multimodal inputs: text, image, and audio in the same pipeline.
Challenges we ran into
We faced the challenge of integrating a new service into the boutique app while preserving its original architecture, ensuring that the microservice could extend the system without breaking it. Deploying and orchestrating AI workloads on GKE required careful design to guarantee scalability and modularity. Another challenge was managing multimodal data, handling text, images, and audio together in a consistent pipeline. Finally, maintaining low latency was essential so that the AI experience would feel immediate and interactive for end users.
Accomplishments that we're proud of
We are proud of having built and deployed a fully functional AI service on GKE in a short time frame, proving how fast innovation can be scaled with the right architecture. Delivering features that are both innovative and accessible was an achievement that truly motivated us, as we opened new possibilities for blind and visually impaired users. Beyond the technical milestones, we are proud of how our team worked: engaged, collaborative, and deeply focused on solving a real and relevant problem. This spirit of integration and shared purpose allowed us to move quickly, overcome blockers, and deliver a solution that went beyond expectations.
What we learned
We learned how powerful GKE can be for rapidly prototyping and scaling AI services, giving us the confidence to build modular microservices that integrate smoothly into existing systems. We also learned how accessibility should not be an afterthought: by designing inclusive features such as text-to-speech, we extended the impact of our solution to a broader audience. Finally, we learned that creativity matters, by mixing image generation, product compliments, and fashion tips, we turned a purely technical solution into a human-centered experience that people can relate to.
What's next for NeroFashion
Our next step is to deepen our knowledge and usage of GKE, exploring its full potential for scaling AI services in production scenarios. We also want to test recommendation models on a larger and more complex catalog, since during this hackathon we felt limited by the number of product samples available. Another key area is accessibility: we plan to continue improving inclusive features so that online shopping becomes truly universal. Finally, we see a clear application of MCP (Model Context Protocol) and deep agents in this project. Our goal is to convert the nanobananaservice API we built into an MCP server, enabling deep agents to consume our service seamlessly. Unfortunately, we didn’t have enough time to implement this during the hackathon, but it is one of the directions we’re most excited to explore next.
giovannamoeller/nero-fashion-frontend★ 31 forksTypeScriptCreated Sep 22, 2025 · last push Nov 10, 2025
README excerpt
# React Product Frontend Um frontend moderno em React + Vite que se conecta ao Product Catalog Service via gRPC. ## 🏗️ Arquitetura ``` Browser (React) → BFF (Node.js/Express) → Product Catalog Service (gRPC) ``` ## 🚀 Quick Start ### Desenvolvimento Local 1. **Instalar dependências:** ```bash npm run install:all ``` 2. **Port-forward do Product Catalog Service:** ```bash kubectl port-forward service/productcatalogservice 3550:3550 ``` 3. **Executar em modo desenvolvimento:** ```bash npm run dev ``` Isso iniciará: - Frontend React: http://localhost:3000 - Backend BFF: http://localhost:3001 ### Deploy no Kubernetes 1. **Build da imagem Docker:** ```bash docker build -t react-product-frontend:latest . ``` 2. **Deploy no cluster:** ```bash kubectl apply -f k8s-deployment.yaml ``` 3. **Verificar status:** ```bash kubectl get pods -l app=react-product-frontend kubectl get svc react-product-frontend ``` ## 📁 Estrutura do Projeto ``` react-product-frontend/ ├── src/ # Frontend React │ ├── components/ # Componentes React │ ├── services/ # API clients │ ├── types/ # TypeScript types │ ├── utils/ # Utilitários │ └── main.tsx # Entry point ├── backend/ # Backend BFF │ ├── src/ │ │ ├── grpc/ # gRPC clients │ │ └── server.ts # Express server │ └── package.json ├── protos/ # Protocol Buffers │