ghostship
The problem: AI coding tools made building features 10x faster, but learning whether a change is good for users still takes weeks of A/B testing.
Core trick
Puppeteer captures each preview URL as a screenshot, and five Gemini personas generated from the page content score the revision.
Description
The problem:
AI coding tools made building features 10x faster, but learning whether a change is good for users still takes weeks of A/B testing. Every Vercel preview deployment is already an A/B test candidate — it just has zero users. GhostShip fills that gap.
GhostShip sends AI-generated "phantom users" to evaluate your web pages before real users ever see them. Three core capabilities:
1. Generate personas on the fly - Paste any URL. Gemini analyzes the page and generates 5 user personas specific to that page's content and audience. not generic templates.
2. Review a page from each persona's perspective - Each persona evaluates the page using Gemini's multimodal vision, providing scores, first impressions, strengths, weaknesses, and suggestions from their unique point of view.
3. Compare pages across revisions via PR reviews - When a developer opens a PR, @ghostship in Slack/GitHub compares the Vercel preview against production. Five personas vote, and you get a confidence-scored recommendation in 30 seconds instead of waiting 2-4 weeks for a real A/B test.
Built with Gemini multimodal (via Vercel AI SDK), Vercel Chat SDK for multi-platform bot delivery (Slack + GitHub), and Puppeteer for automated screenshotting. Deployed on Vercel.
README excerpt
# GhostShip **Phantom users for every pull request.** > Every Vercel preview is already an A/B test. It just has zero users. [ghostship.sh](https://www.ghostship.sh) | [Demo Video](#demo) | [Problem Statement](PROBLEM_STATEMENT.md) --- ## What is GhostShip? AI coding tools made building features 10x faster. But learning whether a change is good for users still takes 2-4 weeks of A/B testing. GhostShip closes that gap. It sends AI-generated "phantom users" to evaluate your pages in 30 seconds — not 3 weeks. Lighthouse for UX. ## Three Capabilities ### 1. Generate Personas on the Fly Paste any URL. Gemini analyzes the page and generates 5 user personas specific to that page — not generic templates. A cooking site gets food personas. A B2B pricing page gets buyer personas. ### 2. Review a Page from Each Persona's Perspective Each persona evaluates the page using Gemini's multimodal vision: first impressions, scores, strengths, weaknesses, and suggestions — all from their unique point of view. ### 3. Compare Pages Across Revisions via PR Reviews When a developer opens a PR, `@ghostship` in Slack or GitHub compares the Vercel preview against production. Five personas vote, and you get a confidence-scored recommendation in 30 seconds. ``` @ghostship https://my-app-git-feature.vercel.app/pricing ``` ``` 👻 Ghostship Report: /pricing Preview wins 4-1 · Confidence: 82% 🛍️ Budget-Conscious Buyer — Prefers Preview (high confidence) "The pricing tiers are much clearer.