Transform your smart glasses into an AI-powered shopping assistant that understands what you're looking at and handles cryptocurrency payments with just your voice.
Vitalik is a cutting-edge AI shopping assistant designed for the next generation of AR/smart glasses. Simply look at any product, say "Hey Vitalik," and instantly get prices, make purchases, and complete transactions using cryptocurrency - all through natural voice commands.
No screens. No typing. Just natural conversation.
- Real-time object recognition - Identifies products just by looking at them
- Context-aware responses - Understands what you're looking at and provides relevant information
- Multi-item detection - Can identify multiple products in your field of view
- Wake word activation - "Hey Vitalik" or "Okay Vitalik" to start
- Natural language processing - Speak naturally, no rigid commands
- Audio-only feedback - Designed for screenless interaction
- PYUSD on Arbitrum - Lightning-fast stablecoin transactions
- Flow blockchain - Support for Flow tokens and NFTs
- One-voice checkout - Confirm purchases with a simple "yes"
- On-chain verification - Every transaction is real and verifiable
- Authorized vendors only - Curated list of trusted merchants
- Voice confirmation required - No accidental purchases
- Duplicate protection - Smart detection prevents double-charging
- Blockchain transparency - All transactions on public testnets
Experience the future of shopping:
- Enable camera and microphone when prompted
- Say "Hey Vitalik" to activate
- Show any product to the camera (try a Coke can, phone charger, or water bottle)
- Ask about pricing - "What does this cost?"
- Make a purchase - "I want to buy this"
- Confirm with voice - Say "yes" to complete the transaction
- AI Vision: Google Gemini 2.5 Flash for real-time visual analysis
- Blockchain: Arbitrum Sepolia (PYUSD) & Flow Testnet
- Voice Processing: WebRTC streaming with live transcription
- ENS Integration: L2 optimistic name resolution
- Framework: Next.js with React
Walk through stores and instantly get product information and prices without pulling out your phone.
Look at items in a vending machine and purchase with voice commands - no physical interaction needed.
Get information about artifacts and artwork, with optional donation or purchase capabilities.
Empowers visually impaired users with voice-guided shopping and audio confirmations.
┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐
│ Smart Glasses │────▶│ Gemini AI │────▶│ Blockchain │
│ Camera + Mic │ │ Vision + Voice │ │ Arbitrum/Flow │
└─────────────────┘ └─────────────────┘ └─────────────────┘
│ │ │
│ ▼ │
│ ┌─────────────────┐ │
└─────────────▶│ Voice Output │◀─────────────┘
│ Confirmation │
└─────────────────┘
Every purchase is a real blockchain transaction:
- Arbitrum Sepolia: View on Arbiscan
- Flow Testnet: View on Flowscan
Vitalik represents the convergence of:
- Augmented Reality - Information overlaid on the real world
- Artificial Intelligence - Understanding context and intent
- Blockchain Technology - Instant, global, programmable money
- Voice Computing - The most natural human interface
- Node.js 18+
- Camera and microphone access
- Wallet with testnet PYUSD or Flow tokens
# Clone the repository
git clone https://github.com/yourusername/vitalik
# Install dependencies
pnpm install
# Set up environment variables
cp .env.example .env.local
# Run the development server
pnpm devNEXT_PUBLIC_GEMINI_API_KEY= # Google AI Studio
WALLET_PRIVATE_KEY= # For PYUSD transfers
FLOW_PRIVATE_KEY= # For Flow transfers
FLOW_ACCOUNT_ADDRESS= # Your Flow account
ARBITRUM_SEPOLIA_RPC_URL= # Arbitrum RPC endpointCurrently recognizes and sells:
- Beverages: Coca-Cola, Pepsi, Sprite, Energy Drinks, Water
- Electronics: USB-C Chargers, Phone Chargers, Laptop Chargers
- Digital Goods: Flow NFT Packs, Collectibles
We believe the future of shopping is:
- Frictionless - No apps, no cards, no checkout lines
- Intuitive - As natural as asking a friend
- Transparent - Every transaction on-chain
- Accessible - Voice-first for everyone
Vitalik is more than a shopping assistant - it's a glimpse into a world where technology disappears into the background, leaving only natural human interaction with instant, global, programmable money.