Your Camera Is Now the Umpire.

AI-powered table tennis scoring using real-time vision and voice.

No hardware. No referee. No manual scoring.

Camera Watches AI Detects Rally Auto Scores Live Commentary Fully Hands-Free

Trusted by players worldwide.

Built with Gemini 2.5 Flash · Vision Agents SDK · Ultralytics YOLO

WHAT IS SUPERPONG?

Real-Time AI Umpire for Table Tennis

SuperPong is a real-time AI umpire built using computer vision, multimodal AI, and voice interaction. It detects ball movement, determines rally outcomes, updates the scoreboard, and delivers live commentary — all hands-free, running entirely in your browser.

Computer Vision Ball Detection

YOLO tracks ball movement at 5fps, detecting rally outcomes and score events in real time.

Voice-First Interaction

Wake word activation, natural language commands, undo support — all without touching a device.

Live AI Commentary

Gemini delivers energetic real-time voice commentary after every rally. Point for point.

Auto Scoreboard Updates

Score updates in under 1 second. Serve rotation, deuce rules, and best-of sets — fully ITTF compliant.

Runs in the Browser

No installs. Full WebRTC camera + mic stream. Optional Python backend with YOLO for enhanced accuracy.

5fps Video Processing

<1s Score Update Latency

100% Hands-Free Capable

HOW IT WORKS

From Setup to Scoreboard in Seconds

Three simple steps. Voice-activated. Fully automatic.

Setup Match

Enter player names, choose your format (11, 21, or best-of sets), and hit start.

Wake the AI

Say "SuperPong" to activate. Camera and mic start simultaneously. The AI begins listening.

Live Scoring

YOLO tracks the ball at 5fps. Gemini detects rally loss, updates score, and delivers live commentary.

Point to X Undo last point Pause match What's the score

CORE FEATURES

Everything You Need. Nothing You Don't.

Voice-First Scoring

Natural language control with undo and override support. Context-aware — no button presses ever.

YOLO Ball Detection

Ultralytics YOLO with custom VideoProcessor. Trajectory prediction and auto rally outcome detection.

Live Gemini Commentary

Real-time voice output with energetic short commentary after every rally point.

Full Match Intelligence

Serve rotation, deuce rules, best-of sets. Fully ITTF compliant scoring logic.

Backend Optional Mode

Full WebRTC + Python backend, or browser-only Gemini fallback. Your call.

Post-Match Analytics

Winner display, point percentage, set breakdown, and full match duration summary.

UNDER THE HOOD

Built on Serious Technology

A modular architecture that works in the browser or scales with a Python backend.

Frontend Stack

React + Vite · Web Speech API wake word · WebRTC camera stream · useAgentConnection hook

Backend Mode

Stream WebRTC transport · Vision Agents backend · Gemini Realtime at 5fps · YOLO BallTrackingProcessor

Fallback Mode

Direct Gemini Live in browser · Silent SYSTEM STATE UPDATE messages · Keeps score context accurate

Vision Agents SDK

The framework powering SuperPong. Handles WebRTC, Gemini sessions, and custom video processor integration.

add_point undo_last_point pause_match resume_match end_match override_score set_serving

SEE IT IN ACTION

Watch the AI Score a Real Match

01 Wake Word

02 Rally Detection

03 Score Update

04 Commentary

05 Undo Command

06 Match Summary

Browser Only

Option A — Instant Preview

Experience the AI umpire live without any installation. This mode runs entirely in your browser using Gemini Live to handle scoring and commentary.

1 Click "Start Preview" to begin.

2 Enable microphone permissions when prompted.

3 Say "SuperPong" to start scoring!

Run Locally

Option B — Full Customization

The complete professional setup. Clone the repository and run it locally to enable maximum accuracy with full YOLO ball tracking and your own Gemini API key.

Step 1 npm install

Step 2 Add API Key

Step 3 npm run dev

Run it locally & View on GitHub Try Full App Online