ChessInsights AI is a Chrome and Firefox browser extension that per... - Vibeus
ChessInsights AI is a Chrome and Firefox browser extension that performs chessboard detection and piece recognition 100% client-side using local inference. It keeps image data on the user's machine, supports detecting multiple boards in a single frame, and provides its features for free. The project is designed to connect passive chess content—YouTube, Twitch, PDFs, and articles—with active engine analysis. A user can capture the visible browser tab with the tab-capture API or select a region in Photo mode, then receive a FEN string and engine evaluation without switching contexts. The captured screenshot is processed by a local object-detection neural network with a YOLO-style architecture through TensorFlow.js and a WebGL or CPU backend. The pipeline finds chessboard-shaped regions across the frame and filters them with non-max suppression; boards are currently expected to be roughly axis-aligned, while perspective correction for heavily skewed boards is planned. Each detected board is cropped, divided into its 8x8 grid, and sent cell by cell to a local CNN classifier that predicts the piece type or an empty square. The model uses augmentations for video-compression noise, stream overlays, arrows, and different 2D and 3D board themes. Stockfish compiled to WebAssembly runs in a Web Worker for local position analysis, and the results appear in the extension's dashboard and board editor. The project says that detection, classification, and engine analysis run entirely in the browser: no board images or video frames are sent to a server. It also supports capturing multiple diagrams at once and has no paywall for its feature set. Источник