fullseye

日本語 · English · 简体中文 · 繁體中文 · 한국어 · Deutsch · हिन्दी · Français

Fullseye — ViEW2026

Physics simulation and image processing, combined with AI and checked against ground truth.

Tap a tile to open the video or figure (▶ = moving).

About Fullseye (reading)

Try it yourself

Run the paper’s figures yourself, on a phone too. Switch methods with the tabs and drag the 3-D views to rotate them.

Highlights

Some PoC descriptions are in English.

Faint-defect limit▶Faint-defect limit Active contours▶Active contours DIC strain▶DIC strain Focus stacking▶Focus stacking Point-cloud ICP▶Point-cloud ICP Stockpile volume▶Stockpile volume CT reconstructionCT reconstruction CT voids▶CT voids White-light steps▶White-light steps PolarizationPolarization Photoelasticity▶Photoelasticity Thermography NDTThermography NDT Motion magnification▶Motion magnification Ping-pong bounce▶Ping-pong bounce Compound eyeCompound eye Peg-in-hole▶Peg-in-hole Air hockey▶Air hockey Tactile sensor▶Tactile sensor Ping-pong spin▶Ping-pong spin Rally and misreads▶Rally and misreads Traffic, blind spots▶Traffic, blind spots Level crossings▶Level crossings Curve mirror▶Curve mirror TTC and RSS▶TTC and RSS Eye to brain▶Eye to brain Fly brain wave▶Fly brain wave Mouse cortex wave▶Mouse cortex wave Humanoid stereo eyes▶Humanoid stereo eyes Chopstick-cam tracking▶Chopstick-cam tracking 1-D barcode1-D barcode Bearing diagnosisBearing diagnosis Bilateral asymmetryBilateral asymmetry Crack widthCrack width Dimensional checkDimensional check Fabric defectsFabric defects Fibre orientationFibre orientation Gear teethGear teeth Matrix codeMatrix code Display moiréDisplay moiré Particle sizingParticle sizing Creep strain▶Creep strain Surface roughnessSurface roughness Thermal driftThermal drift Veiling glareVeiling glare Weld bead profileWeld bead profile Leak by soundLeak by sound Machine healthMachine health Grain sizeGrain size Waste sortingWaste sorting Screw threadsScrew threads Solar ELSolar EL Solder AOISolder AOI As-built wallsAs-built walls Electrode breathingElectrode breathing Electrode tortuosityElectrode tortuosity Bump coplanarityBump coplanarity Die tilt and TSVDie tilt and TSV Multibeam sonarMultibeam sonar Print registrationPrint registration Rail corrugationRail corrugation Real coinsReal coins Rotating texturesRotating textures Roller defectsRoller defects Weld bead scanWeld bead scan AOI-to-CT matchingAOI-to-CT matching SPCSPC Glyph typosGlyph typos Print layersPrint layers Gauge R&RGauge R&R Attention identitiesAttention identities Zernike aberrationsZernike aberrations MT hidden faultMT hidden fault Text regionsText regions AGV fleet▶AGV fleet Tactile shearTactile shear Tactile dipoleTactile dipole Food cutting▶Food cutting Powder heapPowder heap Polish and wipe▶Polish and wipe Mortar grindingMortar grinding Powder scoop/pourPowder scoop/pour Soft dome contact▶Soft dome contact Dose uniformityDose uniformity Tactile knifeTactile knife Phase CRTPhase CRT POD per lightingPOD per lighting In-camera processing vs datasheetsIn-camera processing vs datasheets Interreflection and fringe errorInterreflection and fringe error Speckle floor of a laser lineSpeckle floor of a laser line Hybrid-bond voids by echo phaseHybrid-bond voids by echo phase PL groove vs diffusion lengthPL groove vs diffusion length Illumination cone versus imaging NAIllumination cone versus imaging NA Moiré alignment (two invisible gratings read 1 nm)Moiré alignment (two invisible gratings read 1 nm) Optical drawings from the calculationOptical drawings from the calculation Pocket interreflection to convergencePocket interreflection to convergence Telecentric lens metrologyTelecentric lens metrology Code matching under light and occlusion▶Code matching under light and occlusion Counting dense bubbles (an interval when undecidable)Counting dense bubbles (an interval when undecidable) Good-sample variation modelGood-sample variation model Non-coaxial optics: beamsplitter ghosts and foldsNon-coaxial optics: beamsplitter ghosts and folds How far a scratch dents the mean line, and where robust filters breakHow far a scratch dents the mean line, and where robust filters break Calibrating an imaging model on a real telecentric imageCalibrating an imaging model on a real telecentric image Per-pixel lock-in demodulation: ring-light normals, daylighting, thermal wavesPer-pixel lock-in demodulation: ring-light normals, daylighting, thermal waves Anomaly detection from good samples only (classical patch features: distribution versus memory)Anomaly detection from good samples only (classical patch features: distribution versus memory) Sorting multi-robot plans by how they braid▶Sorting multi-robot plans by how they braid Fourier ptychography (20x resolution in a 4x field)Fourier ptychography (20x resolution in a 4x field) Seven Mueller dimensions a four-angle polarisation camera cannot seeSeven Mueller dimensions a four-angle polarisation camera cannot see Slanted-edge SFR misreads MTF50 through gammaSlanted-edge SFR misreads MTF50 through gamma Where the Maréchal approximation fails, by aberration shapeWhere the Maréchal approximation fails, by aberration shape Car parkingCar parking Complex planeComplex plane All-sky cloud coverAll-sky cloud cover Cell countingCell counting Pigment layersPigment layers Photon ranging▶Photon ranging Document scanDocument scan Camera calibration▶Camera calibration Shake deblurring▶Shake deblurring Battery CT ageingBattery CT ageing Particle tracking▶Particle tracking Driving schoolDriving school Epicycle drawing▶Epicycle drawing Star photometryStar photometry Nuclear ploidyNuclear ploidy White balanceWhite balance Light-field depthLight-field depth Forgery ROCForgery ROC Panorama drift▶Panorama drift Dehazing▶Dehazing BEV sensor fusionBEV sensor fusion Template tracking▶Template tracking Widening the worldWidening the world One beatOne beat Terrain (DEM)▶Terrain (DEM) Vessel networkVessel network Real stain unmixingReal stain unmixing PV thermal surveyPV thermal survey CraquelureCraquelure Real stereoReal stereo Super-resolution▶Super-resolution CAD-to-scan▶CAD-to-scan Growth time-lapse▶Growth time-lapse Inertia and slopes▶Inertia and slopes Endless drawingEndless drawing Sea-ice coverSea-ice cover Wound area▶Wound area Optical fibres and light guides (modes, dispersion, mode field)Optical fibres and light guides (modes, dispersion, mode field) Weld porosityWeld porosity Camera fingerprintCamera fingerprint Rotation auditRotation audit Colormap readingColormap reading Crop leaf areaCrop leaf area Traffic counting▶Traffic counting Sun and weather▶Sun and weather Theorems as gatesTheorems as gates Limb darkeningLimb darkening Trabecular boneTrabecular bone A material optical-property library (86 materials, one table)A material optical-property library (86 materials, one table) Thermal radiometryThermal radiometry Physical consistency of footage: ballistic or thrusted, time stretch▶Physical consistency of footage: ballistic or thrusted, time stretch Camera headingCamera heading Real deblurringReal deblurring ManufacturabilityManufacturability Arrival-time surface▶Arrival-time surface Decision scenes▶Decision scenes Beyond picturesBeyond pictures Star astrometryStar astrometry ColocalizationColocalization Near-infrared through a silicon wafer (choosing the LED)Near-infrared through a silicon wafer (choosing the LED) EMVA 1288 sensorEMVA 1288 sensor Camera heading (real)Camera heading (real) Fly visual front endFly visual front end Slope earthworkSlope earthwork Modal ID from video▶Modal ID from video Endless map▶Endless map Calipers vs illusionsCalipers vs illusions Vegetation coverVegetation cover MRI bias fieldMRI bias field Sorting look-alike foreign matter with hyperspectral NIRSorting look-alike foreign matter with hyperspectral NIR AM thermal to CTAM thermal to CT Two worlds (CARLA)Two worlds (CARLA) Fly steeringFly steering Mesh repair▶Mesh repair Cold-chain recordCold-chain record Lateral motion▶Lateral motion River stageRiver stage Larval connectomeLarval connectome Lens design files (.zmx): read, analyse, fix, write backLens design files (.zmx): read, analyse, fix, write back PXRD phases▶PXRD phases CommonRoad scoringCommonRoad scoring Vanishing detailVanishing detail Pipe wall lossPipe wall loss Warehouse dwellWarehouse dwell Humanoid crossing▶Humanoid crossing Change detectionChange detection Motor quantisationMotor quantisation Glass substitution and multi-start global searchGlass substitution and multi-start global search SEM edge inflationSEM edge inflation A real Japanese townA real Japanese town Graph segmentationGraph segmentation Print warpagePrint warpage Crack growth▶Crack growth Exoplanet transitExoplanet transit Branch territoriesBranch territories Designing a triplet from a table of requirements (edge bounds and glass as a variable)Designing a triplet from a table of requirements (edge bounds and glass as a variable) Shape from polarisationShape from polarisation Assembling a townAssembling a town Segmentation gauntlet▶Segmentation gauntlet Human-machine gapHuman-machine gap Settlement testSettlement test Leaf diseaseLeaf disease EM second opinionEM second opinion Zoom lenses as differences of one prescription (multi-configuration)Zoom lenses as differences of one prescription (multi-configuration) A gravitational-wave detector in closed form▶A gravitational-wave detector in closed form Peg failure recoveryPeg failure recovery FSIM/GMSD/VIFFSIM/GMSD/VIF Scan-to-BIMScan-to-BIM Live 3D+tLive 3D+t River velocity▶River velocity Wiring across decadesWiring across decades Keeping a design's relations as solves (F/# that follows the stop, afocal, curved image, odd aspheres)Keeping a design's relations as solves (F/# that follows the stop, afocal, curved image, odd aspheres) Chromatic confocal sensor (reading height from colour)Chromatic confocal sensor (reading height from colour) Tactile peg insertionTactile peg insertion IQA vs TID2013IQA vs TID2013 Yearly re-survey▶Yearly re-survey Video cubeVideo cube Tree ringsTree rings Worm-to-worm wiringWorm-to-worm wiring Independent verification and inspection scoring of public .zmx prescriptionsIndependent verification and inspection scoring of public .zmx prescriptions Industrial OCT (paint layers and hidden defects)Industrial OCT (paint layers and hidden defects) Peg symmetryPeg symmetry A fly's eye closing in on stripes▶A fly's eye closing in on stripes Symmetry repairSymmetry repair Periodic videoPeriodic video 3-D thermal field3-D thermal field Worm L/R symmetryWorm L/R symmetry Indirect ToF (wrapping, multipath)Indirect ToF (wrapping, multipath) Reproducible ICPReproducible ICP Calibrating pixel-shift offsets and aperture (undetermined map)Calibrating pixel-shift offsets and aperture (undetermined map) Livestock weight▶Livestock weight Ping-pong tracking▶Ping-pong tracking Height datumsHeight datums EM split/mergeEM split/merge Micrometre dents a photo cannot show, in a fringe mirror image (deflectometry)Micrometre dents a photo cannot show, in a fringe mirror image (deflectometry) Tactile calibrationTactile calibration Water and transparent media: ocean waves, pool refraction, colour under water, a bottle's causticWater and transparent media: ocean waves, pool refraction, colour under water, a bottle's caustic Pallet loadPallet load Kendama▶Kendama Real deep skyReal deep sky Wiring errorsWiring errors Pixel shift (false colour, aliasing)Pixel shift (false colour, aliasing) Calibrating a thin-film model to real images (determined coefficients vs combinations)Calibrating a thin-film model to real images (determined coefficients vs combinations) Photographing a 3-D scene through the actual lens prescription: depth of field, cat's-eye bokeh, corner illumination, colour fringes, ghostsPhotographing a 3-D scene through the actual lens prescription: depth of field, cat's-eye bokeh, corner illumination, colour fringes, ghosts Endless zoomEndless zoom Diabolo▶Diabolo Sweep widthSweep width SWC skeletonsSWC skeletons TDI line scan and line-scan lensesTDI line scan and line-scan lenses How water looks in inspection images: pool-floor caustics, a bottle from the side, a wet plate, a hull under waterHow water looks in inspection images: pool-floor caustics, a bottle from the side, a wet plate, a hull under water 4-D with 3-D tools▶4-D with 3-D tools Swarm obstacleSwarm obstacle Two heights (real)Two heights (real) Neurite growthNeurite growth Virtual TEM (Thon rings and defocus)Virtual TEM (Thon rings and defocus) The venue buildings and asteroid Itokawa on one ruler: PLATEAU CityGML LOD2 as a meshThe venue buildings and asteroid Itokawa on one ruler: PLATEAU CityGML LOD2 as a mesh Gravitational lensGravitational lens Slime-mould mazeSlime-mould maze Thin-film thickness by spectral reflectometry (scored on public measured data, wafer colours)Thin-film thickness by spectral reflectometry (scored on public measured data, wafer colours) Mars rover slipMars rover slip Slime-mould transportSlime-mould transport Virtual SEM vs voltageVirtual SEM vs voltage Grading weed cover in rice paddiesGrading weed cover in rice paddies ERL vs VOIERL vs VOI Bone and glass in meat, separated with two X-ray energies (dual-energy X-ray)Bone and glass in meat, separated with two X-ray energies (dual-energy X-ray) Worm brain coreWorm brain core Grating interferometry (fibres, cracks and pores in the dark field)Grating interferometry (fibres, cracks and pores in the dark field) Synapses vs neuritesSynapses vs neurites Spectrometer and illumination (bandwidth and lamp structure)Spectrometer and illumination (bandwidth and lamp structure) The fly brain as 126k cell bodiesThe fly brain as 126k cell bodies Budget lens manufacturing tolerances by MTF, yield, and compensator travelBudget lens manufacturing tolerances by MTF, yield, and compensator travel A prescription-based plenoptic camera: raw microimages to refocusing and distanceA prescription-based plenoptic camera: raw microimages to refocusing and distance The same particles in scanning and transmission images▶The same particles in scanning and transmission images Indirect and direct time of flight on one 3-D scene: multipath, mixed pixels, pile-up and volume error▶Indirect and direct time of flight on one 3-D scene: multipath, mixed pixels, pile-up and volume error Omnidirectional inspection and stereo displayOmnidirectional inspection and stereo display

Article series (articles on Qiita)

A Metrology Museum on PaperA Metrology Museum on PaperEvery PoC with its own planted ground truth Table tennisTable tennisBounce and friction measured from video Autonomous drivingAutonomous drivingScored by theorems and second implementations Connectome (brain wiring)Connectome (brain wiring)A fly visual model on a body, measured Humanoid sports dayHumanoid sports dayA home sports day refereed by image processing

What it can do

97 topics, each with an explanation page (how to use it, and its limits) and runnable examples.

Find

Measure

Light and colour

Waves and signals

Reconstruct and correct

Build a workflow

Show

Draw

All 174 usage examples that are not PoCs

See everything

283 PoCs plus 5 robot demos. Open a group to load its thumbnails.

Robot eyes (Fullseye does the perceiving) (4)
Robot bodies (trained policies run inside Fullseye) (1)
Industrial inspection (50)
Dimensional and shape metrology (55)
3-D shape (20)
Geometry and calibration (19)
Image quality and restoration (24)
Colour and separation (17)
Time as 3-D (21)
Connectome and neurons (20)
Medical and biological (9)
Astronomy and environment (23)
Forensics and documents (5)
Autonomous driving (13)
Mathematical pictures (7)

What you see, and the measured number

Every number is measured against ground truth the PoC planted itself (closed form, analytic solution or published value); running the PoC prints the same value.

Inspection and appearance

3-D measurement and geometry

X-ray CT and volumes

Optics, interferometry, polarization

Thermal, acoustic, time series

Robotics and spatial perception

Table tennis and motion

Autonomous driving

Connectome and neurons

Robot eyes (Fullseye does the perceiving)

Mathematics made visible

What Fullseye is

A foundation that hands physics simulation (including sensing such as optical design and 3-D measurement) and classic image processing to an AI through MCP and RAG, lets it work out a combination for each task, and solves the task interactively while checking type consistency and evaluating against ground truth. Open source (Apache-2.0).

Try it (Python 3.11)
pip install fullseye
git clone https://github.com/furuse-kazufumi/fullseye
cd fullseye
python examples/poc_focus_stacking.py

The focus-stacking PoC runs in about 20 seconds and prints its numbers against ground truth and PASS. Figures go to out/figures/poc_focus_stacking/.

Links
Paper

Abstract (translated from Japanese): We propose Fullseye, an open-source foundation that builds image-inspection and 3-D measurement processing as chains of operators with declared input and output data types, evaluates it quantitatively against ground truth produced by physics and imaging simulation, and records the procedure, the evaluation and the failure conditions so they can be reused. It consists of about 3,000 typed operators, a check that rejects type mismatches before execution, multilingual operator search (RAG), and more than 200 proof-of-concept programs with ground truth. We report quantitative evaluation of representative examples and the distinction between synthetic, measured and real-hardware validation stages.