Blacktip grouper · w40_fish5

Epinephelus fasciatus · Serranidae · 62% · low reconstructed model: fair species doubtful
Reviewer: slender, pointed snout; runners-up are wrasses

Where it comes from

Original video (longest visit, 43:06-43:16), the selected fish boxed
Tracking: real frame + crop + 3D render at the estimated pose, species overlay

3D and 4D model

loading 3D gaussians…
Interactive canonical 3D gaussians (drag to orbit, scroll to zoom). This is the rest pose shared by every frame; the 4D part is the per-frame bending / tail motion shown on the right.
4D: canonical model replaying the learned body bending and tail beat
3D turntable of the canonical model

Poster

poster

Species

Blacktip grouper Epinephelus fasciatus Serranidae
62.4%
Cheeklined wrasse Oxycheilinus digramma Labridae
9.6%
Sixline wrasse Pseudocheilinus hexataenia Labridae
5.8%
Sixbar thicklip wrasse Hemigymnus sexfasciatus Labridae
5.8%
Redbarred parrotfish Scarus caudofasciatus Scaridae
4.4%

Family: Serranidae 63%, Labridae 28%, Scaridae 6% · agreement across crops 67% · 64 crops · bioclip-2.5 (hf-hub:imageomics/bioclip-2.5-vith14, open_clip, zero-shot)

Crops used for the species vote

Data and reconstruction

window40:00 – 48:00
visits14: 41:25-41:26, 41:42-41:44, 42:01-42:05, 42:20-42:21, 42:47-42:50, 42:55-42:58, 43:05-43:14, 45:02-45:07, 45:18-45:25, 45:37-45:38, 45:40-45:45, 46:08-46:10, 46:14-46:16, 46:55-46:56
frames (10 fps) detected / kept455 / 393
valid poses (10 fps)394
frames with background plate363
median size100.0 px
30 fps frames / valid poses722 / 528
method4D GS, fins + bending + tail (30 fps)
model shownv1 (gs_final)
iterations4000
gaussians18632
training time22 min
trainer validation PSNR full / masked26.7 / 22.2 dB
trainer validation IoU vs SAM mask0.886
near-fish band PSNR (fins)27.0 dB
production statusdone
visual note (curation)brown barred wrasse/goatfish-like

Diagnostics

Tracklet contact sheet (selection)
Held-out frames: real crop vs 4D render (composited over the plate)
Held-out frames: render on black
Estimated pose: fitted ellipsoid + axes on crops
Frame cleaning: identity / occlusion over time
Frames down-weighted / dropped by the robust trainer

Downloads

point_cloud.ply (canonical 3D gaussians) · poses_refined.json · model.pt (incl. per-frame 4D params) · species.json

← all fish