Yellowfin hind · w32_fish1

Cephalopholis hemistiktos · Serranidae · 62% · medium reconstructed model: fair

Reviewer: artifact: bright sand-coloured patch baked into the belly, visible in the side views of the turntable

Where it comes from

Original video (longest visit, 37:12-37:32), the selected fish boxed

Tracking: real frame + crop + 3D render at the estimated pose, species overlay

3D and 4D model

loading 3D gaussians…

Interactive canonical 3D gaussians (drag to orbit, scroll to zoom). This is the rest pose shared by every frame; the 4D part is the per-frame bending / tail motion shown on the right.

4D: canonical model replaying the learned body bending and tail beat

3D turntable of the canonical model

Poster

Species

Yellowfin hind Cephalopholis hemistiktos Serranidae

62.2%

Redmouth grouper Aethaloperca rogaa Serranidae

13.4%

Broom filefish Amanses scopas Monacanthidae

5.8%

Slingjaw wrasse Epibulus insidiator Labridae

3.7%

African coris Coris cuvieri Labridae

3.6%

Family: Serranidae 80%, Labridae 8%, Monacanthidae 6% · agreement across crops 69% · 64 crops · bioclip-2.5 (hf-hub:imageomics/bioclip-2.5-vith14, open_clip, zero-shot)

Data and reconstruction

window	32:00 – 40:00
visits	12: 33:00-33:06, 33:38-33:54, 34:21-34:39, 34:50-35:09, 35:17-35:36, 35:38-35:40, 35:47-35:52, 36:06-36:32, 36:45-36:46, 36:49-36:50, 36:52-37:22, 38:06-39:58
frames (10 fps) detected / kept	2461 / 2172
valid poses (10 fps)	2440
frames with background plate	1743
median size	117.0 px
30 fps frames / valid poses	721 / 719
method	4D GS, fins + bending + tail (30 fps)
model shown	v1 (gs_final)
iterations	4000
gaussians	22914
training time	23 min
trainer validation PSNR full / masked	23.0 / 23.2 dB
trainer validation IoU vs SAM mask	0.884
near-fish band PSNR (fins)	21.5 dB
production status	done
visual note (curation)	brown grouper (same species as w48 fish1

Diagnostics

Held-out frames: real crop vs 4D render (composited over the plate)

Estimated pose: fitted ellipsoid + axes on crops

Frame cleaning: identity / occlusion over time

Frames down-weighted / dropped by the robust trainer

Downloads

point_cloud.ply (canonical 3D gaussians) · poses_refined.json · model.pt (incl. per-frame 4D params) · species.json

← all fish