Answer M1: tract loads both face graphs once their dims are pinned
Neither InsightFace export parses as shipped -- SCRFD fails at its input node, ArcFace at the first Conv -- which is the same wall dr-segment hit on YOLO's dynamic export. Both load cleanly with the input dims frozen, so the pure-Rust runtime holds for the face pipeline too. tools/fix-face-model-shapes.sh does the freezing, and exists so the artefact is reproducible rather than a binary someone once produced. It takes two forms because the two graphs need different ones: ArcFace's batch is a named dim_param, SCRFD's H and W are dynamic but unnamed. Also notes YuNet loading with no intervention, which matters for the licence question in faces.md 2.3. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
This commit is contained in:
Executable
+109
@@ -0,0 +1,109 @@
|
||||
#!/usr/bin/env bash
|
||||
# Freeze the input dimensions of the face models so tract can parse them.
|
||||
#
|
||||
# ./tools/fix-face-model-shapes.sh IN.onnx OUT.onnx --input NAME=1,3,640,640
|
||||
# ./tools/fix-face-model-shapes.sh IN.onnx OUT.onnx --dim NAME=1
|
||||
#
|
||||
# The two the face pipeline needs, verified 2026-08-26 (docs/faces.md §12 M1):
|
||||
#
|
||||
# ... det_500m.onnx scrfd_500m_640.onnx --input input.1=1,3,640,640
|
||||
# ... w600k_mbf.onnx arcface_mbf_b1.onnx --dim None=1
|
||||
#
|
||||
# ## Why this exists
|
||||
#
|
||||
# The InsightFace exports declare dynamic input dimensions — SCRFD's H and W,
|
||||
# ArcFace's batch N. **tract cannot parse either graph in that form**, failing
|
||||
# at the input node and at the first Conv respectively:
|
||||
#
|
||||
# scrfd_500m_bnkps.onnx Translating node #0 "input.1" Source ToTypedTranslator
|
||||
# arcface_w600k_mbf.onnx Failed analyse for node #139 "Conv_0" ConvHir
|
||||
#
|
||||
# Both load cleanly once the dims are pinned. This is the same wall dr-segment
|
||||
# hit, which is why `tools/export-seg-model.sh` passes `dynamic=False`; here we
|
||||
# cannot re-export from PyTorch, because the weights are InsightFace's and the
|
||||
# training code is not in the loop, so the dims are rewritten in the ONNX file
|
||||
# instead.
|
||||
#
|
||||
# `make_dynamic_shape_fixed` only edits the declared dimension; it does not
|
||||
# retrain, requantise, or change a single weight. The output is numerically the
|
||||
# same graph with one shape pinned. SCRFD's *outputs* were already static — the
|
||||
# export was made at 640 and only its input forgot to say so — which is why 640
|
||||
# is not a free choice here.
|
||||
#
|
||||
# ## Why it is a script and not a build step
|
||||
#
|
||||
# Same reason as the segmentation export: the model is not a build input
|
||||
# (docs/faces.md §2.2 — the weights are never committed, because InsightFace's
|
||||
# grant is non-commercial). This runs once, wherever the user's model lives,
|
||||
# and the app loads the result. It exists so the transformation is reproducible
|
||||
# rather than a binary someone once produced and nobody can regenerate.
|
||||
#
|
||||
# Requires `uv`. Everything else is fetched into a throwaway venv, in /var/tmp
|
||||
# rather than /tmp — /tmp here is a tmpfs, and onnxruntime is not small.
|
||||
set -euo pipefail
|
||||
|
||||
if [ "$#" -lt 4 ]; then
|
||||
sed -n '2,10p' "$0" >&2
|
||||
exit 2
|
||||
fi
|
||||
|
||||
IN="$1"; shift
|
||||
OUT="$1"; shift
|
||||
|
||||
[ -f "$IN" ] || { echo "no such model: $IN" >&2; exit 1; }
|
||||
|
||||
WORK="$(mktemp -d -p /var/tmp fix-face-shapes.XXXXXX)"
|
||||
trap 'rm -rf "${WORK}"' EXIT
|
||||
|
||||
echo "==> venv in ${WORK}"
|
||||
uv venv --python 3.12 "${WORK}/venv" >/dev/null
|
||||
VIRTUAL_ENV="${WORK}/venv" uv pip install --quiet onnx onnxruntime
|
||||
|
||||
# Two forms, because the two models need different ones — and which one a graph
|
||||
# needs is not a matter of taste:
|
||||
#
|
||||
# --dim NAME=VALUE for a *named* symbolic dimension.
|
||||
# --input NAME=D,D,D,D for a dimension that is dynamic but unnamed.
|
||||
#
|
||||
# ArcFace declares its batch as the literal dim_param "None", so `--dim` binds
|
||||
# it. SCRFD's H and W carry no dim_param at all, so there is no name to bind
|
||||
# and the whole input shape has to be restated. Reaching for `--dim` first and
|
||||
# getting a silent no-op is the half-hour worth skipping.
|
||||
CUR="$IN"
|
||||
STEP=0
|
||||
while [ "$#" -gt 0 ]; do
|
||||
FLAG="$1"; shift
|
||||
PAIR="${1:-}"; shift || true
|
||||
NAME="${PAIR%%=*}"
|
||||
VAL="${PAIR#*=}"
|
||||
STEP=$((STEP + 1))
|
||||
NEXT="${WORK}/step${STEP}.onnx"
|
||||
case "$FLAG" in
|
||||
--dim)
|
||||
echo "==> dim_param ${NAME} := ${VAL}"
|
||||
"${WORK}/venv/bin/python" -m onnxruntime.tools.make_dynamic_shape_fixed \
|
||||
--dim_param "${NAME}" --dim_value "${VAL}" "${CUR}" "${NEXT}"
|
||||
;;
|
||||
--input)
|
||||
echo "==> input ${NAME} := ${VAL}"
|
||||
"${WORK}/venv/bin/python" -m onnxruntime.tools.make_dynamic_shape_fixed \
|
||||
--input_name "${NAME}" --input_shape "${VAL}" "${CUR}" "${NEXT}"
|
||||
;;
|
||||
*)
|
||||
echo "unknown flag ${FLAG} (want --dim or --input)" >&2
|
||||
exit 2
|
||||
;;
|
||||
esac
|
||||
CUR="${NEXT}"
|
||||
done
|
||||
|
||||
cp "${CUR}" "${OUT}"
|
||||
echo "==> wrote ${OUT}"
|
||||
"${WORK}/venv/bin/python" - "$OUT" <<'PY'
|
||||
import sys, onnx
|
||||
m = onnx.load(sys.argv[1])
|
||||
for vi in list(m.graph.input) + list(m.graph.output):
|
||||
dims = [d.dim_value if d.HasField("dim_value") else (d.dim_param or "?")
|
||||
for d in vi.type.tensor_type.shape.dim]
|
||||
print(f" {vi.name:<24} {dims}")
|
||||
PY
|
||||
Reference in New Issue
Block a user