Skip to content

Case Study Final Review · 11 October 2026 · 2:00–6:00 PM · SRM KTR campus, in person

Final review — the complete case study

The case study concludes with the overall design, the justification for each choice, the results and their discussion, and the report. Since Review 2 the recogniser has learned from signers of another language: a supervised American Sign Language stage, measured over four seeds per recipe and distilled into one browser model, took the unseen signer past 0.50 in the graph the browser runs. The complete report is below.

Candidate
Mithunish Prabhakaran
Registration No.
RA2512049015065
Programme
M.Tech Artificial Intelligence, Department of Computational Intelligence, SRMIST (2025–2027)
Course
21CSC601T – Case Studies · School of Computing
Guide
Dr. S. Saravanan, Professor, Department of Computational Intelligence
Review
11 Oct 2026 · 2:00–6:00 PM · SRM KTR campus, in person
SDG alignment
SDG 10 — Reduced Inequalities (secondary: SDG 4 — Quality Education)
Deployed model
jepa-asl-b3 · 5.23 MB int8 · since 2 Oct 2026
Presentation
deck.kadal.cc/sanket-final
Contact
pmithunish@gmail.com
Case study report — final (81 pages)PDF — the same content as these pages, typeset for printing and approval records.

Deliverables

#DeliverableWhere it is answered
1Overall designReport Chapter 3 — the approach, data, requirements and architecture; Architecture
2Justification for the proposed systemReport Section 3.5 — each choice against its alternative, with the measurement that decided it
3Results and discussionReport Chapter 5 — lineage, transfer from ASL, the deployed model, sign by sign, negative results; Results
4Report submissionThe PDF above: 6 chapters, 26 figures, 26 tables, 7 algorithms, 49 references; appendices with code, a manuscript, screenshots, reproducibility and MoM
Figure 1The approach in five steps

How to read this. Read left to right: landmarks only; a self-supervised encoder learned without labels; transfer from ASL and targeted data; many models distilled into one; and a stranger test before anything ships. The bar underneath is the constraint that holds throughout — the same canonical landmarks in the browser, in training and in evaluation, and no video leaves the device.

Figure 1The approach in five steps

From Review 1 to the final review

ThreadReview 1 (30 Aug)Review 2 (27 Sep)Final (11 Oct)
Unseen signer (RKMVU-220)0.33180.5000 (jepa-x12)0.5136 with the app's mirror rule · int8 0.5091
Accuracy test (599 clips)0.14690.55090.5526 int8 · 0.5559 in the browser
Calibration error (ECE)—0.0560.039 (T = 0.804, cross-fitted)
Modelsupervised, 9.9 MB12 teachers → one student, 4.57 MB12 ASL-pretrained teachers → one student, 5.23 MB
Continuous signingsliding windowssliding windowssign by sign: word accuracy 0.230 → 0.498
Figure 2Learning ISL from ASL signers

How to read this. Left: Google's ISLR corpus — 94,477 ASL clips from 21 Deaf signers — streamed by byte range on a CPU task and canonicalised with the same rules as the Indian corpora. Right: the transfer recipes — a supervised ASL stage before the ISL fine-tune, an ASL auxiliary loss, the phonological head — and their distillation into the deployed model. Bottom: what was measured, four seeds per recipe.

Figure 2Learning ISL from ASL signers
Figure 3Model lineage, Review 0 to the final review

How to read this. Each browser model on the review timeline with its accuracy test (gate) and unseen-signer (RKMVU) numbers, in order but not to scale. The pink marker is the deployed jepa-asl-b3.

Figure 3Model lineage, Review 0 to the final review
Figure 4Sign by sign

How to read this. The webcam stream is split where both hands rest below the hip line; each span is resampled to 64 frames and classified once. Offline, on joined unseen-signer clips, word accuracy rose from 0.230 with sliding windows to 0.498, against a ceiling of 0.509 with the true boundaries.

Figure 4Sign by sign

Future scope

Figure 5Future scope

How to read this. Four next steps, from a signer study to continuous signing. Each is kept only if it beats the deployed model on the unseen signer.

Figure 5Future scope