prathoshap GitHub avatar

sushrota-sanskrit-asr

prathoshap

Su-śrotā is a Sanskrit ASR system tuned for recitational and śāstric speech, paired with Vāgbodhinī, an interactive chant practice tool, and documented with transparent experiments including failures and a data flywheel that improved real-world performance.

Stars

48

7-day growth

No data

Forks

5

Open issues

1

License

No data

Last updated

2026-07-19

AI repository intelligence
FR-AI / ANALYSIS

Why it is worth attention

It provides a rare combination of scholar-grade ASR for Sanskrit, honest reporting of what did and did not work, and a live data flywheel that reduced in-the-wild CER from 24% to 15.6% using consented user data, all while being open-source and deployable.

Who it is for

  • Sanskrit scholars and students of śāstra
  • Chant practitioners and teachers
  • ASR researchers working on low-resource languages
  • Language technology developers building interactive tools

Use cases

  • Transcribing recitation and śāstra prose with high accuracy
  • Practicing chant with syllable-level feedback and metre-aware splitting
  • Collecting consented, tiered user data to continuously improve a shared ASR model
  • Evaluating ASR using sandhi-normalized WER to account for Sanskrit's word-boundary issues

Strengths

  • Achieves 6% CER on studio-recorded chant and ~15.6% CER on real-world audio
  • Transparently documents both successful and failed experiments, with detailed diagnostics
  • Introduces a sandhi-normalized WER metric that reveals half of Sanskrit WER is spacing
  • Provides live, any-script web tools (Vāgbodhinī and Su-śrotā) that feed a self-improving data flywheel

Considerations

  • Acoustic model shows saturation on clean studio audio; further improvements come mainly from task reformulation (verification vs. recognition)
  • Additional clean human labels did not improve CER and hurt WER due to spacing drift
  • Rule-based and post-correction approaches (segmenter, ByT5) were ineffective for productive sandhi

README quick start

Su-śrotā — Scholar-grade Sanskrit ASR & chant practice

Sanskrit speech recognition tuned for śāstric / recitational Sanskrit, plus Vāgbodhinī, an interactive chant-practice tool built on it. This repository documents the full set of experiments — including the ones that did not work, which were as instructive as the ones that did.

  • ASR model: IndicConformer-CTC (Sanskrit slice). "v5" is the studio-finetuned base (on HF); v11-ep3 is the current deployed model — v5 continued on real user data (see §5b).
  • Live tools: Vāgbodhinī (chant/prose tutor) and Su-śrotā (dictation/transcription) — both serve the same shared core ASR and both collect consented data that improves it.
  • Author: Prof. Prathosh A P, Indian Institute of Science, Bengaluru.

Headline result (§5b): the model was only saturated on clean studio audio. On real, in-the-wild user audio it had huge headroom (24% CER) — and a small batch of consented user recordings closed a third of it (24% → 16% CER, 86% → 34% WER) with no loss on the studio benchmarks. The data flywheel works.


1. Motivation

Off-the-shelf Sanskrit ASR is trained on conversational IndicVoices-style data and degrades badly on recitation and śāstra — dense compounds, sandhi, retroflex/aspirate contrasts, pitch, and long metrical utterances. The goal here was a model and tooling good enough for scholars: accurate on chant and prose, and useful as a practice aid rather than a transcription toy.

Two things shaped everything:

  1. Segmentation dominates Sanskrit WER. Word boundaries in Sanskrit are largely a writing convention (sandhi fuses words). Standard WER punishes boundary disagreements that are not errors. We therefore report a sandhi-normalized WER (SN-WER) alongside CER/WER.
  2. The acoustic model saturates. Past a point, adding data stops moving CER; the leverage moves to how you use the model (known-reference tasks, decoding, tooling), not how you train it.

2. Data & preprocessing

  • Recitation + śāstra prose corpora (Bhāgavata chant, Vedānta prose), a TTS-speaker slice, and a multi-scholar annotation set collected via a purpose-built web portal.
  • Content-only normalization: NFC, keep Devanāgarī letters + combining marks, dro

Description

Scholar-grade Sanskrit ASR (finetuned IndicConformer-CTC) + Vāgbodhinī metre-aware chant-practice tool

Related repositories

Similar projects matched by category, topics, and programming language.

lopopolo
Featured
lopopolo GitHub avatar

harness-engineering

Harness Engineering is a methodology for improving coding agent outputs by carefully crafting the environment around them—providing curated context, tools, and executable constraints that encode an organization’s nonfunctional requirements and cumulative lessons.

AI & Machine LearningAI Agents
2,390
slvDev
Featured
slvDev GitHub avatar

esp32-ai

A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.

AI & Machine LearningLarge Language Models
1,960
littledivy
Featured
littledivy GitHub avatar

mimic

mimic captures traffic from any iOS or web app and automatically generates a Python client library that lets you call the app's API like a regular library.

AI & Machine Learning
1,482