Skip to content

Add Parakeet Bench command for transcription performance benchmarking#2

Merged
chand1012 merged 3 commits into
masterfrom
bench
Mar 15, 2026
Merged

Add Parakeet Bench command for transcription performance benchmarking#2
chand1012 merged 3 commits into
masterfrom
bench

Conversation

@chand1012

@chand1012 chand1012 commented Mar 15, 2026

Copy link
Copy Markdown
Owner

Summary

Adds a new parakeet-bench CLI tool for benchmarking transcription performance using real audio samples from the OpenSLR SLR81 test set. Includes download script and multi-threaded parallel processing.

Also updates .gitignore to exclude downloaded audio files and refactors code by moving transcription logic to dedicated module.

Key Changes

  • New binary: parakeet-bench.rs (~240 lines) - benchmarks transcription throughput with configurable parallel workers via rayon
  • Added script: download_samples.sh - automated download of ~2.5GB test audio from AWS S3 (OpenSLR SLR81)
  • Refactored code: Moved transcription logic from main.rs to dedicated src/audio.rs module
  • Updated dependencies in Cargo.toml and Cargo.lock
  • Added wav_files/ directory to .gitignore

- Create shared audio module (src/audio.rs) with decoding and resampling functions
- Add parakeet-bench binary that benchmarks WAV files against CPU performance
- Report realtime factor (e.g., 50x means 50 seconds of audio processed in 1 second)
- Include CPU information using sysinfo crate
- Sequential processing to accurately measure single-stream performance
@chand1012
chand1012 merged commit c103508 into master Mar 15, 2026
1 check passed
@chand1012
chand1012 deleted the bench branch March 15, 2026 01:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant