Bug#1064101: RFP: whisper.cpp -- automatic speech recognition

2024-02-17 Thread Petter Reinholdtsen


I have drafted a package in
https://salsa.debian.org/deeplearning-team/whisper.cpp.git >.

Still need lots of work.

-- 
Happy hacking
Petter Reinholdtsen



Bug#1064101: RFP: whisper.cpp -- automatic speech recognition

2024-02-17 Thread Petter Reinholdtsen


Package: wnpp
Severity: wishlist
X-Debbugs-Cc: debian...@lists.debian.org

* Package name: whisper.cpp
  Version : 1.5.4
  Upstream Author : Georgi Gerganov
* URL : https://github.com/ggerganov/whisper.cpp
* License : MIT
  Programming Lang: C++
  Description : Automatic speech recogniztion, port of OpenAI's Whisper 
model in C/C++

High-performance inference of OpenAI's Whisper automatic speech
recognition (ASR) model:

 * Plain C/C++ implementation without dependencies
 * Apple Silicon first-class citizen - optimized via ARM NEON, Accelerate 
framework, Metal and Core ML
 * AVX intrinsics support for x86 architectures
 * VSX intrinsics support for POWER architectures
 * Mixed F16 / F32 precision
 * 4-bit and 5-bit integer quantization support
 * Zero memory allocations at runtime
 * Support for CPU-only inference
 * Efficient GPU support for NVIDIA
 * Partial OpenCL GPU support via CLBlast
 * OpenVINO Support
 * C-style API

This package could be a good fit for maintainence by the Debian Deep
Learning Team.  It might need to go into non-free, as it to work need a
machine learning model trained on unknown content and without any easy
way to be reproduced using non-proprietary data sets.

This is an alternative implementation to the one requested in
https://bugs.debian.org/1034091 >.

-- 
Happy hacking
Petter Reinholdtsen