![]() Having such a lightweight implementation of the model allows to easily integrate it in different platforms and applications.Īs an example, here is a video of running the model on an iPhone 13 device - fully offline, on-device: whisper.objc whisper-iphone-13-mini-2.mp4 Transformer inference: whisper.h / whisper.cpp.The entire implementation of the model is contained in 2 source files: ![]() Partial GPU support for NVIDIA via cuBLAS.4-bit and 5-bit integer quantization support.VSX intrinsics support for POWER architectures.AVX intrinsics support for x86 architectures.Apple Silicon first-class citizen - optimized via ARM NEON, Accelerate framework, Metal and Core ML.Plain C/C++ implementation without dependencies.High-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model:
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |