AI Model Catalogue

Open-source whisper-large-v3-turbo model from openai — available for download and self-hosting on Hugging Face.

Open-source whisper-base model from openai — available for download and self-hosting on Hugging Face.

Open-source wav2vec2-large-xlsr-53-polish model from jonatasgrosman — available for download and self-hosting on Hugging Face.

Open-source Qwen3-ASR-1.7B model from qwen — available for download and self-hosting on Hugging Face.

Open-source wav2vec2-large-xlsr-53-chinese-zh-cn model from jonatasgrosman — available for download and self-hosting on Hugging Face.

Open-source speaker-diarization-3.1 model from pyannote — available for download and self-hosting on Hugging Face.

Open-source wav2vec2-large-xlsr-53-japanese model from jonatasgrosman — available for download and self-hosting on Hugging Face.

Open-source whisper-small model from openai — available for download and self-hosting on Hugging Face.

Open-source whisperkit-coreml model from argmaxinc — available for download and self-hosting on Hugging Face.

A small audio understanding model released in July 2025

A mini audio understanding model released in July 2025

A mini audio understanding model released in July 2025

A small audio understanding model released in July 2025

SAM-Audio is a foundation model for isolating any sound in audio using text

Image-to-video generation with optional audio, multi-shot narrative support, and faster inference

A foundation model for isolating any sound in audio using text, visual, or temporal prompts

Minimax Speech 2.8 HD focuses on high-fidelity audio generation with features like studio-grade quality, flexible emotion control, multilingual support, and voice cloning capabilities

Music generation

Kling Video 3.0: Generate cinematic videos up to 15 seconds with multi-shot control, native audio, and improved consistency

This lightweight, multimodal model excels at processing text, images, and audio inputs with fast response times and lower costs, making it ideal for developers and organizations building real-time conversational applications, content analysis tools, and interactive voice assistants where efficiency and affordability are priorities.

This multimodal model excels at processing and generating both text and audio, making it ideal for developers and applications requiring real-time voice interactions, transcription, audio analysis, and spoken responses without separate API calls.

This lightweight multimodal model excels at fast, cost-effective processing of text, images, and audio inputs, making it ideal for developers and organizations seeking to build real-time conversational AI applications and voice-enabled features with minimal latency and resource requirements.

I don't have information about a model called "gpt-audio-2025-08-28" in my training data, as my knowledge was last updated in April 2024 and this appears to be a future or non-existent model designation.

This lightweight audio-processing model excels at real-time speech recognition, transcription, and audio understanding tasks, making it ideal for developers building cost-effective voice applications and accessibility features with minimal latency requirements.

HeartMuLa: A Family of Open Sourced Music Foundation Models

Lightning-fast video generation with portrait support, camera controls, and synchronized audio. Up to 20 seconds at 1080p, 4K at 50 FPS.

Ace Step 1.5 open source music generation model

An extension of AiCoverGen, which provides several new features and improvements, enabling users to generate audio-related content using RVC with ease. Ideal for people who want to incorporate singing functionality into their AI assistant/chatbot/vtuber,