AI Model Catalogue

A mini audio understanding model released in July 2025

A small audio understanding model released in July 2025

A small audio understanding model released in July 2025

A mini audio understanding model released in July 2025

Image-to-video generation with optional audio, multi-shot narrative support, and faster inference

Minimax Speech 2.8 HD focuses on high-fidelity audio generation with features like studio-grade quality, flexible emotion control, multilingual support, and voice cloning capabilities

Music generation

SAM-Audio is a foundation model for isolating any sound in audio using text

A foundation model for isolating any sound in audio using text, visual, or temporal prompts

Kling Video 3.0: Generate cinematic videos up to 15 seconds with multi-shot control, native audio, and improved consistency

Kling Video 3.0 Omni: Unified multimodal video generation with reference images, video editing, native audio, and multi-shot control

HeartMuLa: A Family of Open Sourced Music Foundation Models

Ace Step 1.5 open source music generation model

High-fidelity video generation with portrait support, audio-to-video, retake, and extend. Text, image, and audio-driven creation up to 4K at 50 FPS.

Lightning-fast video generation with portrait support, camera controls, and synchronized audio. Up to 20 seconds at 1080p, 4K at 50 FPS.

An extension of AiCoverGen, which provides several new features and improvements, enabling users to generate audio-related content using RVC with ease. Ideal for people who want to incorporate singing functionality into their AI assistant/chatbot/vtuber,

ByteDance's multimodal video generation model with native audio, multimodal reference inputs, and intelligent duration control.

Lo-fi hip-hop music generation with ACE-Step 1.5 + LoRA

Generate full-length songs or instrumentals from a text prompt, with optional auto-generated lyrics

Fast video generation with built-in draft mode for rapid creative iteration. Text-to-video, image-to-video, and audio-to-video in a single endpoint.

Fast video generation with text-to-video, image-to-video, and start-end-to-video modes. Up to 16 seconds at 1080p with synchronized audio.

High-fidelity video generation with text-to-video, image-to-video, and start-end-to-video modes. Up to 16 seconds at 1080p with synchronized audio.

Reimagine any song in a different style — change voice, instruments, genre, and arrangement while keeping the original melody

Google's cost-efficient video generation model with native audio, optimized for high-volume applications

Generate full-length songs with vocals, lyrics, and rich instrumentation from a text prompt

A faster variant of Seedance 2.0 for quicker video generation with multimodal inputs and native audio.