myshell-ai/OpenVoice
Text-to-Speech
•
Updated
•
458
AV LLMs
A collection of Audio, Video and Visual LLMs.
-
-
1.07k
OpenVoice
🤗 -
dataautogpt3/ProteusV0.3
Text-to-Image • Updated • 107k • 93 -
ByteDance/SDXL-Lightning
Text-to-Image • Updated • 76.9k • • 2.04k -
openai/whisper-large-v3
Automatic Speech Recognition • Updated • 3.97M • • 4.47k -
stabilityai/TripoSR
Image-to-3D • Updated • 9.08k • 550 -
Efficient-Large-Model/VILA-7b
Text Generation • Updated • 162 • 26 -
google/paligemma-3b-pt-896
Image-Text-to-Text • Updated • 1.18k • 118 -
microsoft/Phi-3-vision-128k-instruct
Text Generation • Updated • 18.3k • 959 -
stabilityai/stable-audio-open-1.0
Text-to-Audio • Updated • 40.3k • 1.22k -
OpenVLA: An Open-Source Vision-Language-Action Model
Paper • 2406.09246 • Published • 40 -
aiola/whisper-medusa-v1
Updated • 108 • 178 -
merve/idefics3llama-vqav2
Updated • 8 -
black-forest-labs/FLUX.1-schnell
Text-to-Image • Updated • 1.08M • • 3.89k -
115
Llama3.1 S V0.2 Checkpoint 2024 08 20
😻Convert text to audio and vice versa
-
gpt-omni/mini-omni
Text-to-Speech • Updated • 2 • 429 -
fishaudio/fish-speech-1.4
Text-to-Speech • Updated • 463 • 451 -
178
Tonic's GOT OCR
📲GOT - OCR (from : UCAS, Beijing)
-
stepfun-ai/GOT-OCR2_0
Image-Text-to-Text • Updated • 150k • 1.48k -
apple/coreml-sam2-large
Mask Generation • Updated • 55 • 27 -
coreml-projects/sam-2-studio
Updated • 25 -
mistralai/Pixtral-12B-2409
Image-Text-to-Text • Updated • • 645 -
allenai/Molmo-72B-0924
Image-Text-to-Text • Updated • 1.7k • 284 -
openai/whisper-large-v3-turbo
Automatic Speech Recognition • Updated • 3.47M • • 2.41k -
Revai/reverb-asr
Automatic Speech Recognition • Updated • 12 • 84 -
360
GOT Online
💬Extract text from images using various OCR modes
-
facebook/vfusion3d
Image-to-3D • Updated • 100 • 66 -
facebook/cotracker
Updated • 961 • 35 -
rhymes-ai/Aria
Image-Text-to-Text • Updated • 23.6k • 630 -
SWivid/F5-TTS
Text-to-Speech • Updated • 1.03M • 1.04k -
64
Ichigo Llama3.1 S Instruct
🏢Generate text from audio recordings
-
kyutai/moshiko-mlx-q4
Updated • 231 • 28 -
kyutai/moshiko-mlx-q8
Updated • 152 • 5 -
109
Open VLM Video Leaderboard
🌎VLMEvalKit Eval Results in video understanding benchmark
-
jimmycarter/LibreFLUX
Text-to-Image • Updated • 100 • 165 -
microsoft/OmniParser
Image-Text-to-Text • Updated • 643 • 1.67k -
318
Aya Models
🌍Interact with the Aya family of models.
-
CohereLabs/aya-expanse-32b
Text Generation • Updated • 10.2k • • 255 -
stabilityai/stable-diffusion-3.5-medium
Text-to-Image • Updated • 240k • • 745 -
OuteAI/OuteTTS-0.1-350M
Text-to-Speech • Updated • 576 • 301 -
vidore/colpali
Visual Document Retrieval • Updated • 82.1k • 440 -
vidore/colpali-v1.2
Visual Document Retrieval • Updated • 72k • 109 -
si-pbc/hertz-dev
Audio-to-Audio • Updated • 213 -
38
Talk To Ultravox
⚡Talk to Fixie.ai's Ultravox with WebRTC ⚡️
-
LLaVA-o1: Let Vision Language Models Reason Step-by-Step
Paper • 2411.10440 • Published • 125 -
Xkev/Llama-3.2V-11B-cot
Image-Text-to-Text • Updated • 6.14k • 153 -
google/paligemma-3b-pt-224
Image-Text-to-Text • Updated • 38.2k • 328 -
apple/coreml-mobileclip
Updated • 230 • 43 -
InstantX/InstantIR
Image-to-Image • Updated • 174 -
86
InstantIR
🖼diffusion-based Image Restoration model
-
157
Flux IP Adapter
🖼Prompt with Images in flux[dev]
-
38
Image Preferences - Argilla annotation space
🖼A community project to create an image preferences dataset.
-
fishaudio/fish-speech-1.5
Text-to-Speech • Updated • 6.98k • 584 -
meta-llama/Llama-3.3-70B-Instruct
Text Generation • Updated • 910k • • 2.35k -
48
Paligemma2 Vqav2
🐨PaliGemma2 LoRA finetuned on VQAv2
-
VisionZip: Longer is Better but Not Necessary in Vision Language Models
Paper • 2412.04467 • Published • 111 -
fancyfeast/llama-joycaption-alpha-two-hf-llava
Updated • 20.4k • 183 -
taohu/mask
Updated • 5 -
[MASK] is All You Need
Paper • 2412.06787 • Published • 2 -
780
Open VLM Leaderboard
🌎VLMEvalKit Evaluation Results Collection
-
microsoft/LLM2CLIP-Llama3.2-1B-EVA02-L-14-336
Zero-Shot Image Classification • Updated • 10 -
LLM2CLIP: Powerful Language Model Unlock Richer Visual Representation
Paper • 2411.04997 • Published • 40 -
Generative Powers of Ten
Paper • 2312.02149 • Published • 8 -
25
StoryStar
💬Fantasy story generator
-
GoodiesHere/Apollo-LMMs-Apollo-7B-t32
Video-Text-to-Text • Updated • 34 • 55 -
Apollo: An Exploration of Video Understanding in Large Multimodal Models
Paper • 2412.10360 • Published • 146 -
Qwen/Qwen2-VL-7B-Instruct
Image-Text-to-Text • Updated • 1.32M • • 1.19k -
XiaoduoAILab/Xmodel_VLM
Text Generation • Updated • 101 • 12 -
nvidia/Cosmos-1.0-Diffusion-14B-Text2World
Updated • 2.2k • 59 -
nvidia/Cosmos-1.0-Autoregressive-12B
Updated • 64 • 30 -
nvidia/Cosmos-1.0-Autoregressive-13B-Video2World
Updated • 57 • 31 -
nvidia/Cosmos-1.0-Diffusion-7B-Text2World
Text-to-Video • Updated • 8.33k • 221 -
nvidia/Cosmos-1.0-Diffusion-14B-Video2World
Updated • 2.76k • 56 -
432
Stable Point-Aware 3D
⚡Generate 3D models from single images
-
hexgrad/Kokoro-82M
Text-to-Speech • Updated • 1.85M • • 4.47k -
2.67k
Kokoro TTS
❤Upgraded to v1.0!
-
openbmb/MiniCPM-o-2_6
Any-to-Any • Updated • 267k • 1.15k -
377
TTS Spaces Arena
🤗Blind vote on HF TTS models!
-
google/paligemma2-10b-pt-896
Image-Text-to-Text • Updated • 481 • 31 -
NovaSky-AI/Sky-T1-32B-Preview
Text Generation • Updated • 2.49k • • 545 -
MiniMaxAI/MiniMax-VL-01
Image-Text-to-Text • Updated • 27.1k • 260 -
63
SmolVLM
📊Generate descriptions from images and text prompts
-
HKUSTAudio/Llasa-3B
Text-to-Speech • Updated • 3.32k • 501 -
HuggingFaceTB/SmolVLM-500M-Instruct
Image-Text-to-Text • Updated • 39.7k • 152 -
deepseek-ai/Janus-Pro-7B
Any-to-Any • Updated • 98k • 3.4k -
285
Kokoro TTS Zero
🎴✨[With v1.0.0] Accelerated TTS on Kokoro-82M
-
kyutai/hibiki-2b-mlx-bf16
Translation • Updated • 10 • 19 -
kyutai/hibiki-2b-pytorch-bf16
Translation • Updated • 143 • 54 -
ARTPARK-IISc/Vaani
Viewer • Updated • 14.9M • 2.25k • 58 -
Zyphra/Zonos-v0.1-hybrid
Text-to-Speech • Updated • 12.8k • 1.08k -
Zyphra/Zonos-v0.1-transformer
Text-to-Speech • Updated • 60.2k • 400 -
microsoft/OmniParser-v2.0
Updated • 1.76k • 1.26k -
90
Paligemma2 Mix
🌖Generate text or segment objects from an image
-
google/paligemma2-3b-mix-448
Image-Text-to-Text • Updated • 8.21k • 44 -
google/paligemma2-3b-mix-224
Image-Text-to-Text • Updated • 11.7k • 32 -
google/paligemma2-28b-mix-224
Image-Text-to-Text • Updated • 1.32k • 4 -
google/paligemma2-28b-mix-448
Image-Text-to-Text • Updated • 527 • 26 -
google/paligemma2-10b-mix-224
Image-Text-to-Text • Updated • 1.35k • 9 -
google/paligemma2-10b-mix-448
Image-Text-to-Text • Updated • 20k • 28 -
stepfun-ai/stepvideo-t2v
Text-to-Video • Updated • 261 • 465 -
stepfun-ai/stepvideo-t2v-turbo
Updated • 93 -
Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Model
Paper • 2502.10248 • Published • 56 -
HuggingFaceTB/SmolVLM2-2.2B-Instruct
Image-Text-to-Text • Updated • 67.1k • 197 -
nvidia/canary-1b
Automatic Speech Recognition • Updated • 15.7k • 428 -
Wan-AI/Wan2.1-I2V-14B-720P
Image-to-Video • Updated • 34.4k • 480 -
fastrtc/kokoro-onnx
Updated • 10 -
2
Fastphone
🐠Download and run an app from a Hugging Face repository
-
microsoft/Phi-4-multimodal-instruct
Automatic Speech Recognition • Updated • 480k • 1.41k -
microsoft/Magma-8B
Image-Text-to-Text • Updated • 4.45k • 397 -
37
Magma UI
📚Magma-8B model for UI Agents
-
596
Di♪♪Rhythm
🎶Blazingly Fast and Embarrassingly Simple Song Generation
-
DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion
Paper • 2503.01183 • Published • 28 -
ASLP-lab/DiffRhythm-vae
Updated • 41 -
ASLP-lab/DiffRhythm-base
Updated • 87 • 165 -
Large Language Diffusion Models
Paper • 2502.09992 • Published • 120 -
GSAI-ML/LLaDA-8B-Instruct
Text Generation • Updated • 78k • 288 -
unsloth/gemma-3-12b-pt
Image-Text-to-Text • Updated • 758 • 4 -
google/gemma-3-27b-it
Image-Text-to-Text • Updated • 404k • • 1.42k -
sesame/csm-1b
Text-to-Speech • Updated • 45.7k • 2.08k -
unsloth/gemma-3-27b-it-GGUF
Image-Text-to-Text • Updated • 49.1k • 128 -
ds4sd/SmolDocling-256M-preview
Image-Text-to-Text • Updated • 324k • 1.41k -
starvector/starvector-8b-im2svg
Text Generation • Updated • 5.48k • 475 -
starvector/starvector-1b-im2svg
Text Generation • Updated • 2.85k • 167 -
Tokenize Image as a Set
Paper • 2503.16425 • Published • 16 -
kyutai/moshika-vis-pytorch-bf16
Updated • 56 -
kyutai/Babillage
Viewer • Updated • 465k • 217 • 9 -
ByteDance/InfiniteYou
Text-to-Image • Updated • 14.2k • 604 -
InfiniteYou: Flexible Photo Recrafting While Preserving Your Identity
Paper • 2503.16418 • Published • 35 -
openfree/flux-chatgpt-ghibli-lora
Text-to-Image • Updated • 2.55k • • 306 -
Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources
Paper • 2504.00595 • Published • 36 -
weizhiwang/Open-Qwen2VL
Image-Text-to-Text • Updated • 68 • 17 -
ostris/Flex.1-alpha-Redux
Text-to-Image • Updated • 3.82k • 102 -
unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 2.65k • 78 -
unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-8bit
Image-Text-to-Text • Updated • 554 • 9 -
SmolVLM: Redefining small and efficient multimodal models
Paper • 2504.05299 • Published • 188 -
canopylabs/3b-hi-ft-research_release
Text-to-Speech • Updated • 327 • 19 -
canopylabs/3b-es_it-ft-research_release
Text-to-Speech • Updated • 1.27k • 14 -
nvidia/C-RADIOv2-g
Image Feature Extraction • Updated • 726 • 13 -
InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models
Paper • 2504.10479 • Published • 268 -
OpenGVLab/InternVL3-1B
Image-Text-to-Text • Updated • 69k • 61 -
OpenGVLab/InternVL3-78B
Image-Text-to-Text • Updated • 1.19M • 187 -
InteractVLM: 3D Interaction Reasoning from 2D Foundational Models
Paper • 2504.05303 • Published • 5 -
1.48k
Dia 1.6B
👯Generate realistic dialogue from a script, using Dia!
-
nari-labs/Dia-1.6B
Text-to-Speech • Updated • 166k • • 2.51k -
Describe Anything: Detailed Localized Image and Video Captioning
Paper • 2504.16072 • Published • 60 -
nvidia/DAM-3B-Self-Contained
Image-Text-to-Text • Updated • 4.78k • 21 -
nvidia/DAM-3B-Video
Image-Text-to-Text • Updated • 4.9k • 53 -
nvidia/DAM-3B
Image-Text-to-Text • Updated • 6.38k • 123 -
Qwen/Qwen2.5-Omni-3B
Any-to-Any • Updated • 78.8k • 235 -
MMaDA: Multimodal Large Diffusion Language Models
Paper • 2505.15809 • Published • 85 -
One RL to See Them All: Visual Triple Unified Reinforcement Learning
Paper • 2505.18129 • Published • 59 -
56
PlayDiffusion
🎨Generate audio modifications and speech
-
lerobot/smolvla_base
Robotics • Updated • 1.57k • 93 -
stockmark/Stockmark-2-VL-100B-beta
Image-Text-to-Text • Updated • 323 • 15
