Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

Collections

Discover the best community collections!

Collections including paper arxiv:2407.01449

about 18 hours ago

EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameters

Paper • 2402.04252 • Published Feb 6, 2024 • 29
Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models

Paper • 2402.03749 • Published Feb 6, 2024 • 13
ScreenAI: A Vision-Language Model for UI and Infographics Understanding

Paper • 2402.04615 • Published Feb 7, 2024 • 44
EfficientViT-SAM: Accelerated Segment Anything Model Without Performance Loss

Paper • 2402.05008 • Published Feb 7, 2024 • 23

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

Paper • 2306.01116 • Published Jun 1, 2023 • 38
HuggingFaceFW/fineweb

Viewer • Updated Jul 11 • 52.5B • 311k • 2.32k
tiiuae/falcon-refinedweb

Viewer • Updated Jun 20, 2023 • 968M • 11.5k • 866
cerebras/SlimPajama-627B

Preview • Updated Jul 7, 2023 • 43.7k • 489

MIT Talk 31/10 Papers

NVLM: Open Frontier-Class Multimodal LLMs

Paper • 2409.11402 • Published Sep 17, 2024 • 75
BRAVE: Broadening the visual encoding of vision-language models

Paper • 2404.07204 • Published Apr 10, 2024 • 19
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models

Paper • 2403.18814 • Published Mar 27, 2024 • 48
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models

Paper • 2409.17146 • Published Sep 25, 2024 • 122

ColPali: Efficient Document Retrieval with Vision Language Models

Paper • 2407.01449 • Published Jun 27, 2024 • 51

ColPali: Efficient Document Retrieval with Vision Language Models

Paper • 2407.01449 • Published Jun 27, 2024 • 51

Vision Language Models: 2025 Update

This collection includes all the models, datasets and Spaces mentioned in the blog Vision Language Models: 2025 Update

Qwen/Qwen2.5-Omni-7B

Any-to-Any • 11B • Updated Apr 30 • 128k • 1.75k
Running

338

338

Qwen2.5 Omni 7B Demo

🏆

Generate text and speech responses from various inputs
Qwen2.5-Omni Technical Report

Paper • 2503.20215 • Published Mar 26 • 165
openbmb/MiniCPM-o-2_6

Any-to-Any • 9B • Updated Jun 20 • 175k • 1.22k

Save it, later read

CompCap: Improving Multimodal Large Language Models with Composite Captions

Paper • 2412.05243 • Published Dec 6, 2024 • 19
GraPE: A Generate-Plan-Edit Framework for Compositional T2I Synthesis

Paper • 2412.06089 • Published Dec 8, 2024 • 4
SILMM: Self-Improving Large Multimodal Models for Compositional Text-to-Image Generation

Paper • 2412.05818 • Published Dec 8, 2024 • 1
FLAIR: VLM with Fine-grained Language-informed Image Representations

Paper • 2412.03561 • Published Dec 4, 2024 • 2

OCR+alternatives

ColPali: Efficient Document Retrieval with Vision Language Models

Paper • 2407.01449 • Published Jun 27, 2024 • 51

Vision Language Models (VLMs)

ColPali: Efficient Document Retrieval with Vision Language Models

Paper • 2407.01449 • Published Jun 27, 2024 • 51

Awesome Visual Embedding

RhapsodyAI/MiniCPM-V-Embedding-preview

Feature Extraction • Updated Aug 20, 2024 • 91 • 52
vidore/colidefics

Updated Jul 11, 2024 • 3
vidore/colpali

Visual Document Retrieval • Updated Jun 27 • 7.36k • 456
Unifying Multimodal Retrieval via Document Screenshot Embedding

Paper • 2406.11251 • Published Jun 17, 2024 • 10

about 18 hours ago

EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameters

Paper • 2402.04252 • Published Feb 6, 2024 • 29
Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models

Paper • 2402.03749 • Published Feb 6, 2024 • 13
ScreenAI: A Vision-Language Model for UI and Infographics Understanding

Paper • 2402.04615 • Published Feb 7, 2024 • 44
EfficientViT-SAM: Accelerated Segment Anything Model Without Performance Loss

Paper • 2402.05008 • Published Feb 7, 2024 • 23

Vision Language Models: 2025 Update

This collection includes all the models, datasets and Spaces mentioned in the blog Vision Language Models: 2025 Update

Qwen/Qwen2.5-Omni-7B

Any-to-Any • 11B • Updated Apr 30 • 128k • 1.75k
Running

338

338

Qwen2.5 Omni 7B Demo

🏆

Generate text and speech responses from various inputs
Qwen2.5-Omni Technical Report

Paper • 2503.20215 • Published Mar 26 • 165
openbmb/MiniCPM-o-2_6

Any-to-Any • 9B • Updated Jun 20 • 175k • 1.22k

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

Paper • 2306.01116 • Published Jun 1, 2023 • 38
HuggingFaceFW/fineweb

Viewer • Updated Jul 11 • 52.5B • 311k • 2.32k
tiiuae/falcon-refinedweb

Viewer • Updated Jun 20, 2023 • 968M • 11.5k • 866
cerebras/SlimPajama-627B

Preview • Updated Jul 7, 2023 • 43.7k • 489

Save it, later read

CompCap: Improving Multimodal Large Language Models with Composite Captions

Paper • 2412.05243 • Published Dec 6, 2024 • 19
GraPE: A Generate-Plan-Edit Framework for Compositional T2I Synthesis

Paper • 2412.06089 • Published Dec 8, 2024 • 4
SILMM: Self-Improving Large Multimodal Models for Compositional Text-to-Image Generation

Paper • 2412.05818 • Published Dec 8, 2024 • 1
FLAIR: VLM with Fine-grained Language-informed Image Representations

Paper • 2412.03561 • Published Dec 4, 2024 • 2

MIT Talk 31/10 Papers

NVLM: Open Frontier-Class Multimodal LLMs

Paper • 2409.11402 • Published Sep 17, 2024 • 75
BRAVE: Broadening the visual encoding of vision-language models

Paper • 2404.07204 • Published Apr 10, 2024 • 19
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models

Paper • 2403.18814 • Published Mar 27, 2024 • 48
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models

Paper • 2409.17146 • Published Sep 25, 2024 • 122

OCR+alternatives

ColPali: Efficient Document Retrieval with Vision Language Models

Paper • 2407.01449 • Published Jun 27, 2024 • 51

ColPali: Efficient Document Retrieval with Vision Language Models

Paper • 2407.01449 • Published Jun 27, 2024 • 51

Vision Language Models (VLMs)

ColPali: Efficient Document Retrieval with Vision Language Models

Paper • 2407.01449 • Published Jun 27, 2024 • 51

ColPali: Efficient Document Retrieval with Vision Language Models

Paper • 2407.01449 • Published Jun 27, 2024 • 51

Awesome Visual Embedding

RhapsodyAI/MiniCPM-V-Embedding-preview

Feature Extraction • Updated Aug 20, 2024 • 91 • 52
vidore/colidefics

Updated Jul 11, 2024 • 3
vidore/colpali

Visual Document Retrieval • Updated Jun 27 • 7.36k • 456
Unifying Multimodal Retrieval via Document Screenshot Embedding

Paper • 2406.11251 • Published Jun 17, 2024 • 10

Previous
1
2
Next

Company

TOS Privacy About Jobs

Website

Models Datasets Spaces Pricing Docs