✨✨Latest Advances on Multimodal Large Language Models
#安卓#Mobile-Agent: The Powerful Mobile Device Operation Assistant Family
#大语言模型#StarVector is a foundation model for SVG generation that transforms vectorization into a code generation task. Using a vision-language modeling architecture, StarVector processes both visual and textu...
#大语言模型#ModelScope-Agent: An agent framework connecting models in ModelScope with the world
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
[ICML 2024] Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs (RPG)
Seed1.5-VL, a vision-language foundation model designed to advance general-purpose multimodal understanding and reasoning, achieving state-of-the-art performance on 38 out of 60 public benchmarks.
#大语言模型#A family of lightweight multimodal models.
实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, supporting end-to-end voice solutions (GLM-4-Voice - THG) and cas...
A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
Speech, Language, Audio, Music Processing with Large Language Model
A collection of resources on applications of multi-modal learning in medical imaging.
LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
Large-Scale Visual Representation Model
Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey
#大语言模型#✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models
[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding