multimodal-learning · GitHub Topics

#自然语言处理#Reading list for research topics in multimodal machine learning

multimodal-learning 机器学习 representation-learning 自然语言处理机器视觉 speech-processing Robotics healthcare reading-list 深度学习 reinforcement-learning

6.5 k

10 个月前

mlfoundations / open_flamingo

#计算机科学#An open-source framework for training large multimodal models.

机器视觉深度学习 in-context-learning language-model multimodal-learning PyTorch flamingo

Python 3.95 k

10 个月前

KaiyangZhou / CoOp

Prompt Learning for Vision-Language Models (IJCV'22, CVPR'22)

foundation-models multimodal-learning prompt-learning

Python 1.98 k

1 年前

Eurus-Holmes / Awesome-Multimodal-Research

A curated list of Multimodal Related Research.

Awesome Lists multimodal-research multimodal-learning multimodal

Python 1.35 k

2 年前

AILab-CVC / UniRepLKNet

#计算机科学#[CVPR'24] UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition

architecture 人工智能 convolutional-neural-networks 深度学习 multimodal-learning

Python 997

8 个月前

PreferredAI / cornac

A Comparative Framework for Multimodal Recommender Systems

recommender-system recommendation-algorithms recommendation-engine matrix-factorization collaborative-filtering multimodal-learning recommendation-system multimodality

Python 960

2 个月前

ArrowLuo / CLIP4Clip

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

multimodal-learning multimodality multimodal search ranking retrieval-model retrieval activitynet clip

Python 953

1 年前

DmitryRyumin / ICCV-2023-Papers

#人脸识别#ICCV 2023 Papers: Discover cutting-edge research from ICCV 2023, the leading computer vision conference. Stay updated on the latest in computer vision and deep learning, with code included. ⭐ support ...

Python 953

9 个月前

declare-lab / multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

multimodal-deep-learning multimodal-learning multimodal-interactions

OpenEdge ABL 846

2 年前

HuaizhengZhang / Awsome-Deep-Learning-for-Video-Analysis

#计算机科学#Papers, code and datasets about deep learning and multi-modal learning for video analysis

深度学习 video-analysis Bukkit multimodal-learning 机器学习 video-classification

799

4 年前

richard-peng-xia / awesome-multimodal-in-medical-imaging

A collection of resources on applications of multi-modal learning in medical imaging.

Medical imaging multimodal-deep-learning multimodal-learning visual-question-answering large-language-models large-multimodal-models multimodal-large-language-models

760

11 天前

henghuiding / ReLA

[CVPR2023 Highlight] GRES: Generalized Referring Expression Segmentation

multimodal-learning referring-expression-comprehension referring-expression-segmentation vision-language-transformer cvpr2023

Python 702

2 年前

georgian-io / Multimodal-Toolkit

#自然语言处理#Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

huggingface-transformers transformer 自然语言处理 tabular-data multimodal-learning

Python 604

8 个月前

pliang279 / MultiBench

#自然语言处理#[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning

机器学习 multimodal-learning Robotics 自然语言处理机器视觉深度学习 healthcare representation-learning speech-processing

HTML 556

1 年前

sangminwoo / awesome-vision-and-language

#Awesome#A curated list of awesome vision and language resources (still under construction... stay tuned!)

Awesome Lists vision-and-language multimodal-learning

534

7 个月前

henghuiding / MeViS

[ICCV 2023] MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressions

multimodal-learning referring-expression-comprehension referring-expression-segmentation referring-video-object-segmentation video-understanding

Python 527

1 年前

subho406 / OmniNet

#自然语言处理#Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain

机器学习深度学习神经网络人工智能 transformer 自然语言处理 image-captioning video-recognition multitask-learning multimodal-learning

Python 512

5 年前

microsoft / XPretrain

#自然语言处理#Multi-modality pre-training

multimodal-learning pre-training multimedia 机器视觉自然语言处理

Python 495

1 年前

njustkmg / OMML

Multi-Modal learning toolkit based on PaddlePaddle and PyTorch, supporting multiple applications such as multi-modal classification, cross-modal retrieval and image caption.

multimodal multimodal-learning Python paddlepaddle PyTorch crossmodal-retrieval imagecaptioning classification

Python 475

2 年前

DmitryRyumin / ICASSP-2023-24-Papers

#人脸识别#ICASSP 2023-2024 Papers: A complete collection of influential and exciting research papers from the ICASSP 2023-24 conferences. Explore the latest advancements in acoustics, speech and signal processi...

asr denoising domain-adaptation face-recognition language-modeling self-supervised-learning semantic-segmentation signal-processing speech-recognition vad generative-models image-generation music-generation multimodal-learning

Python 472

1 个月前