self-attention · GitHub Topics

#大语言模型#《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

机器学习深度学习 leedl-tutorial cnn reinforcement-learning transformer rnn Generative Adversarial Network pruning self-attention ChatGPT 教程 diffusion transfer-learning bert

Jupyter Notebook 15.25 k

2 天前

zhouhaoyi / Informer2020

#计算机科学#The GitHub repository for the paper "Informer" accepted by AAAI 2021.

深度学习 self-attention time-series PyTorch forecasting transformer

Python 5.99 k

2 个月前

cmhungsteve / Awesome-Transformer-Attention

#Awesome#An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

transformer attention-mechanism vision-transformer 深度学习 Awesome Lists transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models visual-transformer 机器视觉 papers attention-mechanisms self-attention vit detr transformers

4.88 k

1 年前

PetarV- / GAT

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

graph-attention-networks attention-mechanism self-attention Tensorflow neural-networks Python

Python 3.37 k

3 年前

Diego999 / pyGAT

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

graph-attention-networks attention-mechanism self-attention PyTorch neural-networks Python

Python 3.04 k

2 年前

gordicaleksa / pytorch-GAT

#计算机科学#My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...

gat graph-attention-networks attention-mechanism self-attention PyTorch Python attention pytorch-gat gat-tutorial 深度学习 pytorch-implementation Jupyter Notebook

Jupyter Notebook 2.55 k

3 年前

github / CodeSearchNet

#自然语言处理#Datasets, tools, and benchmarks for representation learning of code.

深度学习自然语言处理 programming-language-theory 机器学习 Tensorflow 数据集数据科学 machine-learning-on-source-code representation-learning neural-networks Python Open Data data cnn rnn self-attention bert

Jupyter Notebook 2.32 k

3 年前

microsoft / DeBERTa

The implementation of DeBERTa

bert 深度学习 representation-learning roberta language-model natural-language-understanding self-attention transformer-encoder

Python 2.1 k

2 年前

NVlabs / MambaVision

#计算机科学#[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

深度学习 foundation-models image-classification mamba self-attention vision-transformer visual-recognition huggingface-transformers transformers instance-segmentation object-detection semantic-segmentation

Python 1.48 k

5 天前

speedinghzl / CCNet

CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).

cityscape semantic-segmentation self-attention PyTorch scene-parsing segmentation

Python 1.46 k

4 年前

DirtyHarryLYL / Transformer-in-Vision

#计算机科学#Recent Transformer-based CV and related works.

transformer vision-transformers 机器视觉 self-attention multi-modal 深度学习 Bukkit

1.33 k

2 年前

The-AI-Summer / self-attention-cv

#计算机科学#Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

深度学习 transformer transformers self-attention attention-mechanism attention 机器学习人工智能

Python 1.21 k

4 年前

Separius / awesome-fast-attention

list of efficient attention modules

transformer attention Awesome Lists reformer longformer linformer multihead-attention self-attention attention-is-all-you-need transformer-network

Python 1.01 k

4 年前

brightmart / bert_language_understanding

#自然语言处理#Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

bert-model language-model attention-is-all-you-need transformer-encoder pre-training language-understanding text-classification document-classification self-attention transfer-learning 自然语言处理 question-answering textcnn fasttext

Python 966

6 年前

NVlabs / FasterViT

#计算机科学#[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention

ade20k Backbone.js 深度学习 pre-trained-model self-attention vision-transformer visual-recognition coco object-detection semantic-segmentation foundation-models image-classification

Python 856

3 个月前

xxxnell / how-do-vits-work

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

vision-transformer transformer self-attention PyTorch

Python 817

3 年前

prakashpandey9 / Text-Classification-Pytorch

Text classification using deep learning models in Pytorch

PyTorch text-classification sentiment-classification attention-model self-attention rnn-model glove

Python 814

7 年前

kaituoxu / Speech-Transformer

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

asr transformer end-to-end attention self-attention attention-is-all-you-need PyTorch

Python 791

2 年前

daiquocnguyen / Graph-Transformer

Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)

graph-representation-learning graph-neural-networks graph-embeddings self-attention transformer text-classification transformer-models graph-deep-learning

Python 671

3 年前

jayparks / transformer

A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"

self-attention attention-mechanism attention-is-all-you-need machine-translation

Python 557

5 年前