attention-mechanism · GitHub Topics

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

人工智能 attention-mechanism transformers 机器视觉 image-classification

Python 23.52 k

4 天前

BlinkDL / RWKV-LM

#大语言模型#RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN a...

attention-mechanism 深度学习 gpt gpt-2 gpt-3 language-model linear-attention lstm PyTorch rnn transformer transformers rwkv ChatGPT

Python 13.86 k

5 天前

brightmart / text_classification

#自然语言处理#all kinds of text classification models and more with deep learning

classification 自然语言处理 fasttext textcnn textrnn Tensorflow multi-label multi-class attention-mechanism text-classification convolutional-neural-networks sentence-classification

Python 7.93 k

2 年前

lucidrains / DALLE-pytorch

#计算机科学#Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

人工智能深度学习 attention-mechanism text-to-image transformers multi-modal

Python 5.62 k

1 年前

lucidrains / x-transformers

#计算机科学#A concise but complete full-attention transformer with a set of promising experimental features from various papers

人工智能深度学习 attention-mechanism transformers

Python 5.48 k

21 小时前

kyegomez / swarms

#大语言模型#The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

人工智能 attention-mechanism gpt4 langchain 机器学习 multi-modal-imaging multi-modality multimodal swarms transformer-models agents prompt-engineering prompt-toolkit prompting tree-of-thoughts ChatGPT gpt4all huggingface langchain-python

Python 5.07 k

15 小时前

cmhungsteve / Awesome-Transformer-Attention

#Awesome#An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

transformer attention-mechanism vision-transformer 深度学习 Awesome Lists transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models visual-transformer 机器视觉 papers attention-mechanisms self-attention vit detr transformers

4.91 k

1 年前

benedekrozemberczki / awesome-graph-classification

A collection of important graph embedding, classification and representation learning papers with implementations.

graph2vec classification-algorithm graph-kernels weisfeiler-lehman kernel-methods deep-graph-kernels netlsd graph-attention-model graph-attention-networks structural-attention attention-mechanism node2vec graph-embedding network-embedding node-embedding graph-representation-learning deepwalk graph-convolutional-networks

Python 4.79 k

2 年前

Kyubyong / transformer

A TensorFlow Implementation of the Transformer: Attention Is All You Need

attention-mechanism translation attention-is-all-you-need implementation transformer

Python 4.39 k

2 年前

PetarV- / GAT

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

graph-attention-networks attention-mechanism self-attention Tensorflow neural-networks Python

Python 3.4 k

3 年前

zzw922cn / awesome-speech-recognition-speech-synthesis-papers

#新手入门#Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)

automatic-speech-recognition papers 路线图 rnn cnn dnn attention-mechanism seq2seq timit-dataset tts language-model speaker-verification speech-recognition speech-synthesis 神经网络 diffusion-models singing-voice-synthesis voice-conversion

3.06 k

2 年前

Diego999 / pyGAT

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

graph-attention-networks attention-mechanism self-attention PyTorch neural-networks Python

Python 3.05 k

2 年前

sgrvinod / a-PyTorch-Tutorial-to-Image-Captioning

Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning

PyTorch pytorch-tutorial show-attend-and-tell image-captioning encoder-decoder attention-mechanism 机器视觉 mscoco

Python 2.86 k

3 年前

philipperemy / keras-attention

#计算机科学#Keras Attention Layer (Luong and Bahdanau scores).

Keras keras-neural-networks attention-mechanism attention-model 深度学习

Python 2.81 k

2 年前

gordicaleksa / pytorch-GAT

#计算机科学#My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...

gat graph-attention-networks attention-mechanism self-attention PyTorch Python attention pytorch-gat gat-tutorial 深度学习 pytorch-implementation Jupyter Notebook

Jupyter Notebook 2.57 k

3 年前