transformer-xl · GitHub Topics

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

conformer transformer cnn transformer-xl asr speech-recognition PyTorch convolution speech recognition

Python 1.04 k

1 年前

sail-sg / Adan

#计算机科学#Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

bert-model convnext 深度学习 fairseq optimizer resnet timm vit transformer-xl 人工智能 diffusion dreamfusion gpt2 PyTorch cuda-programming llm-training 大语言模型 moe

Python 792

8 天前

hirofumi0810 / neural_sp

End-to-end ASR/LM implementation with PyTorch

PyTorch speech-recognition automatic-speech-recognition asr ctc attention-mechanism attention seq2seq sequence-to-sequence speech language-model transformer language-modeling rnn-transducer transformer-xl streaming

Python 596

4 年前

pingpong-ai / xlnet-pytorch

An implementation of Google Brain's 2019 XLNet in PyTorch

xlnet-pytorch transformer-xl

Python 301

6 年前

MarcoMeter / episodic-transformer-memory-ppo

Clean baseline implementation of PPO using an episodic TransformerXL memory

PyTorch deep-reinforcement-learning ppo transformer proximal-policy-optimization policy-gradient actor-critic transformer-xl

Python 180

1 年前

rusiaaman / XLnet-gen

XLNet for generating language.

xlnet text language-model language-modeling language-generation gpt2 transformer-xl

Python 165

4 年前

MarcoMeter / endless-memory-gym

Challenging Memory-based Deep Reinforcement Learning Agents

benchmark deep-reinforcement-learning gru gym-environment lstm recurrence transformer transformer-xl

Python 100

8 个月前

asigalov61 / SuperPiano

#计算机科学#Absolutely amazing SOTA Google Colab (Jupyter) Notebooks for creating/training SOTA Music AI models and for generating music with Transformer technology (Google XLNet/Transformer-XL)

xlnet music-generation 人工智能 music-composition 机器学习 transformers transformer-xl fastai piano sota Awesome Lists pytorch-implementation music reformer

Jupyter Notebook 87

4 年前

CyberZHG / keras-transformer-xl

Transformer-XL with checkpoint loader

Keras transformer-xl

Python 68

3 年前

Separius / CudaRelativeAttention

custom cuda kernel for {2, 3}d relative attention with pytorch wrapper

CUDA PyTorch attention transformer-xl transformer

Python 43

5 年前

augustwester / transformer-xl

#自然语言处理#A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)

transformer transformer-xl PyTorch xlnet cross-attention 自然语言处理 self-attention

Python 37

2 年前

davidsvy / transformer-xl

#自然语言处理#Music and text generation with Transformer-XL.

transformer music-generation text-generation 自然语言处理 fraud transformer-xl

Python 35

5 年前

cyk1337 / Highway-Transformer

[ACL‘20] Highway Transformer: A Gated Transformer.

transformer-xl language-model PyTorch transformer

Python 32

4 年前

menghuanlater / Tianchi2020ChineseMedicineQuestionGeneration

2020 阿里云天池大数据竞赛-中医药文献问题生成挑战赛

PyTorch roberta bert transformer-xl sequence-to-sequence

Python 27

4 年前

StefanHeng / Symbolic-Music-Generation

#自然语言处理#Symbolic music generation taking inspiration from NLP and human composition process

自然语言处理 representation-learning music-generation MIDI transformer autoregressive-models transformer-xl reformer

Python 18

2 年前

EsterHlav / Quantitative-Comparison-NLP-Embeddings-from-GloVe-to-RoBERTa

#自然语言处理#Fair quantitative comparison of NLP embeddings from GloVe to RoBERTa with Sequential Bayesian Optimization fine-tuning using Flair and SentEval. Extension of HyperOpt library to log_b priors.

自然语言处理 embeddings word2vec glove bert roberta elmo bayesian-optimization seq2seq transformer transformer-xl hyperopt PyTorch

Jupyter Notebook 18

6 年前