transformer-encoder · GitHub Topics

The implementation of DeBERTa

bert 深度学习 representation-learning roberta language-model natural-language-understanding self-attention transformer-encoder

Python 2.1 k

2 年前

VITA-Group / TransGAN

[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang

transformer transformer-encoder transformer-models Generative Adversarial Network PyTorch

Python 1.68 k

3 年前

brightmart / bert_language_understanding

#自然语言处理#Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

bert-model language-model attention-is-all-you-need transformer-encoder pre-training language-understanding text-classification document-classification self-attention transfer-learning 自然语言处理 question-answering textcnn fasttext

Python 966

6 年前

wgcban / ChangeFormer

#计算机科学#[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection

change-detection remote-sensing siamese-network transformer-encoder transformer-architecture attention-mechanism PyTorch 深度学习 satellite-imagery 气候变化

Python 490

1 年前

lilianweng / transformer-tensorflow

Implementation of Transformer Model in Tensorflow

Tensorflow transformer transformer-encoder

Python 469

2 年前

zhongkaifu / Seq2SeqSharp

#计算机科学#Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transfo...

seq2seq encoder-decoder 神经网络深度学习 lstm attention-model CUDA gpu tensor machine-translation transformer-encoder transformer sequence-to-sequence transformer-architecture translation Image text vision-transformer

C# 204

2 个月前

jackaduma / SecBERT

#自然语言处理#pretrained BERT model for cyber security text, learned CyberSecurity Knowledge

Cybersecurity 安全自然语言处理 bert 深度学习 attention transformers transformer-encoder cyber-security security-automation apt cyber-threat-intelligence threat-intelligence threat-hunting threat-detection threat-analysis

Python 181

2 年前

Vidhiwar / multimodule-ecg-classification

#计算机科学#Multi-module Recurrent Convolutional Neural Network with Transformer Encoder for ECG Arrhythmia Classification

transformer transformer-encoder PyTorch 深度学习 cnn lstm

Jupyter Notebook 106

4 年前

declare-lab / MIME

#自然语言处理#This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.

dialogue-systems conversational-bots 自然语言处理 transformer-encoder

Python 44

2 年前