gpt-2 · GitHub Topics

#大语言模型#RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN a...

attention-mechanism 深度学习 gpt gpt-2 gpt-3 language-model linear-attention lstm PyTorch rnn transformer transformers rwkv ChatGPT

Python 13.85 k

4 天前

microsoft / LoRA

#计算机科学#Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

gpt-2 adaptation language-model gpt-3 low-rank PyTorch 深度学习 roberta deberta lora

Python 12.45 k

7 个月前

NielsRogge / Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.

transformers PyTorch bert vision-transformer layoutlm gpt-2

Jupyter Notebook 11.13 k

1 个月前

codota / TabNine

AI Code Completions

人工智能 gpt-2 VS Code Extension sublime-package vim-plugin JavaScript TypeScript Rust C++Ruby Java Python Go Lua Bash Swift PHP Atom

Shell 10.79 k

3 个月前

FoundationVision / VAR

[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An...

auto-regressive-model diffusion-models image-generation transformers autoregressive-models generative-ai generative-model gpt gpt-2 large-language-models vision-transformer neurips

Jupyter Notebook 8.33 k

2 个月前

EleutherAI / gpt-neo

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

language-model transformers gpt gpt-2 gpt-3

Python 8.3 k

3 年前

Morizeyao / GPT2-Chinese

#自然语言处理#Chinese version of GPT2 training code, using BERT tokenizer.

transformer gpt-2 中文自然语言处理 text-generation

Python 7.58 k

1 年前

lonePatient / awesome-pretrained-chinese-nlp-models

#自然语言处理#Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

中文自然语言处理 pretrained-models bert roberta xlnet nezha ernie gpt gpt-2 dataset 大语言模型 large-language-models

Python 5.34 k

17 天前

jaymody / picoGPT

#自然语言处理#An unnecessarily tiny implementation of GPT-2 in NumPy.

深度学习 gpt gpt-2 large-language-models 机器学习神经网络 Python 自然语言处理

Python 3.4 k

2 年前

dbiir / UER-py

#自然语言处理#Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

bert pre-training fine-tuning gpt 中文自然语言处理 PyTorch elmo classification ner t5 unilm roberta albert gpt-2 model-zoo bart xlm-roberta

Python 3.07 k

1 年前

yangjianxin1 / GPT2-chitchat

#自然语言处理#GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)

transformer gpt2 gpt-2 chichat 自然语言处理 text-generation dialogue-model dialogpt

Python 3.02 k

2 年前

guillaume-be / rust-bert

#自然语言处理#Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

深度学习自然语言处理 transformer bert Rust 机器学习 ner sentiment-analysis question-answering language-generation gpt-2 roberta gpt bart electra translation

Rust 2.91 k

2 个月前

stochasticai / xTuring

#大语言模型#Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJ...

深度学习 fine-tuning gpt-2 gpt-j llama 大语言模型 lora language-model alpaca finetuning adapter gen-ai generative-ai mistral peft quantization

Python 2.66 k

10 个月前

microsoft / DialoGPT

#计算机科学#Large-scale pretraining for dialogue

dialogue 机器学习 PyTorch transformer text-generation dialogpt gpt-2 text-data data-processing

Python 2.4 k

3 年前

asyml / texar

#自然语言处理#Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/

机器学习自然语言处理 Tensorflow 深度学习 text-generation Python machine-translation dialog-systems texar bert gpt-2 xlnet text-data data-processing

Python 2.39 k

4 年前

BrikerMan / Kashgari

#自然语言处理#Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.

自然语言处理 sequence-labeling text-classification bert-model ner 机器学习 nlp-framework named-entity-recognition gpt-2 transfer-learning seq2seq bert text-labeling

Python 2.39 k

1 年前