pre-training · GitHub Topics

chain-of-thought ChatGPT in-context-learning instruction-tuning large-language-models 大语言模型自然语言处理 pre-trained-language-models pre-training rlhf

Python 11.7 k

5 个月前

modelscope / data-juicer

#大语言模型#Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

数据分析数据科学 large-language-models 大语言模型数据可视化 instruction-tuning pre-training multi-modal synthetic-data data data-pipeline data-processing foundation-models

Python 4.9 k

4 小时前

dbiir / UER-py

#自然语言处理#Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

bert pre-training fine-tuning gpt 中文自然语言处理 PyTorch elmo classification ner t5 unilm roberta albert gpt-2 model-zoo bart xlm-roberta

Python 3.07 k

1 年前

ChandlerBang / awesome-self-supervised-gnn

#计算机科学#Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

graph-neural-networks pretraining self-supervised-learning 深度学习机器学习 pre-training

Python 1.68 k

1 年前

EgoAlpha / prompt-in-context-learning

#大语言模型#Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates. - Professor Yu Liu

chain-of-thought 聊天机器人 ChatGPT ChatGPT API cot in-context-learning language-modeling 大语言模型 pre-training prompt prompt-engineering prompt-learning ai-agent

Jupyter Notebook 1.62 k

1 个月前

LirongWu / awesome-graph-self-supervised-learning

#计算机科学#Code for TKDE paper "Self-supervised learning on graphs: Contrastive, generative, or predictive"

self-supervised-learning 机器学习 unsupervised-learning graph-neural-networks pre-training data-augmentation representation-learning transfer-learning 深度学习

1.41 k

1 年前

zjunlp / KnowLM

#计算机科学#An Open-sourced Knowledgable Large Language Model Framework.

llama large-language-models pre-trained-language-models language-model instruction-following 深度学习中文 english instructions models reasoning gpt-3 deepspeed instruction-tuning lora pre-training pre-trained-model

Python 1.33 k

7 个月前

yzhuoning / Awesome-CLIP

Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).

clip contrastive-learning pre-training

1.21 k

1 年前

SalesforceAIResearch / uni2ts

#计算机科学#Unified Training of Universal Time Series Forecasting Transformers

深度学习 forecasting 机器学习 pre-trained-models pre-training representation-learning time-series time-series-forecasting transformers

Jupyter Notebook 1.2 k

8 小时前

qingsongedu / Awesome-TimeSeries-SpatioTemporal-LM-LLM

A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series, Spatiotemporal, and Event Data.

anomalydetection autoscaling 深度学习 forecasting foundation-models large-language-models 机器学习 pre-training timeseries

1.12 k

7 个月前

Tencent / TencentPretrain

#自然语言处理#Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

albert bart bert 中文 classification elmo fine-tuning gpt gpt-2 model-zoo 自然语言处理 ner pre-training PyTorch roberta t5 unilm xlm-roberta

Python 1.08 k

1 年前

microsoft / Oscar

Oscar and VinVL

vision-and-language pre-training image-captioning vqa oscar

Python 1.05 k

2 年前

brightmart / bert_language_understanding

#自然语言处理#Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

bert-model language-model attention-is-all-you-need transformer-encoder pre-training language-understanding text-classification document-classification self-attention transfer-learning 自然语言处理 question-answering textcnn fasttext

Python 964

7 年前

ChenRocks / UNITER

Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"

transformers pre-training vision-and-language PyTorch

Python 795

4 年前

jackroos / VL-BERT

Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".

pre-training representation-learning self-supervised-learning vision-and-language bert PyTorch

Jupyter Notebook 743

2 年前

nancheng58 / Awesome-LLM4RS-Papers

#Awesome# Large Language Model-enhanced Recommender System Papers

large-language-models 大语言模型 papers pre-training prompt-tuning recommender-system survey Awesome Lists gpt

692

2 个月前

cxcscmu / Craw4LLM

#网络爬虫#Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

爬虫 crawling large-language-models 大语言模型 pre-training pretraining web-crawler web-crawling

Python 632

5 个月前

princeton-nlp / LLM-Shearing

#自然语言处理#[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

efficiency 大语言模型自然语言处理 pre-training pruning llama llama2

Python 625

1 年前

Shen-Lab / GraphCL

[NeurIPS 2020] "Graph Contrastive Learning with Augmentations" by Yuning You, Tianlong Chen, Yongduo Sui, Ting Chen, Zhangyang Wang, Yang Shen

graph-neural-network contrastive-learning self-supervised-learning pre-training

Python 601

1 年前

linwhitehat / ET-BERT

The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.

pre-training transformer-architecture PyTorch

Python 500

4 个月前